system

Abstract

We provide the system. [Solution] Information acquisition means for acquiring event information via a communication network, An information analysis means that analyzes events related to user interests and generates them as time management information, An integrated means for embedding time management information into the user's mobile device, An implementation method for automating reservations and payments, A notification method to inform the user of the completion of the reservation and payment, A means of informing users in advance of the event date as a reminder, A system that recommends events based on interests and includes means to integrate digital payments.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Users with specific hobbies find it difficult to efficiently collect relevant event and shop information, and often miss important reservation and participation opportunities. In addition, the associated ticket reservation and payment procedures are cumbersome, which impose a great deal of stress and burden on users. As a result, there is a problem that users cannot fully enjoy their hobby activities.

Means for Solving the Problems

[0005] The present invention provides a system that includes information gathering means for collecting information via a communication network, information analysis means for analyzing information related to the user's interests and outputting it as schedule information, integration means for integrating the schedule information into the user's terminal, processing means for automatically executing reservations and payments, notification means for notifying the user of the completion of reservations and payments, and means for notifying the user of event dates in advance as a reminder, thereby enabling users to efficiently manage event information and participate reliably.

[0006] A "communication network" is a system in which multiple computers and devices are interconnected for sending and receiving information.

[0007] "Information gathering means" refers to methods or devices for acquiring necessary data and information via communication networks such as the Internet.

[0008] "Information analysis means" refers to a device or method that processes collected data according to the user's interests and conditions and transforms it into useful information.

[0009] "Schedule information" refers to scheduled events and appointments related to dates and times, and is data compiled in a format that users can manage and refer to.

[0010] An "integration method" is a method or device that brings together multiple different pieces of information or systems in a consistent manner, allowing users to operate them through a single interface.

[0011] "Processing means" refers to a device or program for automatically performing a specific task or operation.

[0012] "Notification means" refers to a device or method for conveying information to a user when a specific event occurs.

[0013] A "reminder" is a feature or tool that sends notifications about specific times or events to help users remember them. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Embodiments for Carrying out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), etc.

[0018] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This system integrates information gathering, analysis, scheduling, booking processes, and notification services to streamline event participation relevant to user interests. Specific implementations are described below.

[0036] The server first uses information gathering methods via the communication network to obtain data relevant to the user's interests from the vast amount of event information available on the internet. Web scraping and open APIs are used for information gathering, and the collected data is stored in a database.

[0037] Next, the server uses information analysis tools to select events that match the user's interests from the acquired data. This selection is based on keywords and conditions registered by the user in advance. The selected events are then formatted as schedule information, including date, location, and availability.

[0038] The formatted schedule information is sent to the user's device via an integration mechanism and automatically added to the user's scheduling app. The device then uses this information to configure notification settings and prepares to provide reminder notifications later.

[0039] The user selects an event they wish to attend from the event list displayed on their device. Upon receiving the selection, the device sends the specific reservation procedure to the server.

[0040] The server uses processing tools to automatically handle booking and payment procedures for selected events. This process is completed by directly accessing external booking and payment systems and entering the necessary information. Secure electronic payment systems are used for payment.

[0041] Once the reservation and payment are complete, the server will use a notification system to inform the user that the process is complete and provide details of the event they will be participating in.

[0042] As a concrete example, consider a case where a user is interested in a "music festival." The server searches for information on relevant music festivals and creates a list of available events. When the user selects an event they want to attend, the process of purchasing a ticket and making a payment is automatically initiated. As the event date approaches, the device sends a reminder to the user, prompting them to attend. In this way, users can smoothly participate in events they are interested in, saving time and effort.

[0043] The following describes the processing flow.

[0044] Step 1:

[0045] The server receives keywords and conditions related to the user's interests and uses the communication network to collect event information from the internet. Web scraping techniques and APIs are used to obtain detailed information such as event name, date and time, and location. This information is stored in a database.

[0046] Step 2:

[0047] The server analyzes the information collected using data analysis tools. First, it selects event entries that match the user's interests and organizes them by date, time, location, etc. The analyzed information is then formatted as schedule information based on each user's interests.

[0048] Step 3:

[0049] The server sends organized schedule information to the device. The device then automatically adds events to the user's scheduling app based on the received information. At this stage, alarms and notifications are incorporated into the schedule based on the notification conditions set by the user.

[0050] Step 4:

[0051] The user views the event list provided on the device and selects the event they wish to attend. The device records the user's selection and requests the server to execute the reservation.

[0052] Step 5:

[0053] The server initiates the reservation and payment process based on the user's selection. It accesses external reservation and payment systems, automatically entering the necessary information to complete the reservation. Electronic payment systems are used for secure and reliable payment.

[0054] Step 6:

[0055] After confirming the completion of the reservation and payment, the server will send a completion notification to the user using a notification method. The notification will include reservation details and important event information.

[0056] Step 7:

[0057] The device sends reminders to the user based on a pre-set schedule as the event date approaches. This ensures the user is prepared to attend the event without forgetting.

[0058] (Example 1)

[0059] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0060] In today's information society, there is a need for a system that can quickly gather event information of interest to users and allow them to participate efficiently. Existing methods are time-consuming and cumbersome for information gathering, filtering, and event registration procedures, hindering improvements in the user experience. Therefore, there is a need for a new system that automatically analyzes event information of interest to users, manages it as a schedule, and centrally handles the registration process.

[0061] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0062] In this invention, the server includes means for collecting event information via a communication network, means for storing the collected event information in a database, and means for analyzing the event information based on specified conditions and formatting it as schedule information. This allows users to automatically obtain event information that matches their interests and efficiently proceed with event participation.

[0063] A "communication network" is a system for sending and receiving data between computers and information devices.

[0064] "Event information" refers to detailed data about events and gatherings, including the date, location, purpose, and participation requirements.

[0065] A "database" is an information system built to efficiently store, manage, and retrieve various types of information.

[0066] "Conditions" refer to information used as criteria or filters based on the user's interests and desires.

[0067] "Analysis" is a computational process that classifies and analyzes collected data according to a specific purpose and derives conclusions.

[0068] "Schedule information" refers to time management information related to specific activities or events, such as dates, times, and locations.

[0069] "Integration" is the process of centralizing multiple pieces of information and making them available for use as a whole system.

[0070] A "reservation" is the process of securing an event or service in advance and gaining the right to use it.

[0071] "Payment" refers to the procedure of paying money as compensation for goods or services.

[0072] The following describes embodiments for carrying out this invention. This system aims to streamline the process of users participating in events of interest.

[0073] First, the server collects event information via the communication network. This process utilizes web scraping techniques, and Python's BeautifulSoup or Requests libraries can be used. Alternatively, when obtaining information using open APIs, APIs from common event service providers can be used. The server temporarily organizes this data into JSON format and then stores it in a database system. MySQL®, an open-source relational database management system, can be used as the database.

[0074] The server analyzes the stored data based on keywords and conditions pre-registered by the user. The analysis uses the Pandas data processing library to perform necessary filtering and aggregation. The analysis results are formatted as schedule information and sent to the user's terminal. This transmission can be achieved, for example, using the HTTP protocol.

[0075] The device can automatically add data to its local scheduling application based on the received schedule information. For example, it can create calendar entries directly using the Google® Calendar API. Based on this information, the device sets up notifications and prepares to generate reminders at the appropriate time.

[0076] The user reviews the event list displayed on the device and selects the events they are interested in. Selection is primarily done through the touchscreen interface. Once the user makes a selection, the device sends that information to the server.

[0077] The server automatically handles booking and payment for selected events. Common booking and payment system APIs can be used for the booking and payment processes. For example, payments can be made via a secure electronic payment system as an external API.

[0078] For example, if a user is interested in a "music festival," the server collects relevant information and formats the data appropriately. Once the user selects an event they wish to attend, the system automatically completes the ticket reservation and payment. As the event date approaches, the device sends a reminder to inform the user that the date is fast approaching.

[0079] An example of a prompt statement is as follows:

[0080] "The keyword for events that users are interested in is 'music festivals.' Please collect relevant event information and create a list of events they can attend."

[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0082] Step 1:

[0083] The server collects event information via the internet. It receives keywords related to the user's interests (e.g., "music festival") as input. It uses web scraping techniques and open APIs to collect a wide range of relevant event information. The obtained data is converted to JSON format and stored in a database for analysis in the next step.

[0084] Step 2:

[0085] The server parses event information stored in the database. It receives event data obtained in step 1 and user-defined filtering conditions (e.g., date, location, price range) as input. Using the Pandas library, it filters and aggregates the data to identify events that match the user's criteria. The output is a list of matching events, formatted as schedule information.

[0086] Step 3:

[0087] The server sends the formatted schedule information to the user's device. It receives the event list created in step 2 as input. It sends this information to the device via the HTTP protocol. The device parses the received data and formats it for registration in its local scheduling app.

[0088] Step 4:

[0089] The device adds the schedule information to its local scheduling application. It receives the schedule information received in step 3 as input. It automatically creates schedule entries using the Google Calendar API or similar. The device also configures notifications, preparing to issue reminder notifications later.

[0090] Step 5:

[0091] The user selects an event they wish to attend from the event list displayed on the terminal. They refer to the event information displayed on the terminal as input. The user makes their selection using the touchscreen or other interface, and the user's selection is sent to the terminal for the next reservation process.

[0092] Step 6:

[0093] The terminal sends the user's selected event information to the server. The server receives the user's selected event information as input. The server prepares to process the selected event information to execute the automated booking and payment process.

[0094] Step 7:

[0095] The server automatically handles the booking and payment for the selected event. It receives the event information obtained in step 6 as input. Necessary procedures are performed via external booking system APIs and payment system APIs. The output is booking confirmation data, including information indicating that payment has been completed.

[0096] Step 8:

[0097] The server notifies the user that the reservation and payment are complete. It receives the output result from step 7 as input. It sends the user a reservation confirmation and event details using email or a push notification service. As the event date approaches, the device issues a reminder to let the user know that they will be attending.

[0098] (Application Example 1)

[0099] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0100] It is not easy for users to identify the event that best suits their interests and schedules from a wide variety of event information, and to efficiently make reservations and payments. Furthermore, timely reminder notifications are necessary to ensure smooth participation in these events. In conventional systems, these processes are handled independently, resulting in a cumbersome process and an inconsistent user experience.

[0101] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0102] In this invention, the server includes information acquisition means for acquiring event information via a communication network, information analysis means for analyzing events related to the user's interests and generating time management information, and integration means for incorporating the time management information into the user's mobile terminal. This enables a consistent user experience that integrates efficient searching, booking, payment, and reminder notifications for events based on the user's interests.

[0103] A "communication network" is a set of interconnected systems used to send and receive data, including the internet and other digital communication media.

[0104] An "information acquisition module" is a component that has the function of collecting data from external information sources and importing it into an internal system.

[0105] "User interests" refer to the interests and preferences that individual users have regarding specific fields or activities.

[0106] "Analysis" refers to the process of processing collected data and deriving meanings and trends that are relevant to a specific purpose.

[0107] "Time management information" refers to data related to schedules and reminders used to coordinate and manage events and tasks.

[0108] An "integration module" is a component that combines various types of data and information within a single system, ensuring consistency and functionality.

[0109] A "mobile device" is a device with information processing capabilities designed to be carried by the user at all times, and primarily refers to smartphones and tablets.

[0110] An "executable module" is an element within a system that has the functionality to perform specific operations or processes defined within the system.

[0111] A "notification module" is a component that provides the functionality to inform users of information based on specific times or conditions.

[0112] "Digital payment" refers to the process of paying for goods and services electronically via the internet, using methods such as credit cards and electronic wallets.

[0113] A "reminder" is a notification or alert that reminds a user of a specific task or event based on a pre-set time or conditions.

[0114] The system that implements this application consists of the following main components: The server uses an information acquisition module to obtain event information via a communication network. This module has the functionality to access external data sources and collect useful event information using web scraping and open APIs. The collected data is stored in a database and used for subsequent processing.

[0115] The information analysis module analyzes event information collected based on user interests. This module uses machine learning algorithms to infer user preferences and select events that match them. This analysis utilizes the Python library TENSORFLOW® to generate an optimal event list based on keywords and interests registered by the user in advance.

[0116] The integration module is responsible for embedding the generated time management information into the user's mobile device and automatically adding it to the scheduling application. This allows users to manage their schedules smoothly and receive reminder notifications from their devices. Firebase Cloud Messaging is used in this process.

[0117] The executable module automates event booking and payment. It connects to external payment platforms via APIs and processes payments directly using Stripe and other electronic payment systems.

[0118] The notification module informs users of the completion of booking and payment, and sends reminders as the event date approaches. It also sends immediate notifications to end users' mobile devices via Firebase Cloud Messaging, based on the scheduled event time.

[0119] For example, if a user expresses interest in "cutting-edge technology events," the system collects and analyzes that information to recommend relevant events. The user can then select an event from the recommendations and complete the reservation and payment with a single click within the application. As the event date approaches, a notification is sent to the device, encouraging the user to attend.

[0120] Examples of prompts to input into a generative AI model:

[0121] "We want to develop an app that automatically finds events users are interested in and allows for smooth booking and payment. Could you tell us about the main features of this app?"

[0122] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0123] Step 1:

[0124] The server uses an information acquisition module to collect publicly available event information via the communication network. Keywords and regions are provided as input, and data is retrieved via web scraping or APIs based on these conditions. The output is a list of the collected event data. This list is stored in a database and used for subsequent processing.

[0125] Step 2:

[0126] The server uses an information analysis module to perform data analysis based on user interests. The input consists of interest keywords pre-registered by the user and event data obtained in step 1. TensorFlow is used to evaluate the relevance of events using a machine learning algorithm. This generates an optimized event list as output.

[0127] Step 3:

[0128] The server sends the event list generated by the integration module to the user's mobile device and adds it to the calendar app. The input is the event list generated in step 2, and the output is the event information registered in the calendar app on the device. Firebase Cloud Messaging is used in this process to synchronize information in real time.

[0129] Step 4:

[0130] The user selects an event they wish to attend from a list of events presented in the scheduling app on their device. After selection, the device sends that information to the server for reservation. The input is the user's selected event information, and the output is the reservation request received by the server.

[0131] Step 5:

[0132] The server automates booking and payment through an executable module. The input is the booking request from step 4, and payment is processed using the Stripe API. The output is confirmation that the booking and payment are complete. This confirmation is shared with the user via a notification module.

[0133] Step 6:

[0134] The server uses a notification module to inform the user of the completion of the reservation and payment, and to send a reminder notification as the event approaches. The input is payment completion information and the date and time of the event, and the output is a notification message to the user's device. In this step, Firebase Cloud Messaging is again used to send notifications.

[0135] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0136] This invention is a system that automates the management of event information based on the user's interests and emotional state, and proposes it in the most optimal form. This system is realized by combining information gathering means, information analysis means, integration means, processing means, notification means, reminder means, and an emotion engine.

[0137] First, the server utilizes information gathering tools via the communication network to collect event information from the internet. During this process, keywords and conditions related to the user's interests are taken into consideration. The resulting data is then stored in a database.

[0138] Next, the emotion engine takes on the role of recognizing the user's emotions. User emotion data is collected in real time through sensors built into the device and user input information. The server interprets this emotion data using information analysis tools and selects appropriate events according to the user's emotions. In this step, the user's current emotions and past emotional tendencies are taken into consideration, and the most suitable event suggestions are made for the user.

[0139] The selected events are formatted as schedule information and integrated with the user's device through an integration mechanism. The device receives this information and automatically adds the events to its scheduling app. Furthermore, the notification mechanism adjusts the content of notifications according to the user's emotional state, providing information in the most optimal way for the user.

[0140] When a user selects an event they wish to attend, the terminal sends the selection to the server, and the processing system initiates the reservation and payment process. The processing system works in conjunction with an external system to securely and automatically complete the necessary reservation procedures and payments. After completion, the server notifies the user using a notification system.

[0141] For example, if a user wants to relax after a busy day, the emotion engine recognizes the user's state and prioritizes suggesting relaxing music events. The device notifies the user of these events, automatically handles reservations and payments if the user is interested, and uses a reminder function to ensure they don't forget to attend. This allows users to efficiently participate in events and have an emotionally fulfilling experience.

[0142] The following describes the processing flow.

[0143] Step 1:

[0144] The server receives keywords and conditions related to the user's interests and uses information gathering methods to collect event information from the internet. This includes web scraping techniques and API integration. The collected data is stored in a database for later processing.

[0145] Step 2:

[0146] The device utilizes an emotion engine to recognize the user's emotional state. This is a process that acquires emotional data in real time through the device's built-in sensors and user input data (such as text and voice).

[0147] Step 3:

[0148] The server compares event information collected through information analysis tools with user emotion data from the emotion engine. Based on the analysis results, it selects events that match the user's current emotional state and generates event suggestions that are most suitable for the user.

[0149] Step 4:

[0150] The server sends the generated schedule information to the user's device via an integration mechanism. The device receives this information and adds the event to the user's scheduling app. Simultaneously, the notification content is adjusted according to the user's mood, resulting in effective notification settings.

[0151] Step 5:

[0152] The user reviews the event list displayed on their device and selects the events they wish to participate in. The device receives the selection and sends it as an instruction to the server.

[0153] Step 6:

[0154] The server, based on the user's selection, executes event booking and payment through processing mechanisms. This involves direct communication with external booking and payment systems, automatically inputting the necessary data, and completing the procedure.

[0155] Step 7:

[0156] After the reservation and payment are complete, the server will send a completion notification to the user using a notification system. This notification will include detailed information about the event and the next steps.

[0157] Step 8:

[0158] The device sends reminders to the user as the event date and time approaches. Based on a pre-set schedule, the reminders help users remember the event and participate smoothly.

[0159] (Example 2)

[0160] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0161] There is a challenge in that users have difficulty selecting appropriate events and activities in their daily lives and receiving suggestions that match their emotions and interests. Furthermore, finding the right event from a large amount of information and efficiently making reservations and payments is time-consuming and laborious. Moreover, the complexity of these processes can sometimes detract from the user experience.

[0162] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0163] In this invention, the server includes information acquisition means for collecting data via a communication network, analysis means for analyzing information related to the user's interests and emotions and outputting it as activity information, and integration means for integrating the activity information into the user's device. This makes it possible for the user to be offered optimal events according to their individual interests and emotions, and to automate and efficiently carry out the reservation and payment process.

[0164] A "communication network" is a collection of systems and technologies used to send and receive data, such as the internet, which connects multiple computing devices to enable information exchange.

[0165] "Information acquisition means" refers to methods and devices for collecting data, and provides the function of collecting necessary information based on specified ranges and conditions.

[0166] "Analysis tools" refer to methods and devices for analyzing user data, and have the function of evaluating data and gaining insights to achieve a specific purpose.

[0167] "Activity information" refers to information related to events and activities, generated based on the user's interests and emotions, and is intended to assist in decision-making.

[0168] "Integration means" are methods and devices for combining and integrating different information and data, enabling efficient management and utilization.

[0169] "Execution means" refers to methods or devices for automatically performing processes such as reservations and payments, and which have functions to ensure efficiency and security.

[0170] A "notification means" is a method or device for informing a user of specific information, and provides a function to reliably deliver important updates and completion notifications.

[0171] A "reminder" is a notification method that informs users in advance that a specific event or activity is approaching, helping them to take action without forgetting.

[0172] This invention provides a system that manages event information based on users' interests and emotions and proposes it in the most optimal way. This system is implemented using a communication network that includes servers and terminals.

[0173] The server collects event information from various data sources on the internet through information acquisition methods. During this process, it efficiently filters the necessary information, taking into account keywords and conditions specified by the user. The collected data is stored in a database and managed using data structuring technologies.

[0174] The device collects user emotion data in real time using built-in sensors and user input. This data is sent to a server and analyzed using an emotion engine. Using Natural Language Processing (NLP) technology, the server interprets the user's text-based emotions and selects the most relevant events for the user. Activity information based on the analysis results is sent to the user's device via an integration mechanism and automatically integrated into the scheduling app.

[0175] For events selected by the user, the terminal sends the selection to the server, and the execution mechanism automatically handles the process in conjunction with an external reservation and payment system. Once this process is complete, the user is notified of the result via a notification system. As a concrete example, a user who feels stressed from their daily work might be offered a relaxing event by the system. This suggestion is based on the user's emotional state, and the automation of the entire process efficiently ensures a relaxing experience.

[0176] An example of a prompt for the generating AI model would be, "Based on the user's sentiment analysis results, please suggest activities that will help them refresh." Through this system, users can receive highly customized suggestions tailored to their individual emotional state.

[0177] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0178] Step 1:

[0179] The server uses information acquisition methods via the communication network to collect event information from data sources on the internet. It receives keywords and conditions specified by the user as input, and a web crawler searches and collects data based on this. After collection, this information is stored in a structured format in a database in preparation for later analysis. Specifically, a crawler built with a programming language such as Python visits relevant websites to extract event information.

[0180] Step 2:

[0181] The device collects user emotion data in real time through sensors and direct user input. Input includes user interactions such as voice and text. This data is immediately sent to a server and interpreted by an emotion engine. Natural Language Processing (NLP) techniques are used for data processing, analyzing the type and intensity of emotions. The output is a user emotion profile. Specific operations include a process where speech recognition software analyzes the tone of the user's voice.

[0182] Step 3:

[0183] The server uses analytical tools to select the most suitable events for the user based on the emotional profile obtained from the emotion engine. The input is data related to the user's emotional tendencies and interests, and the output is information about the selected events. For data processing, it uses past user data and applies an AI algorithm to determine the optimal event candidates. Activity information is then organized and sent to the next stage.

[0184] Step 4:

[0185] The server formats the selected events through the integration mechanism and sends them to the user's terminal. The input is the selected event information, and the output is the event registered in the scheduling app on the terminal. Data processing includes operations to adapt the data to the user's calendar format. Specifically, there is an implementation that automatically adds events to the calendar app via an API.

[0186] Step 5:

[0187] When a user selects to participate in an event on their device, the device sends this selection information to a server, and the system automatically handles the reservation and payment using an execution mechanism. Integration with an external reservation system allows for the acquisition of reservation data as input and confirmed reservation information as output. This enables a secure and rapid process. Specific execution includes the payment process via calls to an external API.

[0188] Step 6:

[0189] The server notifies the user that the reservation and payment are complete and transmits the information to the user via the terminal. The input is the completion status of the procedure, and the output is the notification message to the user. This information is sent to the terminal in real time via the notification method. Specifically, push notification functionality is utilized so that the information is delivered to the user immediately.

[0190] (Application Example 2)

[0191] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0192] The goal is to provide a system that suggests the most suitable products and events based on the user's emotional state, enabling efficient selection and purchase. Conventional systems struggled to adequately consider user interests and emotions, resulting in an insufficient user experience. Furthermore, there was a need to reduce user effort by automating event scheduling and payment.

[0193] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0194] In this invention, the server includes information gathering means for collecting information via a communication network, information analysis means for analyzing the information based on the user's interests and emotional state and outputting it as schedule information, and integration means for integrating the schedule information with the user's communication device. This makes it possible to suggest products and events optimized based on the user's emotional state and to automatically and efficiently execute reservations and digital transactions.

[0195] "Information gathering means" refers to a device or process for acquiring data from external sources via a communication network and collecting necessary information.

[0196] "Information analysis means" refers to a device or process for analyzing users' interests and emotional states from collected data and generating appropriate information.

[0197] "Integration means" refers to a device or process for incorporating the analyzed information as schedule information into the user's communication device.

[0198] "Processing means" refers to a device or process that performs the procedures necessary to automatically execute reservations and digital transactions.

[0199] "Notification means" refers to a device or process for communicating information about completed reservations and digital transactions to the user.

[0200] A "reminder device" is a device or process used to notify a user in advance when an event or appointment is approaching.

[0201] "Emotional analysis means" refers to a device or process that analyzes a user's emotional state in real time and makes appropriate suggestions based on the results.

[0202] This system suggests optimal products and events based on the user's emotional state and interests, and automates the purchase and participation process. The core of the system consists of a server and user terminals, which exchange data with each other using various hardware and software.

[0203] The server collects information through the communication network. It uses API services to retrieve event information and product data from the internet. This information is stored in a database.

[0204] The server uses an emotion analysis API to analyze the user's emotions. Emotional data is collected by sensors and cameras attached to the user's device. The server also analyzes the user's emotional state in real time and interprets the results using information analysis tools. Based on this, it can suggest events and products that are best suited to the user.

[0205] The selected information is formatted as schedule information and integrated with the user's device using an integration mechanism. The device automatically manages this information using a scheduling app and sends notifications and reminders to the user as needed.

[0206] The processing system executes reservations and digital transactions according to the user's selection. It connects to a highly secure external payment system to automatically complete payments. Once all procedures are complete, the server notifies the user of the results using a notification system.

[0207] As a concrete example, if a user is feeling stressed, the system suggests purchasing relaxation products and allows the user to complete the purchase with a single click. In this process, the generative AI model utilizes prompts such as: "Design the specifications for a purchase support app that provides product suggestions tailored to the user's emotion when that emotion is detected. How should product suggestions be optimized if the user's emotion is relaxation?"

[0208] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0209] Step 1:

[0210] The server uses information gathering tools via a communication network to acquire event information and product data from external sources. Input is publicly available data on the internet, and output is raw data stored in a database. This data is collected via an API service and stored in the server's internal database.

[0211] Step 2:

[0212] Sensors and cameras attached to the user's device detect the user's emotional state in real time. The input is raw emotional data acquired from the sensors, and the output is analyzable emotional information sent to the server. This information is transmitted to the server as a digital signal.

[0213] Step 3:

[0214] The server analyzes emotional information using an emotion analysis API. The input is the user's emotional information, and the output is the analyzed emotional state. This analysis result is combined with the user's interest information by an information analysis tool to generate optimal event or product suggestions.

[0215] Step 4:

[0216] The server selects the most suitable events and products for the user based on the analysis and synthesis results. The input here is the analysis results, and the output is a list of selected events and products. Prompts are used to improve the accuracy of the suggestions using a generative AI model.

[0217] Step 5:

[0218] Selected event and product information is sent from the server to the user's terminal and automatically added to the scheduling app via an integration mechanism. The input is the selected event information, and the output is the scheduling app on the user's terminal.

[0219] Step 6:

[0220] The terminal initiates the reservation and purchase process for the event or product selected by the user. Input is the user's selection information, and output is information confirming the completion of the reservation or purchase. The processing mechanism integrates with an external payment system to ensure secure transactions.

[0221] Step 7:

[0222] The server notifies the user of the details of completed transactions. The input is the completed transaction information, and the output is a notification message sent to the terminal. Through this notification, the user can confirm the completion of the transaction.

[0223] Step 8:

[0224] The system uses a reminder mechanism to notify users in advance of event dates. The input is event information registered in the schedule, and the output is a reminder notification. The device provides timely notifications to ensure users don't forget events.

[0225] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0226] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0227] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0228] [Second Embodiment]

[0229] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0230] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0231] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0232] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0233] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0234] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0235] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0236] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0237] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0238] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0239] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0240] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0241] This system integrates information gathering, analysis, scheduling, booking processes, and notification services to streamline event participation relevant to user interests. Specific implementations are described below.

[0242] The server first uses information gathering methods via the communication network to obtain data relevant to the user's interests from the vast amount of event information available on the internet. Web scraping and open APIs are used for information gathering, and the collected data is stored in a database.

[0243] Next, the server uses information analysis tools to select events that match the user's interests from the acquired data. This selection is based on keywords and conditions registered by the user in advance. The selected events are then formatted as schedule information, including date, location, and availability.

[0244] The formatted schedule information is sent to the user's device via an integration mechanism and automatically added to the user's scheduling app. The device then uses this information to configure notification settings and prepares to provide reminder notifications later.

[0245] The user selects an event they wish to attend from the event list displayed on their device. Upon receiving the selection, the device sends the specific reservation procedure to the server.

[0246] The server uses processing tools to automatically handle booking and payment procedures for selected events. This process is completed by directly accessing external booking and payment systems and entering the necessary information. Secure electronic payment systems are used for payment.

[0247] Once the reservation and payment are complete, the server will use a notification system to inform the user that the process is complete and provide details of the event they will be participating in.

[0248] As a concrete example, consider a case where a user is interested in a "music festival." The server searches for information on relevant music festivals and creates a list of available events. When the user selects an event they want to attend, the process of purchasing a ticket and making a payment is automatically initiated. As the event date approaches, the device sends a reminder to the user, prompting them to attend. In this way, users can smoothly participate in events they are interested in, saving time and effort.

[0249] The following describes the processing flow.

[0250] Step 1:

[0251] The server receives keywords and conditions related to the user's interests and uses the communication network to collect event information from the internet. Web scraping techniques and APIs are used to obtain detailed information such as event name, date and time, and location. This information is stored in a database.

[0252] Step 2:

[0253] The server analyzes the information collected using data analysis tools. First, it selects event entries that match the user's interests and organizes them by date, time, location, etc. The analyzed information is then formatted as schedule information based on each user's interests.

[0254] Step 3:

[0255] The server sends organized schedule information to the device. The device then automatically adds events to the user's scheduling app based on the received information. At this stage, alarms and notifications are incorporated into the schedule based on the notification conditions set by the user.

[0256] Step 4:

[0257] The user views the event list provided on the device and selects the event they wish to attend. The device records the user's selection and requests the server to execute the reservation.

[0258] Step 5:

[0259] The server initiates the reservation and payment process based on the user's selection. It accesses external reservation and payment systems, automatically entering the necessary information to complete the reservation. Electronic payment systems are used for secure and reliable payment.

[0260] Step 6:

[0261] After confirming the completion of the reservation and payment, the server will send a completion notification to the user using a notification method. The notification will include reservation details and important event information.

[0262] Step 7:

[0263] The device sends reminders to the user based on a pre-set schedule as the event date approaches. This ensures the user is prepared to attend the event without forgetting.

[0264] (Example 1)

[0265] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0266] In today's information society, there is a need for a system that can quickly gather event information of interest to users and allow them to participate efficiently. Existing methods are time-consuming and cumbersome for information gathering, filtering, and event registration procedures, hindering improvements in the user experience. Therefore, there is a need for a new system that automatically analyzes event information of interest to users, manages it as a schedule, and centrally handles the registration process.

[0267] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0268] In this invention, the server includes means for collecting event information via a communication network, means for storing the collected event information in a database, and means for analyzing the event information based on specified conditions and formatting it as schedule information. This allows users to automatically obtain event information that matches their interests and efficiently proceed with event participation.

[0269] A "communication network" is a system for sending and receiving data between computers and information devices.

[0270] "Event information" refers to detailed data about events and gatherings, including the date, location, purpose, and participation requirements.

[0271] A "database" is an information system built to efficiently store, manage, and retrieve various types of information.

[0272] "Conditions" refer to information used as criteria or filters based on the user's interests and desires.

[0273] "Analysis" is a computational process that classifies and analyzes collected data according to a specific purpose and derives conclusions.

[0274] "Schedule information" refers to time management information related to specific activities or events, such as dates, times, and locations.

[0275] "Integration" is the process of centralizing multiple pieces of information and making them available for use as a whole system.

[0276] A "reservation" is the process of securing an event or service in advance and gaining the right to use it.

[0277] "Payment" refers to the procedure of paying money as compensation for goods or services.

[0278] The following describes embodiments for carrying out this invention. This system aims to streamline the process of users participating in events of interest.

[0279] First, the server collects event information via the communication network. This process utilizes web scraping techniques, and Python's BeautifulSoup or Requests libraries can be used. Alternatively, when obtaining information using open APIs, APIs from common event service providers can be used. The server temporarily organizes this data into JSON format and then stores it in a database system. MySQL, an open-source relational database management system, can be used as the database.

[0280] The server analyzes the stored data based on keywords and conditions pre-registered by the user. The analysis uses the Pandas data processing library to perform necessary filtering and aggregation. The analysis results are formatted as schedule information and sent to the user's terminal. This transmission can be achieved, for example, using the HTTP protocol.

[0281] The device can automatically add data to its local scheduling application based on the received schedule information. For example, it can create calendar entries directly using the Google Calendar API. Based on this information, the device can configure notification settings and prepare to generate reminders at the appropriate time.

[0282] The user reviews the event list displayed on the device and selects the events they are interested in. Selection is primarily done through the touchscreen interface. Once the user makes a selection, the device sends that information to the server.

[0283] The server automatically handles booking and payment for selected events. Common booking and payment system APIs can be used for the booking and payment processes. For example, payments can be made via a secure electronic payment system as an external API.

[0284] As a specific example, when a user is interested in a "music festival", the server collects relevant information and formats appropriate data. When the user selects an event they wish to participate in, the system automatically completes ticket reservation and payment. When the event schedule approaches, the terminal notifies the reminder to inform the user that the schedule is approaching.

[0285] Examples of prompt sentences are as follows.

[0286] "The keyword of the event that the user is interested in is'music festival'. Please collect relevant event information and create a list of events that can be participated in."

[0287] The flow of the specific process in Example 1 will be described using FIG. 11.

[0288] Step 1:

[0289] The server collects event information via the Internet. As input, it receives keywords related to the user's interests (e.g., "music festival"). Using web scraping technology and open APIs, it widely collects relevant event information. The obtained data is converted into JSON format and stored in a database for analysis in the next step.

[0290] Step 2:

[0291] The server analyzes the event information stored in the database. As input, it receives the event data obtained in Step 1 and the filtering conditions (e.g., date, location, price range) previously set by the user. Using the Pandas library, it filters and aggregates the data to identify events that match the user's conditions. The output is a list of events that meet the conditions, formatted as schedule information.

[0292] Step 3:

[0293] The server sends the formatted schedule information to the user's device. It receives the event list created in step 2 as input. It sends this information to the device via the HTTP protocol. The device parses the received data and formats it for registration in its local scheduling app.

[0294] Step 4:

[0295] The device adds the schedule information to its local scheduling application. It receives the schedule information received in step 3 as input. It automatically creates schedule entries using the Google Calendar API or similar. The device also configures notifications, preparing to issue reminder notifications later.

[0296] Step 5:

[0297] The user selects an event they wish to attend from the event list displayed on the terminal. They refer to the event information displayed on the terminal as input. The user makes their selection using the touchscreen or other interface, and the user's selection is sent to the terminal for the next reservation process.

[0298] Step 6:

[0299] The terminal sends the user's selected event information to the server. The server receives the user's selected event information as input. The server prepares to process the selected event information to execute the automated booking and payment process.

[0300] Step 7:

[0301] The server automatically handles the booking and payment for the selected event. It receives the event information obtained in step 6 as input. Necessary procedures are performed via external booking system APIs and payment system APIs. The output is booking confirmation data, including information indicating that payment has been completed.

[0302] Step 8:

[0303] The server notifies the user of the completion of the reservation and payment. As input, it receives the output result of Step 7. It uses email or push notification services to send the reservation completion notice and event details to the user. When the event schedule approaches, the terminal issues a reminder to inform the user of the planned participation.

[0304] (Application Example 1)

[0305] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0306] It is not easy for a user to identify the most suitable events from a variety of event information according to their interests and schedules and to make reservations and payments efficiently. Also, in order to smoothly participate in these events, reminder notifications at appropriate times are necessary. In conventional systems, since these processes are individually independent, there are problems such as being time-consuming and the user experience not being consistent.

[0307] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0308] In this invention, the server includes an information acquisition means for acquiring event information via a communication network, an information analysis means for analyzing events related to the user's interests and generating them as time management information, and an integration means for incorporating the time management information into the user's mobile terminal. Thereby, a consistent user experience integrating efficient search, reservation, settlement, and reminder notification of events based on the user's interests becomes possible.

[0309] The "communication network" is a series of interconnected systems used for transmitting and receiving data, including the Internet and other digital communication media.

[0310] An "information acquisition module" is a component that has the function of collecting data from external information sources and importing it into an internal system.

[0311] "User interests" refer to the interests and preferences that individual users have regarding specific fields or activities.

[0312] "Analysis" refers to the process of processing collected data and deriving meanings and trends that are relevant to a specific purpose.

[0313] "Time management information" refers to data related to schedules and reminders used to coordinate and manage events and tasks.

[0314] An "integration module" is a component that combines various types of data and information within a single system, ensuring consistency and functionality.

[0315] A "mobile device" is a device with information processing capabilities designed to be carried by the user at all times, and primarily refers to smartphones and tablets.

[0316] An "executable module" is an element within a system that has the functionality to perform specific operations or processes defined within the system.

[0317] A "notification module" is a component that provides the functionality to inform users of information based on specific times or conditions.

[0318] "Digital payment" refers to the process of paying for goods and services electronically via the internet, using methods such as credit cards and electronic wallets.

[0319] A "reminder" is a notification or alert that reminds a user of a specific task or event based on a pre-set time or conditions.

[0320] The system that implements this application consists of the following main components: The server uses an information acquisition module to obtain event information via a communication network. This module has the functionality to access external data sources and collect useful event information using web scraping and open APIs. The collected data is stored in a database and used for subsequent processing.

[0321] The information analysis module analyzes event information collected based on user interests. This module uses machine learning algorithms to infer user preferences and select events that match them. This analysis utilizes TensorFlow, a Python library, to generate an optimal event list based on keywords and interests registered by the user in advance.

[0322] The integration module is responsible for embedding the generated time management information into the user's mobile device and automatically adding it to the scheduling application. This allows users to manage their schedules smoothly and receive reminder notifications from their devices. Firebase Cloud Messaging is used in this process.

[0323] The executable module automates event booking and payment. It connects to external payment platforms via APIs and processes payments directly using Stripe and other electronic payment systems.

[0324] The notification module informs users of the completion of booking and payment, and sends reminders as the event date approaches. It also sends immediate notifications to end users' mobile devices via Firebase Cloud Messaging, based on the scheduled event time.

[0325] For example, if a user expresses interest in "cutting-edge technology events," the system collects and analyzes that information to recommend relevant events. The user can then select an event from the recommendations and complete the reservation and payment with a single click within the application. As the event date approaches, a notification is sent to the device, encouraging the user to attend.

[0326] Examples of prompts to input into a generative AI model:

[0327] "We want to develop an app that automatically finds events users are interested in and allows for smooth booking and payment. Could you tell us about the main features of this app?"

[0328] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0329] Step 1:

[0330] The server uses an information acquisition module to collect publicly available event information via the communication network. Keywords and regions are provided as input, and data is retrieved via web scraping or APIs based on these conditions. The output is a list of the collected event data. This list is stored in a database and used for subsequent processing.

[0331] Step 2:

[0332] The server uses an information analysis module to perform data analysis based on user interests. The input consists of interest keywords pre-registered by the user and event data obtained in step 1. TensorFlow is used to evaluate the relevance of events using a machine learning algorithm. This generates an optimized event list as output.

[0333] Step 3:

[0334] The server sends the event list generated by the integration module to the user's mobile device and adds it to the calendar app. The input is the event list generated in step 2, and the output is the event information registered in the calendar app on the device. Firebase Cloud Messaging is used in this process to synchronize information in real time.

[0335] Step 4:

[0336] The user selects an event they wish to attend from a list of events presented in the scheduling app on their device. After selection, the device sends that information to the server for reservation. The input is the user's selected event information, and the output is the reservation request received by the server.

[0337] Step 5:

[0338] The server automates booking and payment through an executable module. The input is the booking request from step 4, and payment is processed using the Stripe API. The output is confirmation that the booking and payment are complete. This confirmation is shared with the user via a notification module.

[0339] Step 6:

[0340] The server uses a notification module to inform the user of the completion of the reservation and payment, and to send a reminder notification as the event approaches. The input is payment completion information and the date and time of the event, and the output is a notification message to the user's device. In this step, Firebase Cloud Messaging is again used to send notifications.

[0341] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0342] This invention is a system that automates the management of event information based on the user's interests and emotional state, and proposes it in the most optimal form. This system is realized by combining information gathering means, information analysis means, integration means, processing means, notification means, reminder means, and an emotion engine.

[0343] First, the server utilizes information gathering tools via the communication network to collect event information from the internet. During this process, keywords and conditions related to the user's interests are taken into consideration. The resulting data is then stored in a database.

[0344] Next, the emotion engine takes on the role of recognizing the user's emotions. User emotion data is collected in real time through sensors built into the device and user input information. The server interprets this emotion data using information analysis tools and selects appropriate events according to the user's emotions. In this step, the user's current emotions and past emotional tendencies are taken into consideration, and the most suitable event suggestions are made for the user.

[0345] The selected events are formatted as schedule information and integrated with the user's device through an integration mechanism. The device receives this information and automatically adds the events to its scheduling app. Furthermore, the notification mechanism adjusts the content of notifications according to the user's emotional state, providing information in the most optimal way for the user.

[0346] When a user selects an event they wish to attend, the terminal sends the selection to the server, and the processing system initiates the reservation and payment process. The processing system works in conjunction with an external system to securely and automatically complete the necessary reservation procedures and payments. After completion, the server notifies the user using a notification system.

[0347] For example, if a user wants to relax after a busy day, the emotion engine recognizes the user's state and prioritizes suggesting relaxing music events. The device notifies the user of these events, automatically handles reservations and payments if the user is interested, and uses a reminder function to ensure they don't forget to attend. This allows users to efficiently participate in events and have an emotionally fulfilling experience.

[0348] The following describes the processing flow.

[0349] Step 1:

[0350] The server receives keywords and conditions related to the user's interests and uses information gathering methods to collect event information from the internet. This includes web scraping techniques and API integration. The collected data is stored in a database for later processing.

[0351] Step 2:

[0352] The device utilizes an emotion engine to recognize the user's emotional state. This is a process that acquires emotional data in real time through the device's built-in sensors and user input data (such as text and voice).

[0353] Step 3:

[0354] The server compares event information collected through information analysis tools with user emotion data from the emotion engine. Based on the analysis results, it selects events that match the user's current emotional state and generates event suggestions that are most suitable for the user.

[0355] Step 4:

[0356] The server sends the generated schedule information to the user's device via an integration mechanism. The device receives this information and adds the event to the user's scheduling app. Simultaneously, the notification content is adjusted according to the user's mood, resulting in effective notification settings.

[0357] Step 5:

[0358] The user reviews the event list displayed on their device and selects the events they wish to participate in. The device receives the selection and sends it as an instruction to the server.

[0359] Step 6:

[0360] The server, based on the user's selection, executes event booking and payment through processing mechanisms. This involves direct communication with external booking and payment systems, automatically inputting the necessary data, and completing the procedure.

[0361] Step 7:

[0362] After the reservation and payment are complete, the server will send a completion notification to the user using a notification system. This notification will include detailed information about the event and the next steps.

[0363] Step 8:

[0364] The device sends reminders to the user as the event date and time approaches. Based on a pre-set schedule, the reminders help users remember the event and participate smoothly.

[0365] (Example 2)

[0366] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0367] There is a challenge in that users have difficulty selecting appropriate events and activities in their daily lives and receiving suggestions that match their emotions and interests. Furthermore, finding the right event from a large amount of information and efficiently making reservations and payments is time-consuming and laborious. Moreover, the complexity of these processes can sometimes detract from the user experience.

[0368] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0369] In this invention, the server includes information acquisition means for collecting data via a communication network, analysis means for analyzing information related to the user's interests and emotions and outputting it as activity information, and integration means for integrating the activity information into the user's device. This makes it possible for the user to be offered optimal events according to their individual interests and emotions, and to automate and efficiently carry out the reservation and payment process.

[0370] A "communication network" is a collection of systems and technologies used to send and receive data, such as the internet, which connects multiple computing devices to enable information exchange.

[0371] "Information acquisition means" refers to methods and devices for collecting data, and provides the function of collecting necessary information based on specified ranges and conditions.

[0372] "Analysis tools" refer to methods and devices for analyzing user data, and have the function of evaluating data and gaining insights to achieve a specific purpose.

[0373] "Activity information" refers to information related to events and activities, generated based on the user's interests and emotions, and is intended to assist in decision-making.

[0374] "Integration means" are methods and devices for combining and integrating different information and data, enabling efficient management and utilization.

[0375] "Execution means" refers to methods or devices for automatically performing processes such as reservations and payments, and which have functions to ensure efficiency and security.

[0376] A "notification means" is a method or device for informing a user of specific information, and provides a function to reliably deliver important updates and completion notifications.

[0377] A "reminder" is a notification method that informs users in advance that a specific event or activity is approaching, helping them to take action without forgetting.

[0378] This invention provides a system that manages event information based on users' interests and emotions and proposes it in the most optimal way. This system is implemented using a communication network that includes servers and terminals.

[0379] The server collects event information from various data sources on the internet through information acquisition methods. During this process, it efficiently filters the necessary information, taking into account keywords and conditions specified by the user. The collected data is stored in a database and managed using data structuring technologies.

[0380] The device collects user emotion data in real time using built-in sensors and user input. This data is sent to a server and analyzed using an emotion engine. Using Natural Language Processing (NLP) technology, the server interprets the user's text-based emotions and selects the most relevant events for the user. Activity information based on the analysis results is sent to the user's device via an integration mechanism and automatically integrated into the scheduling app.

[0381] For events selected by the user, the terminal sends the selection to the server, and the execution mechanism automatically handles the process in conjunction with an external reservation and payment system. Once this process is complete, the user is notified of the result via a notification system. As a concrete example, a user who feels stressed from their daily work might be offered a relaxing event by the system. This suggestion is based on the user's emotional state, and the automation of the entire process efficiently ensures a relaxing experience.

[0382] An example of a prompt for the generating AI model would be, "Based on the user's sentiment analysis results, please suggest activities that will help them refresh." Through this system, users can receive highly customized suggestions tailored to their individual emotional state.

[0383] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0384] Step 1:

[0385] The server uses information acquisition methods via the communication network to collect event information from data sources on the internet. It receives keywords and conditions specified by the user as input, and a web crawler searches and collects data based on this. After collection, this information is stored in a structured format in a database in preparation for later analysis. Specifically, a crawler built with a programming language such as Python visits relevant websites to extract event information.

[0386] Step 2:

[0387] The device collects user emotion data in real time through sensors and direct user input. Input includes user interactions such as voice and text. This data is immediately sent to a server and interpreted by an emotion engine. Natural Language Processing (NLP) techniques are used for data processing, analyzing the type and intensity of emotions. The output is a user emotion profile. Specific operations include a process where speech recognition software analyzes the tone of the user's voice.

[0388] Step 3:

[0389] The server uses analytical tools to select the most suitable events for the user based on the emotional profile obtained from the emotion engine. The input is data related to the user's emotional tendencies and interests, and the output is information about the selected events. For data processing, it uses past user data and applies an AI algorithm to determine the optimal event candidates. Activity information is then organized and sent to the next stage.

[0390] Step 4:

[0391] The server formats the selected events through the integration mechanism and sends them to the user's terminal. The input is the selected event information, and the output is the event registered in the scheduling app on the terminal. Data processing includes operations to adapt the data to the user's calendar format. Specifically, there is an implementation that automatically adds events to the calendar app via an API.

[0392] Step 5:

[0393] When a user selects to participate in an event on their device, the device sends this selection information to a server, and the system automatically handles the reservation and payment using an execution mechanism. Integration with an external reservation system allows for the acquisition of reservation data as input and confirmed reservation information as output. This enables a secure and rapid process. Specific execution includes the payment process via calls to an external API.

[0394] Step 6:

[0395] The server notifies the user that the reservation and payment are complete and transmits the information to the user via the terminal. The input is the completion status of the procedure, and the output is the notification message to the user. This information is sent to the terminal in real time via the notification method. Specifically, push notification functionality is utilized so that the information is delivered to the user immediately.

[0396] (Application Example 2)

[0397] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0398] The goal is to provide a system that suggests the most suitable products and events based on the user's emotional state, enabling efficient selection and purchase. Conventional systems struggled to adequately consider user interests and emotions, resulting in an insufficient user experience. Furthermore, there was a need to reduce user effort by automating event scheduling and payment.

[0399] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0400] In this invention, the server includes information gathering means for collecting information via a communication network, information analysis means for analyzing the information based on the user's interests and emotional state and outputting it as schedule information, and integration means for integrating the schedule information with the user's communication device. This makes it possible to suggest products and events optimized based on the user's emotional state and to automatically and efficiently execute reservations and digital transactions.

[0401] "Information gathering means" refers to a device or process for acquiring data from external sources via a communication network and collecting necessary information.

[0402] "Information analysis means" refers to a device or process for analyzing users' interests and emotional states from collected data and generating appropriate information.

[0403] "Integration means" refers to a device or process for incorporating the analyzed information as schedule information into the user's communication device.

[0404] "Processing means" refers to a device or process that performs the procedures necessary to automatically execute reservations and digital transactions.

[0405] "Notification means" refers to a device or process for communicating information about completed reservations and digital transactions to the user.

[0406] A "reminder device" is a device or process used to notify a user in advance when an event or appointment is approaching.

[0407] "Emotional analysis means" refers to a device or process that analyzes a user's emotional state in real time and makes appropriate suggestions based on the results.

[0408] This system suggests optimal products and events based on the user's emotional state and interests, and automates the purchase and participation process. The core of the system consists of a server and user terminals, which exchange data with each other using various hardware and software.

[0409] The server collects information through the communication network. It uses API services to retrieve event information and product data from the internet. This information is stored in a database.

[0410] The server uses an emotion analysis API to analyze the user's emotions. Emotional data is collected by sensors and cameras attached to the user's device. The server also analyzes the user's emotional state in real time and interprets the results using information analysis tools. Based on this, it can suggest events and products that are best suited to the user.

[0411] The selected information is formatted as schedule information and integrated with the user's device using an integration mechanism. The device automatically manages this information using a scheduling app and sends notifications and reminders to the user as needed.

[0412] The processing system executes reservations and digital transactions according to the user's selection. It connects to a highly secure external payment system to automatically complete payments. Once all procedures are complete, the server notifies the user of the results using a notification system.

[0413] As a concrete example, if a user is feeling stressed, the system suggests purchasing relaxation products and allows the user to complete the purchase with a single click. In this process, the generative AI model utilizes prompts such as: "Design the specifications for a purchase support app that provides product suggestions tailored to the user's emotion when that emotion is detected. How should product suggestions be optimized if the user's emotion is relaxation?"

[0414] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0415] Step 1:

[0416] The server uses information gathering tools via a communication network to acquire event information and product data from external sources. Input is publicly available data on the internet, and output is raw data stored in a database. This data is collected via an API service and stored in the server's internal database.

[0417] Step 2:

[0418] Sensors and cameras attached to the user's device detect the user's emotional state in real time. The input is raw emotional data acquired from the sensors, and the output is analyzable emotional information sent to the server. This information is transmitted to the server as a digital signal.

[0419] Step 3:

[0420] The server analyzes emotional information using an emotion analysis API. The input is the user's emotional information, and the output is the analyzed emotional state. This analysis result is combined with the user's interest information by an information analysis tool to generate optimal event or product suggestions.

[0421] Step 4:

[0422] The server selects the most suitable events and products for the user based on the analysis and synthesis results. The input here is the analysis results, and the output is a list of selected events and products. Prompts are used to improve the accuracy of the suggestions using a generative AI model.

[0423] Step 5:

[0424] Selected event and product information is sent from the server to the user's terminal and automatically added to the scheduling app via an integration mechanism. The input is the selected event information, and the output is the scheduling app on the user's terminal.

[0425] Step 6:

[0426] The terminal initiates the reservation and purchase process for the event or product selected by the user. Input is the user's selection information, and output is information confirming the completion of the reservation or purchase. The processing mechanism integrates with an external payment system to ensure secure transactions.

[0427] Step 7:

[0428] The server notifies the user of the details of completed transactions. The input is the completed transaction information, and the output is a notification message sent to the terminal. Through this notification, the user can confirm the completion of the transaction.

[0429] Step 8:

[0430] The system uses a reminder mechanism to notify users in advance of event dates. The input is event information registered in the schedule, and the output is a reminder notification. The device provides timely notifications to ensure users don't forget events.

[0431] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0432] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0433] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0434] [Third Embodiment]

[0435] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0436] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0437] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0438] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0439] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0440] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0441] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0442] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0443] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0444] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0445] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0446] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0447] This system integrates information gathering, analysis, scheduling, booking processes, and notification services to streamline event participation relevant to user interests. Specific implementations are described below.

[0448] The server first uses information gathering methods via the communication network to obtain data relevant to the user's interests from the vast amount of event information available on the internet. Web scraping and open APIs are used for information gathering, and the collected data is stored in a database.

[0449] Next, the server uses information analysis tools to select events that match the user's interests from the acquired data. This selection is based on keywords and conditions registered by the user in advance. The selected events are then formatted as schedule information, including date, location, and availability.

[0450] The formatted schedule information is sent to the user's device via an integration mechanism and automatically added to the user's scheduling app. The device then uses this information to configure notification settings and prepares to provide reminder notifications later.

[0451] The user selects an event they wish to attend from the event list displayed on their device. Upon receiving the selection, the device sends the specific reservation procedure to the server.

[0452] The server uses processing tools to automatically handle booking and payment procedures for selected events. This process is completed by directly accessing external booking and payment systems and entering the necessary information. Secure electronic payment systems are used for payment.

[0453] Once the reservation and payment are complete, the server will use a notification system to inform the user that the process is complete and provide details of the event they will be participating in.

[0454] As a concrete example, consider a case where a user is interested in a "music festival." The server searches for information on relevant music festivals and creates a list of available events. When the user selects an event they want to attend, the process of purchasing a ticket and making a payment is automatically initiated. As the event date approaches, the device sends a reminder to the user, prompting them to attend. In this way, users can smoothly participate in events they are interested in, saving time and effort.

[0455] The following describes the processing flow.

[0456] Step 1:

[0457] The server receives keywords and conditions related to the user's interests and uses the communication network to collect event information from the internet. Web scraping techniques and APIs are used to obtain detailed information such as event name, date and time, and location. This information is stored in a database.

[0458] Step 2:

[0459] The server analyzes the information collected using data analysis tools. First, it selects event entries that match the user's interests and organizes them by date, time, location, etc. The analyzed information is then formatted as schedule information based on each user's interests.

[0460] Step 3:

[0461] The server sends organized schedule information to the device. The device then automatically adds events to the user's scheduling app based on the received information. At this stage, alarms and notifications are incorporated into the schedule based on the notification conditions set by the user.

[0462] Step 4:

[0463] The user views the event list provided on the device and selects the event they wish to attend. The device records the user's selection and requests the server to execute the reservation.

[0464] Step 5:

[0465] The server initiates the reservation and payment process based on the user's selection. It accesses external reservation and payment systems, automatically entering the necessary information to complete the reservation. Electronic payment systems are used for secure and reliable payment.

[0466] Step 6:

[0467] After confirming the completion of the reservation and payment, the server will send a completion notification to the user using a notification method. The notification will include reservation details and important event information.

[0468] Step 7:

[0469] The device sends reminders to the user based on a pre-set schedule as the event date approaches. This ensures the user is prepared to attend the event without forgetting.

[0470] (Example 1)

[0471] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0472] In today's information society, there is a need for a system that can quickly gather event information of interest to users and allow them to participate efficiently. Existing methods are time-consuming and cumbersome for information gathering, filtering, and event registration procedures, hindering improvements in the user experience. Therefore, there is a need for a new system that automatically analyzes event information of interest to users, manages it as a schedule, and centrally handles the registration process.

[0473] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0474] In this invention, the server includes means for collecting event information via a communication network, means for storing the collected event information in a database, and means for analyzing the event information based on specified conditions and formatting it as schedule information. This allows users to automatically obtain event information that matches their interests and efficiently proceed with event participation.

[0475] A "communication network" is a system for sending and receiving data between computers and information devices.

[0476] "Event information" refers to detailed data about events and gatherings, including the date, location, purpose, and participation requirements.

[0477] A "database" is an information system built to efficiently store, manage, and retrieve various types of information.

[0478] "Conditions" refer to information used as criteria or filters based on the user's interests and desires.

[0479] "Analysis" is a computational process that classifies and analyzes collected data according to a specific purpose and derives conclusions.

[0480] "Schedule information" refers to time management information related to specific activities or events, such as dates, times, and locations.

[0481] "Integration" is the process of centralizing multiple pieces of information and making them available for use as a whole system.

[0482] A "reservation" is the process of securing an event or service in advance and gaining the right to use it.

[0483] "Payment" refers to the procedure of paying money as compensation for goods or services.

[0484] The following describes embodiments for carrying out this invention. This system aims to streamline the process of users participating in events of interest.

[0485] First, the server collects event information via the communication network. This process utilizes web scraping techniques, and Python's BeautifulSoup or Requests libraries can be used. Alternatively, when obtaining information using open APIs, APIs from common event service providers can be used. The server temporarily organizes this data into JSON format and then stores it in a database system. MySQL, an open-source relational database management system, can be used as the database.

[0486] The server analyzes the stored data based on keywords and conditions pre-registered by the user. The analysis uses the Pandas data processing library to perform necessary filtering and aggregation. The analysis results are formatted as schedule information and sent to the user's terminal. This transmission can be achieved, for example, using the HTTP protocol.

[0487] The device can automatically add data to its local scheduling application based on the received schedule information. For example, it can create calendar entries directly using the Google Calendar API. Based on this information, the device can configure notification settings and prepare to generate reminders at the appropriate time.

[0488] The user reviews the event list displayed on the device and selects the events they are interested in. Selection is primarily done through the touchscreen interface. Once the user makes a selection, the device sends that information to the server.

[0489] The server automatically handles booking and payment for selected events. Common booking and payment system APIs can be used for the booking and payment processes. For example, payments can be made via a secure electronic payment system as an external API.

[0490] For example, if a user is interested in a "music festival," the server collects relevant information and formats the data appropriately. Once the user selects an event they wish to attend, the system automatically completes the ticket reservation and payment. As the event date approaches, the device sends a reminder to inform the user that the date is fast approaching.

[0491] An example of a prompt statement is as follows:

[0492] "The keyword for events that users are interested in is 'music festivals.' Please collect relevant event information and create a list of events they can attend."

[0493] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0494] Step 1:

[0495] The server collects event information via the internet. It receives keywords related to the user's interests (e.g., "music festival") as input. It uses web scraping techniques and open APIs to collect a wide range of relevant event information. The obtained data is converted to JSON format and stored in a database for analysis in the next step.

[0496] Step 2:

[0497] The server parses event information stored in the database. It receives event data obtained in step 1 and user-defined filtering conditions (e.g., date, location, price range) as input. Using the Pandas library, it filters and aggregates the data to identify events that match the user's criteria. The output is a list of matching events, formatted as schedule information.

[0498] Step 3:

[0499] The server sends the formatted schedule information to the user's device. It receives the event list created in step 2 as input. It sends this information to the device via the HTTP protocol. The device parses the received data and formats it for registration in its local scheduling app.

[0500] Step 4:

[0501] The device adds the schedule information to its local scheduling application. It receives the schedule information received in step 3 as input. It automatically creates schedule entries using the Google Calendar API or similar. The device also configures notifications, preparing to issue reminder notifications later.

[0502] Step 5:

[0503] The user selects an event they wish to attend from the event list displayed on the terminal. They refer to the event information displayed on the terminal as input. The user makes their selection using the touchscreen or other interface, and the user's selection is sent to the terminal for the next reservation process.

[0504] Step 6:

[0505] The terminal sends the user's selected event information to the server. The server receives the user's selected event information as input. The server prepares to process the selected event information to execute the automated booking and payment process.

[0506] Step 7:

[0507] The server automatically handles the booking and payment for the selected event. It receives the event information obtained in step 6 as input. Necessary procedures are performed via external booking system APIs and payment system APIs. The output is booking confirmation data, including information indicating that payment has been completed.

[0508] Step 8:

[0509] The server notifies the user that the reservation and payment are complete. It receives the output result from step 7 as input. It sends the user a reservation confirmation and event details using email or a push notification service. As the event date approaches, the device issues a reminder to let the user know that they will be attending.

[0510] (Application Example 1)

[0511] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0512] It is not easy for users to identify the event that best suits their interests and schedules from a wide variety of event information, and to efficiently make reservations and payments. Furthermore, timely reminder notifications are necessary to ensure smooth participation in these events. In conventional systems, these processes are handled independently, resulting in a cumbersome process and an inconsistent user experience.

[0513] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0514] In this invention, the server includes information acquisition means for acquiring event information via a communication network, information analysis means for analyzing events related to the user's interests and generating time management information, and integration means for incorporating the time management information into the user's mobile terminal. This enables a consistent user experience that integrates efficient searching, booking, payment, and reminder notifications for events based on the user's interests.

[0515] A "communication network" is a set of interconnected systems used to send and receive data, including the internet and other digital communication media.

[0516] An "information acquisition module" is a component that has the function of collecting data from external information sources and importing it into an internal system.

[0517] "User interests" refer to the interests and preferences that individual users have regarding specific fields or activities.

[0518] "Analysis" refers to the process of processing collected data and deriving meanings and trends that are relevant to a specific purpose.

[0519] "Time management information" refers to data related to schedules and reminders used to coordinate and manage events and tasks.

[0520] An "integration module" is a component that combines various types of data and information within a single system, ensuring consistency and functionality.

[0521] A "mobile device" is a device with information processing capabilities designed to be carried by the user at all times, and primarily refers to smartphones and tablets.

[0522] An "executable module" is an element within a system that has the functionality to perform specific operations or processes defined within the system.

[0523] A "notification module" is a component that provides the functionality to inform users of information based on specific times or conditions.

[0524] "Digital payment" refers to the process of paying for goods and services electronically via the internet, using methods such as credit cards and electronic wallets.

[0525] A "reminder" is a notification or alert that reminds a user of a specific task or event based on a pre-set time or conditions.

[0526] The system that implements this application consists of the following main components: The server uses an information acquisition module to obtain event information via a communication network. This module has the functionality to access external data sources and collect useful event information using web scraping and open APIs. The collected data is stored in a database and used for subsequent processing.

[0527] The information analysis module analyzes event information collected based on user interests. This module uses machine learning algorithms to infer user preferences and select events that match them. This analysis utilizes TensorFlow, a Python library, to generate an optimal event list based on keywords and interests registered by the user in advance.

[0528] The integration module is responsible for embedding the generated time management information into the user's mobile device and automatically adding it to the scheduling application. This allows users to manage their schedules smoothly and receive reminder notifications from their devices. Firebase Cloud Messaging is used in this process.

[0529] The executable module automates event booking and payment. It connects to external payment platforms via APIs and processes payments directly using Stripe and other electronic payment systems.

[0530] The notification module informs users of the completion of booking and payment, and sends reminders as the event date approaches. It also sends immediate notifications to end users' mobile devices via Firebase Cloud Messaging, based on the scheduled event time.

[0531] For example, if a user expresses interest in "cutting-edge technology events," the system collects and analyzes that information to recommend relevant events. The user can then select an event from the recommendations and complete the reservation and payment with a single click within the application. As the event date approaches, a notification is sent to the device, encouraging the user to attend.

[0532] Examples of prompts to input into a generative AI model:

[0533] "We want to develop an app that automatically finds events users are interested in and allows for smooth booking and payment. Could you tell us about the main features of this app?"

[0534] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0535] Step 1:

[0536] The server uses an information acquisition module to collect publicly available event information via the communication network. Keywords and regions are provided as input, and data is retrieved via web scraping or APIs based on these conditions. The output is a list of the collected event data. This list is stored in a database and used for subsequent processing.

[0537] Step 2:

[0538] The server uses an information analysis module to perform data analysis based on user interests. The input consists of interest keywords pre-registered by the user and event data obtained in step 1. TensorFlow is used to evaluate the relevance of events using a machine learning algorithm. This generates an optimized event list as output.

[0539] Step 3:

[0540] The server sends the event list generated by the integration module to the user's mobile device and adds it to the calendar app. The input is the event list generated in step 2, and the output is the event information registered in the calendar app on the device. Firebase Cloud Messaging is used in this process to synchronize information in real time.

[0541] Step 4:

[0542] The user selects an event they wish to attend from a list of events presented in the scheduling app on their device. After selection, the device sends that information to the server for reservation. The input is the user's selected event information, and the output is the reservation request received by the server.

[0543] Step 5:

[0544] The server automates booking and payment through an executable module. The input is the booking request from step 4, and payment is processed using the Stripe API. The output is confirmation that the booking and payment are complete. This confirmation is shared with the user via a notification module.

[0545] Step 6:

[0546] The server uses a notification module to inform the user of the completion of the reservation and payment, and to send a reminder notification as the event approaches. The input is payment completion information and the date and time of the event, and the output is a notification message to the user's device. In this step, Firebase Cloud Messaging is again used to send notifications.

[0547] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0548] This invention is a system that automates the management of event information based on the user's interests and emotional state, and proposes it in the most optimal form. This system is realized by combining information gathering means, information analysis means, integration means, processing means, notification means, reminder means, and an emotion engine.

[0549] First, the server utilizes information gathering tools via the communication network to collect event information from the internet. During this process, keywords and conditions related to the user's interests are taken into consideration. The resulting data is then stored in a database.

[0550] Next, the emotion engine takes on the role of recognizing the user's emotions. User emotion data is collected in real time through sensors built into the device and user input information. The server interprets this emotion data using information analysis tools and selects appropriate events according to the user's emotions. In this step, the user's current emotions and past emotional tendencies are taken into consideration, and the most suitable event suggestions are made for the user.

[0551] The selected events are formatted as schedule information and integrated with the user's device through an integration mechanism. The device receives this information and automatically adds the events to its scheduling app. Furthermore, the notification mechanism adjusts the content of notifications according to the user's emotional state, providing information in the most optimal way for the user.

[0552] When a user selects an event they wish to attend, the terminal sends the selection to the server, and the processing system initiates the reservation and payment process. The processing system works in conjunction with an external system to securely and automatically complete the necessary reservation procedures and payments. After completion, the server notifies the user using a notification system.

[0553] For example, if a user wants to relax after a busy day, the emotion engine recognizes the user's state and prioritizes suggesting relaxing music events. The device notifies the user of these events, automatically handles reservations and payments if the user is interested, and uses a reminder function to ensure they don't forget to attend. This allows users to efficiently participate in events and have an emotionally fulfilling experience.

[0554] The following describes the processing flow.

[0555] Step 1:

[0556] The server receives keywords and conditions related to the user's interests and uses information gathering methods to collect event information from the internet. This includes web scraping techniques and API integration. The collected data is stored in a database for later processing.

[0557] Step 2:

[0558] The device utilizes an emotion engine to recognize the user's emotional state. This is a process that acquires emotional data in real time through the device's built-in sensors and user input data (such as text and voice).

[0559] Step 3:

[0560] The server compares event information collected through information analysis tools with user emotion data from the emotion engine. Based on the analysis results, it selects events that match the user's current emotional state and generates event suggestions that are most suitable for the user.

[0561] Step 4:

[0562] The server sends the generated schedule information to the user's device via an integration mechanism. The device receives this information and adds the event to the user's scheduling app. Simultaneously, the notification content is adjusted according to the user's mood, resulting in effective notification settings.

[0563] Step 5:

[0564] The user reviews the event list displayed on their device and selects the events they wish to participate in. The device receives the selection and sends it as an instruction to the server.

[0565] Step 6:

[0566] The server, based on the user's selection, executes event booking and payment through processing mechanisms. This involves direct communication with external booking and payment systems, automatically inputting the necessary data, and completing the procedure.

[0567] Step 7:

[0568] After the reservation and payment are complete, the server will send a completion notification to the user using a notification system. This notification will include detailed information about the event and the next steps.

[0569] Step 8:

[0570] The device sends reminders to the user as the event date and time approaches. Based on a pre-set schedule, the reminders help users remember the event and participate smoothly.

[0571] (Example 2)

[0572] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0573] There is a challenge in that users have difficulty selecting appropriate events and activities in their daily lives and receiving suggestions that match their emotions and interests. Furthermore, finding the right event from a large amount of information and efficiently making reservations and payments is time-consuming and laborious. Moreover, the complexity of these processes can sometimes detract from the user experience.

[0574] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0575] In this invention, the server includes information acquisition means for collecting data via a communication network, analysis means for analyzing information related to the user's interests and emotions and outputting it as activity information, and integration means for integrating the activity information into the user's device. This makes it possible for the user to be offered optimal events according to their individual interests and emotions, and to automate and efficiently carry out the reservation and payment process.

[0576] A "communication network" is a collection of systems and technologies used to send and receive data, such as the internet, which connects multiple computing devices to enable information exchange.

[0577] "Information acquisition means" refers to methods and devices for collecting data, and provides the function of collecting necessary information based on specified ranges and conditions.

[0578] "Analysis tools" refer to methods and devices for analyzing user data, and have the function of evaluating data and gaining insights to achieve a specific purpose.

[0579] "Activity information" refers to information related to events and activities, generated based on the user's interests and emotions, and is intended to assist in decision-making.

[0580] "Integration means" are methods and devices for combining and integrating different information and data, enabling efficient management and utilization.

[0581] "Execution means" refers to methods or devices for automatically performing processes such as reservations and payments, and which have functions to ensure efficiency and security.

[0582] A "notification means" is a method or device for informing a user of specific information, and provides a function to reliably deliver important updates and completion notifications.

[0583] A "reminder" is a notification method that informs users in advance that a specific event or activity is approaching, helping them to take action without forgetting.

[0584] This invention provides a system that manages event information based on users' interests and emotions and proposes it in the most optimal way. This system is implemented using a communication network that includes servers and terminals.

[0585] The server collects event information from various data sources on the internet through information acquisition methods. During this process, it efficiently filters the necessary information, taking into account keywords and conditions specified by the user. The collected data is stored in a database and managed using data structuring technologies.

[0586] The device collects user emotion data in real time using built-in sensors and user input. This data is sent to a server and analyzed using an emotion engine. Using Natural Language Processing (NLP) technology, the server interprets the user's text-based emotions and selects the most relevant events for the user. Activity information based on the analysis results is sent to the user's device via an integration mechanism and automatically integrated into the scheduling app.

[0587] For events selected by the user, the terminal sends the selection to the server, and the execution mechanism automatically handles the process in conjunction with an external reservation and payment system. Once this process is complete, the user is notified of the result via a notification system. As a concrete example, a user who feels stressed from their daily work might be offered a relaxing event by the system. This suggestion is based on the user's emotional state, and the automation of the entire process efficiently ensures a relaxing experience.

[0588] An example of a prompt for the generating AI model would be, "Based on the user's sentiment analysis results, please suggest activities that will help them refresh." Through this system, users can receive highly customized suggestions tailored to their individual emotional state.

[0589] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0590] Step 1:

[0591] The server uses information acquisition methods via the communication network to collect event information from data sources on the internet. It receives keywords and conditions specified by the user as input, and a web crawler searches and collects data based on this. After collection, this information is stored in a structured format in a database in preparation for later analysis. Specifically, a crawler built with a programming language such as Python visits relevant websites to extract event information.

[0592] Step 2:

[0593] The device collects user emotion data in real time through sensors and direct user input. Input includes user interactions such as voice and text. This data is immediately sent to a server and interpreted by an emotion engine. Natural Language Processing (NLP) techniques are used for data processing, analyzing the type and intensity of emotions. The output is a user emotion profile. Specific operations include a process where speech recognition software analyzes the tone of the user's voice.

[0594] Step 3:

[0595] The server uses analytical tools to select the most suitable events for the user based on the emotional profile obtained from the emotion engine. The input is data related to the user's emotional tendencies and interests, and the output is information about the selected events. For data processing, it uses past user data and applies an AI algorithm to determine the optimal event candidates. Activity information is then organized and sent to the next stage.

[0596] Step 4:

[0597] The server formats the selected events through the integration mechanism and sends them to the user's terminal. The input is the selected event information, and the output is the event registered in the scheduling app on the terminal. Data processing includes operations to adapt the data to the user's calendar format. Specifically, there is an implementation that automatically adds events to the calendar app via an API.

[0598] Step 5:

[0599] When a user selects to participate in an event on their device, the device sends this selection information to a server, and the system automatically handles the reservation and payment using an execution mechanism. Integration with an external reservation system allows for the acquisition of reservation data as input and confirmed reservation information as output. This enables a secure and rapid process. Specific execution includes the payment process via calls to an external API.

[0600] Step 6:

[0601] The server notifies the user that the reservation and payment are complete and transmits the information to the user via the terminal. The input is the completion status of the procedure, and the output is the notification message to the user. This information is sent to the terminal in real time via the notification method. Specifically, push notification functionality is utilized so that the information is delivered to the user immediately.

[0602] (Application Example 2)

[0603] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0604] The goal is to provide a system that suggests the most suitable products and events based on the user's emotional state, enabling efficient selection and purchase. Conventional systems struggled to adequately consider user interests and emotions, resulting in an insufficient user experience. Furthermore, there was a need to reduce user effort by automating event scheduling and payment.

[0605] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0606] In this invention, the server includes information gathering means for collecting information via a communication network, information analysis means for analyzing the information based on the user's interests and emotional state and outputting it as schedule information, and integration means for integrating the schedule information with the user's communication device. This makes it possible to suggest products and events optimized based on the user's emotional state and to automatically and efficiently execute reservations and digital transactions.

[0607] "Information gathering means" refers to a device or process for acquiring data from external sources via a communication network and collecting necessary information.

[0608] "Information analysis means" refers to a device or process for analyzing users' interests and emotional states from collected data and generating appropriate information.

[0609] "Integration means" refers to a device or process for incorporating the analyzed information as schedule information into the user's communication device.

[0610] "Processing means" refers to a device or process that performs the procedures necessary to automatically execute reservations and digital transactions.

[0611] "Notification means" refers to a device or process for communicating information about completed reservations and digital transactions to the user.

[0612] A "reminder device" is a device or process used to notify a user in advance when an event or appointment is approaching.

[0613] "Emotional analysis means" refers to a device or process that analyzes a user's emotional state in real time and makes appropriate suggestions based on the results.

[0614] This system suggests optimal products and events based on the user's emotional state and interests, and automates the purchase and participation process. The core of the system consists of a server and user terminals, which exchange data with each other using various hardware and software.

[0615] The server collects information through the communication network. It uses API services to retrieve event information and product data from the internet. This information is stored in a database.

[0616] The server uses an emotion analysis API to analyze the user's emotions. Emotional data is collected by sensors and cameras attached to the user's device. The server also analyzes the user's emotional state in real time and interprets the results using information analysis tools. Based on this, it can suggest events and products that are best suited to the user.

[0617] The selected information is formatted as schedule information and integrated with the user's device using an integration mechanism. The device automatically manages this information using a scheduling app and sends notifications and reminders to the user as needed.

[0618] The processing system executes reservations and digital transactions according to the user's selection. It connects to a highly secure external payment system to automatically complete payments. Once all procedures are complete, the server notifies the user of the results using a notification system.

[0619] As a concrete example, if a user is feeling stressed, the system suggests purchasing relaxation products and allows the user to complete the purchase with a single click. In this process, the generative AI model utilizes prompts such as: "Design the specifications for a purchase support app that provides product suggestions tailored to the user's emotion when that emotion is detected. How should product suggestions be optimized if the user's emotion is relaxation?"

[0620] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0621] Step 1:

[0622] The server uses information gathering tools via a communication network to acquire event information and product data from external sources. Input is publicly available data on the internet, and output is raw data stored in a database. This data is collected via an API service and stored in the server's internal database.

[0623] Step 2:

[0624] Sensors and cameras attached to the user's device detect the user's emotional state in real time. The input is raw emotional data acquired from the sensors, and the output is analyzable emotional information sent to the server. This information is transmitted to the server as a digital signal.

[0625] Step 3:

[0626] The server analyzes emotional information using an emotion analysis API. The input is the user's emotional information, and the output is the analyzed emotional state. This analysis result is combined with the user's interest information by an information analysis tool to generate optimal event or product suggestions.

[0627] Step 4:

[0628] The server selects the most suitable events and products for the user based on the analysis and synthesis results. The input here is the analysis results, and the output is a list of selected events and products. Prompts are used to improve the accuracy of the suggestions using a generative AI model.

[0629] Step 5:

[0630] Selected event and product information is sent from the server to the user's terminal and automatically added to the scheduling app via an integration mechanism. The input is the selected event information, and the output is the scheduling app on the user's terminal.

[0631] Step 6:

[0632] The terminal initiates the reservation and purchase process for the event or product selected by the user. Input is the user's selection information, and output is information confirming the completion of the reservation or purchase. The processing mechanism integrates with an external payment system to ensure secure transactions.

[0633] Step 7:

[0634] The server notifies the user of the details of completed transactions. The input is the completed transaction information, and the output is a notification message sent to the terminal. Through this notification, the user can confirm the completion of the transaction.

[0635] Step 8:

[0636] The system uses a reminder mechanism to notify users in advance of event dates. The input is event information registered in the schedule, and the output is a reminder notification. The device provides timely notifications to ensure users don't forget events.

[0637] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0638] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0639] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0640] [Fourth Embodiment]

[0641] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0642] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0643] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0644] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0645] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0646] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0647] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0648] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0649] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0650] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0651] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0652] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0653] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0654] This system integrates information gathering, analysis, scheduling, booking processes, and notification services to streamline event participation relevant to user interests. Specific implementations are described below.

[0655] The server first uses information gathering methods via the communication network to obtain data relevant to the user's interests from the vast amount of event information available on the internet. Web scraping and open APIs are used for information gathering, and the collected data is stored in a database.

[0656] Next, the server uses information analysis tools to select events that match the user's interests from the acquired data. This selection is based on keywords and conditions registered by the user in advance. The selected events are then formatted as schedule information, including date, location, and availability.

[0657] The formatted schedule information is sent to the user's device via an integration mechanism and automatically added to the user's scheduling app. The device then uses this information to configure notification settings and prepares to provide reminder notifications later.

[0658] The user selects an event they wish to attend from the event list displayed on their device. Upon receiving the selection, the device sends the specific reservation procedure to the server.

[0659] The server uses processing tools to automatically handle booking and payment procedures for selected events. This process is completed by directly accessing external booking and payment systems and entering the necessary information. Secure electronic payment systems are used for payment.

[0660] Once the reservation and payment are complete, the server will use a notification system to inform the user that the process is complete and provide details of the event they will be participating in.

[0661] As a concrete example, consider a case where a user is interested in a "music festival." The server searches for information on relevant music festivals and creates a list of available events. When the user selects an event they want to attend, the process of purchasing a ticket and making a payment is automatically initiated. As the event date approaches, the device sends a reminder to the user, prompting them to attend. In this way, users can smoothly participate in events they are interested in, saving time and effort.

[0662] The following describes the processing flow.

[0663] Step 1:

[0664] The server receives keywords and conditions related to the user's interests and uses the communication network to collect event information from the internet. Web scraping techniques and APIs are used to obtain detailed information such as event name, date and time, and location. This information is stored in a database.

[0665] Step 2:

[0666] The server analyzes the information collected using data analysis tools. First, it selects event entries that match the user's interests and organizes them by date, time, location, etc. The analyzed information is then formatted as schedule information based on each user's interests.

[0667] Step 3:

[0668] The server sends organized schedule information to the device. The device then automatically adds events to the user's scheduling app based on the received information. At this stage, alarms and notifications are incorporated into the schedule based on the notification conditions set by the user.

[0669] Step 4:

[0670] The user views the event list provided on the device and selects the event they wish to attend. The device records the user's selection and requests the server to execute the reservation.

[0671] Step 5:

[0672] The server initiates the reservation and payment process based on the user's selection. It accesses external reservation and payment systems, automatically entering the necessary information to complete the reservation. Electronic payment systems are used for secure and reliable payment.

[0673] Step 6:

[0674] After confirming the completion of the reservation and payment, the server will send a completion notification to the user using a notification method. The notification will include reservation details and important event information.

[0675] Step 7:

[0676] The device sends reminders to the user based on a pre-set schedule as the event date approaches. This ensures the user is prepared to attend the event without forgetting.

[0677] (Example 1)

[0678] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0679] In today's information society, there is a need for a system that can quickly gather event information of interest to users and allow them to participate efficiently. Existing methods are time-consuming and cumbersome for information gathering, filtering, and event registration procedures, hindering improvements in the user experience. Therefore, there is a need for a new system that automatically analyzes event information of interest to users, manages it as a schedule, and centrally handles the registration process.

[0680] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0681] In this invention, the server includes means for collecting event information via a communication network, means for storing the collected event information in a database, and means for analyzing the event information based on specified conditions and formatting it as schedule information. This allows users to automatically obtain event information that matches their interests and efficiently proceed with event participation.

[0682] A "communication network" is a system for sending and receiving data between computers and information devices.

[0683] "Event information" refers to detailed data about events and gatherings, including the date, location, purpose, and participation requirements.

[0684] A "database" is an information system built to efficiently store, manage, and retrieve various types of information.

[0685] "Conditions" refer to information used as criteria or filters based on the user's interests and desires.

[0686] "Analysis" is a computational process that classifies and analyzes collected data according to a specific purpose and derives conclusions.

[0687] "Schedule information" refers to time management information related to specific activities or events, such as dates, times, and locations.

[0688] "Integration" is the process of centralizing multiple pieces of information and making them available for use as a whole system.

[0689] A "reservation" is the process of securing an event or service in advance and gaining the right to use it.

[0690] "Payment" refers to the procedure of paying money as compensation for goods or services.

[0691] The following describes embodiments for carrying out this invention. This system aims to streamline the process of users participating in events of interest.

[0692] First, the server collects event information via the communication network. This process utilizes web scraping techniques, and Python's BeautifulSoup or Requests libraries can be used. Alternatively, when obtaining information using open APIs, APIs from common event service providers can be used. The server temporarily organizes this data into JSON format and then stores it in a database system. MySQL, an open-source relational database management system, can be used as the database.

[0693] The server analyzes the stored data based on keywords and conditions pre-registered by the user. The analysis uses the Pandas data processing library to perform necessary filtering and aggregation. The analysis results are formatted as schedule information and sent to the user's terminal. This transmission can be achieved, for example, using the HTTP protocol.

[0694] The device can automatically add data to its local scheduling application based on the received schedule information. For example, it can create calendar entries directly using the Google Calendar API. Based on this information, the device can configure notification settings and prepare to generate reminders at the appropriate time.

[0695] The user reviews the event list displayed on the device and selects the events they are interested in. Selection is primarily done through the touchscreen interface. Once the user makes a selection, the device sends that information to the server.

[0696] The server automatically handles booking and payment for selected events. Common booking and payment system APIs can be used for the booking and payment processes. For example, payments can be made via a secure electronic payment system as an external API.

[0697] For example, if a user is interested in a "music festival," the server collects relevant information and formats the data appropriately. Once the user selects an event they wish to attend, the system automatically completes the ticket reservation and payment. As the event date approaches, the device sends a reminder to inform the user that the date is fast approaching.

[0698] An example of a prompt statement is as follows:

[0699] "The keyword for events that users are interested in is 'music festivals.' Please collect relevant event information and create a list of events they can attend."

[0700] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0701] Step 1:

[0702] The server collects event information via the internet. It receives keywords related to the user's interests (e.g., "music festival") as input. It uses web scraping techniques and open APIs to collect a wide range of relevant event information. The obtained data is converted to JSON format and stored in a database for analysis in the next step.

[0703] Step 2:

[0704] The server parses event information stored in the database. It receives event data obtained in step 1 and user-defined filtering conditions (e.g., date, location, price range) as input. Using the Pandas library, it filters and aggregates the data to identify events that match the user's criteria. The output is a list of matching events, formatted as schedule information.

[0705] Step 3:

[0706] The server sends the formatted schedule information to the user's device. It receives the event list created in step 2 as input. It sends this information to the device via the HTTP protocol. The device parses the received data and formats it for registration in its local scheduling app.

[0707] Step 4:

[0708] The device adds the schedule information to its local scheduling application. It receives the schedule information received in step 3 as input. It automatically creates schedule entries using the Google Calendar API or similar. The device also configures notifications, preparing to issue reminder notifications later.

[0709] Step 5:

[0710] The user selects an event they wish to attend from the event list displayed on the terminal. They refer to the event information displayed on the terminal as input. The user makes their selection using the touchscreen or other interface, and the user's selection is sent to the terminal for the next reservation process.

[0711] Step 6:

[0712] The terminal sends the user's selected event information to the server. The server receives the user's selected event information as input. The server prepares to process the selected event information to execute the automated booking and payment process.

[0713] Step 7:

[0714] The server automatically handles the booking and payment for the selected event. It receives the event information obtained in step 6 as input. Necessary procedures are performed via external booking system APIs and payment system APIs. The output is booking confirmation data, including information indicating that payment has been completed.

[0715] Step 8:

[0716] The server notifies the user that the reservation and payment are complete. It receives the output result from step 7 as input. It sends the user a reservation confirmation and event details using email or a push notification service. As the event date approaches, the device issues a reminder to let the user know that they will be attending.

[0717] (Application Example 1)

[0718] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0719] It is not easy for users to identify the event that best suits their interests and schedules from a wide variety of event information, and to efficiently make reservations and payments. Furthermore, timely reminder notifications are necessary to ensure smooth participation in these events. In conventional systems, these processes are handled independently, resulting in a cumbersome process and an inconsistent user experience.

[0720] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0721] In this invention, the server includes information acquisition means for acquiring event information via a communication network, information analysis means for analyzing events related to the user's interests and generating time management information, and integration means for incorporating the time management information into the user's mobile terminal. This enables a consistent user experience that integrates efficient searching, booking, payment, and reminder notifications for events based on the user's interests.

[0722] A "communication network" is a set of interconnected systems used to send and receive data, including the internet and other digital communication media.

[0723] An "information acquisition module" is a component that has the function of collecting data from external information sources and importing it into an internal system.

[0724] "User interests" refer to the interests and preferences that individual users have regarding specific fields or activities.

[0725] "Analysis" refers to the process of processing collected data and deriving meanings and trends that are relevant to a specific purpose.

[0726] "Time management information" refers to data related to schedules and reminders used to coordinate and manage events and tasks.

[0727] An "integration module" is a component that combines various types of data and information within a single system, ensuring consistency and functionality.

[0728] A "mobile device" is a device with information processing capabilities designed to be carried by the user at all times, and primarily refers to smartphones and tablets.

[0729] An "executable module" is an element within a system that has the functionality to perform specific operations or processes defined within the system.

[0730] A "notification module" is a component that provides the functionality to inform users of information based on specific times or conditions.

[0731] "Digital payment" refers to the process of paying for goods and services electronically via the internet, using methods such as credit cards and electronic wallets.

[0732] A "reminder" is a notification or alert that reminds a user of a specific task or event based on a pre-set time or conditions.

[0733] The system that implements this application consists of the following main components: The server uses an information acquisition module to obtain event information via a communication network. This module has the functionality to access external data sources and collect useful event information using web scraping and open APIs. The collected data is stored in a database and used for subsequent processing.

[0734] The information analysis module analyzes event information collected based on user interests. This module uses machine learning algorithms to infer user preferences and select events that match them. This analysis utilizes TensorFlow, a Python library, to generate an optimal event list based on keywords and interests registered by the user in advance.

[0735] The integration module is responsible for embedding the generated time management information into the user's mobile device and automatically adding it to the scheduling application. This allows users to manage their schedules smoothly and receive reminder notifications from their devices. Firebase Cloud Messaging is used in this process.

[0736] The executable module automates event booking and payment. It connects to external payment platforms via APIs and processes payments directly using Stripe and other electronic payment systems.

[0737] The notification module informs users of the completion of booking and payment, and sends reminders as the event date approaches. It also sends immediate notifications to end users' mobile devices via Firebase Cloud Messaging, based on the scheduled event time.

[0738] For example, if a user expresses interest in "cutting-edge technology events," the system collects and analyzes that information to recommend relevant events. The user can then select an event from the recommendations and complete the reservation and payment with a single click within the application. As the event date approaches, a notification is sent to the device, encouraging the user to attend.

[0739] Examples of prompts to input into a generative AI model:

[0740] "We want to develop an app that automatically finds events users are interested in and allows for smooth booking and payment. Could you tell us about the main features of this app?"

[0741] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0742] Step 1:

[0743] The server uses an information acquisition module to collect publicly available event information via the communication network. Keywords and regions are provided as input, and data is retrieved via web scraping or APIs based on these conditions. The output is a list of the collected event data. This list is stored in a database and used for subsequent processing.

[0744] Step 2:

[0745] The server uses an information analysis module to perform data analysis based on user interests. The input consists of interest keywords pre-registered by the user and event data obtained in step 1. TensorFlow is used to evaluate the relevance of events using a machine learning algorithm. This generates an optimized event list as output.

[0746] Step 3:

[0747] The server sends the event list generated by the integration module to the user's mobile device and adds it to the calendar app. The input is the event list generated in step 2, and the output is the event information registered in the calendar app on the device. Firebase Cloud Messaging is used in this process to synchronize information in real time.

[0748] Step 4:

[0749] The user selects an event they wish to attend from a list of events presented in the scheduling app on their device. After selection, the device sends that information to the server for reservation. The input is the user's selected event information, and the output is the reservation request received by the server.

[0750] Step 5:

[0751] The server automates booking and payment through an executable module. The input is the booking request from step 4, and payment is processed using the Stripe API. The output is confirmation that the booking and payment are complete. This confirmation is shared with the user via a notification module.

[0752] Step 6:

[0753] The server uses a notification module to inform the user of the completion of the reservation and payment, and to send a reminder notification as the event approaches. The input is payment completion information and the date and time of the event, and the output is a notification message to the user's device. In this step, Firebase Cloud Messaging is again used to send notifications.

[0754] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0755] This invention is a system that automates the management of event information based on the user's interests and emotional state, and proposes it in the most optimal form. This system is realized by combining information gathering means, information analysis means, integration means, processing means, notification means, reminder means, and an emotion engine.

[0756] First, the server utilizes information gathering tools via the communication network to collect event information from the internet. During this process, keywords and conditions related to the user's interests are taken into consideration. The resulting data is then stored in a database.

[0757] Next, the emotion engine takes on the role of recognizing the user's emotions. User emotion data is collected in real time through sensors built into the device and user input information. The server interprets this emotion data using information analysis tools and selects appropriate events according to the user's emotions. In this step, the user's current emotions and past emotional tendencies are taken into consideration, and the most suitable event suggestions are made for the user.

[0758] The selected events are formatted as schedule information and integrated with the user's device through an integration mechanism. The device receives this information and automatically adds the events to its scheduling app. Furthermore, the notification mechanism adjusts the content of notifications according to the user's emotional state, providing information in the most optimal way for the user.

[0759] When a user selects an event they wish to attend, the terminal sends the selection to the server, and the processing system initiates the reservation and payment process. The processing system works in conjunction with an external system to securely and automatically complete the necessary reservation procedures and payments. After completion, the server notifies the user using a notification system.

[0760] For example, if a user wants to relax after a busy day, the emotion engine recognizes the user's state and prioritizes suggesting relaxing music events. The device notifies the user of these events, automatically handles reservations and payments if the user is interested, and uses a reminder function to ensure they don't forget to attend. This allows users to efficiently participate in events and have an emotionally fulfilling experience.

[0761] The following describes the processing flow.

[0762] Step 1:

[0763] The server receives keywords and conditions related to the user's interests and uses information gathering methods to collect event information from the internet. This includes web scraping techniques and API integration. The collected data is stored in a database for later processing.

[0764] Step 2:

[0765] The device utilizes an emotion engine to recognize the user's emotional state. This is a process that acquires emotional data in real time through the device's built-in sensors and user input data (such as text and voice).

[0766] Step 3:

[0767] The server compares event information collected through information analysis tools with user emotion data from the emotion engine. Based on the analysis results, it selects events that match the user's current emotional state and generates event suggestions that are most suitable for the user.

[0768] Step 4:

[0769] The server sends the generated schedule information to the user's device via an integration mechanism. The device receives this information and adds the event to the user's scheduling app. Simultaneously, the notification content is adjusted according to the user's mood, resulting in effective notification settings.

[0770] Step 5:

[0771] The user reviews the event list displayed on their device and selects the events they wish to participate in. The device receives the selection and sends it as an instruction to the server.

[0772] Step 6:

[0773] The server, based on the user's selection, executes event booking and payment through processing mechanisms. This involves direct communication with external booking and payment systems, automatically inputting the necessary data, and completing the procedure.

[0774] Step 7:

[0775] After the reservation and payment are complete, the server will send a completion notification to the user using a notification system. This notification will include detailed information about the event and the next steps.

[0776] Step 8:

[0777] The device sends reminders to the user as the event date and time approaches. Based on a pre-set schedule, the reminders help users remember the event and participate smoothly.

[0778] (Example 2)

[0779] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0780] There is a challenge in that users have difficulty selecting appropriate events and activities in their daily lives and receiving suggestions that match their emotions and interests. Furthermore, finding the right event from a large amount of information and efficiently making reservations and payments is time-consuming and laborious. Moreover, the complexity of these processes can sometimes detract from the user experience.

[0781] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0782] In this invention, the server includes information acquisition means for collecting data via a communication network, analysis means for analyzing information related to the user's interests and emotions and outputting it as activity information, and integration means for integrating the activity information into the user's device. This makes it possible for the user to be offered optimal events according to their individual interests and emotions, and to automate and efficiently carry out the reservation and payment process.

[0783] A "communication network" is a collection of systems and technologies used to send and receive data, such as the internet, which connects multiple computing devices to enable information exchange.

[0784] "Information acquisition means" refers to methods and devices for collecting data, and provides the function of collecting necessary information based on specified ranges and conditions.

[0785] "Analysis tools" refer to methods and devices for analyzing user data, and have the function of evaluating data and gaining insights to achieve a specific purpose.

[0786] "Activity information" refers to information related to events and activities, generated based on the user's interests and emotions, and is intended to assist in decision-making.

[0787] "Integration means" are methods and devices for combining and integrating different information and data, enabling efficient management and utilization.

[0788] "Execution means" refers to methods or devices for automatically performing processes such as reservations and payments, and which have functions to ensure efficiency and security.

[0789] A "notification means" is a method or device for informing a user of specific information, and provides a function to reliably deliver important updates and completion notifications.

[0790] A "reminder" is a notification method that informs users in advance that a specific event or activity is approaching, helping them to take action without forgetting.

[0791] This invention provides a system that manages event information based on users' interests and emotions and proposes it in the most optimal way. This system is implemented using a communication network that includes servers and terminals.

[0792] The server collects event information from various data sources on the internet through information acquisition methods. During this process, it efficiently filters the necessary information, taking into account keywords and conditions specified by the user. The collected data is stored in a database and managed using data structuring technologies.

[0793] The device collects user emotion data in real time using built-in sensors and user input. This data is sent to a server and analyzed using an emotion engine. Using Natural Language Processing (NLP) technology, the server interprets the user's text-based emotions and selects the most relevant events for the user. Activity information based on the analysis results is sent to the user's device via an integration mechanism and automatically integrated into the scheduling app.

[0794] For events selected by the user, the terminal sends the selection to the server, and the execution mechanism automatically handles the process in conjunction with an external reservation and payment system. Once this process is complete, the user is notified of the result via a notification system. As a concrete example, a user who feels stressed from their daily work might be offered a relaxing event by the system. This suggestion is based on the user's emotional state, and the automation of the entire process efficiently ensures a relaxing experience.

[0795] An example of a prompt for the generating AI model would be, "Based on the user's sentiment analysis results, please suggest activities that will help them refresh." Through this system, users can receive highly customized suggestions tailored to their individual emotional state.

[0796] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0797] Step 1:

[0798] The server uses information acquisition methods via the communication network to collect event information from data sources on the internet. It receives keywords and conditions specified by the user as input, and a web crawler searches and collects data based on this. After collection, this information is stored in a structured format in a database in preparation for later analysis. Specifically, a crawler built with a programming language such as Python visits relevant websites to extract event information.

[0799] Step 2:

[0800] The device collects user emotion data in real time through sensors and direct user input. Input includes user interactions such as voice and text. This data is immediately sent to a server and interpreted by an emotion engine. Natural Language Processing (NLP) techniques are used for data processing, analyzing the type and intensity of emotions. The output is a user emotion profile. Specific operations include a process where speech recognition software analyzes the tone of the user's voice.

[0801] Step 3:

[0802] The server uses analytical tools to select the most suitable events for the user based on the emotional profile obtained from the emotion engine. The input is data related to the user's emotional tendencies and interests, and the output is information about the selected events. For data processing, it uses past user data and applies an AI algorithm to determine the optimal event candidates. Activity information is then organized and sent to the next stage.

[0803] Step 4:

[0804] The server formats the selected events through the integration mechanism and sends them to the user's terminal. The input is the selected event information, and the output is the event registered in the scheduling app on the terminal. Data processing includes operations to adapt the data to the user's calendar format. Specifically, there is an implementation that automatically adds events to the calendar app via an API.

[0805] Step 5:

[0806] When a user selects to participate in an event on their device, the device sends this selection information to a server, and the system automatically handles the reservation and payment using an execution mechanism. Integration with an external reservation system allows for the acquisition of reservation data as input and confirmed reservation information as output. This enables a secure and rapid process. Specific execution includes the payment process via calls to an external API.

[0807] Step 6:

[0808] The server notifies the user that the reservation and payment are complete and transmits the information to the user via the terminal. The input is the completion status of the procedure, and the output is the notification message to the user. This information is sent to the terminal in real time via the notification method. Specifically, push notification functionality is utilized so that the information is delivered to the user immediately.

[0809] (Application Example 2)

[0810] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0811] The goal is to provide a system that suggests the most suitable products and events based on the user's emotional state, enabling efficient selection and purchase. Conventional systems struggled to adequately consider user interests and emotions, resulting in an insufficient user experience. Furthermore, there was a need to reduce user effort by automating event scheduling and payment.

[0812] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0813] In this invention, the server includes information gathering means for collecting information via a communication network, information analysis means for analyzing the information based on the user's interests and emotional state and outputting it as schedule information, and integration means for integrating the schedule information with the user's communication device. This makes it possible to suggest products and events optimized based on the user's emotional state and to automatically and efficiently execute reservations and digital transactions.

[0814] "Information gathering means" refers to a device or process for acquiring data from external sources via a communication network and collecting necessary information.

[0815] "Information analysis means" refers to a device or process for analyzing users' interests and emotional states from collected data and generating appropriate information.

[0816] "Integration means" refers to a device or process for incorporating the analyzed information as schedule information into the user's communication device.

[0817] "Processing means" refers to a device or process that performs the procedures necessary to automatically execute reservations and digital transactions.

[0818] "Notification means" refers to a device or process for communicating information about completed reservations and digital transactions to the user.

[0819] A "reminder device" is a device or process used to notify a user in advance when an event or appointment is approaching.

[0820] "Emotional analysis means" refers to a device or process that analyzes a user's emotional state in real time and makes appropriate suggestions based on the results.

[0821] This system suggests optimal products and events based on the user's emotional state and interests, and automates the purchase and participation process. The core of the system consists of a server and user terminals, which exchange data with each other using various hardware and software.

[0822] The server collects information through the communication network. It uses API services to retrieve event information and product data from the internet. This information is stored in a database.

[0823] The server uses an emotion analysis API to analyze the user's emotions. Emotional data is collected by sensors and cameras attached to the user's device. The server also analyzes the user's emotional state in real time and interprets the results using information analysis tools. Based on this, it can suggest events and products that are best suited to the user.

[0824] The selected information is formatted as schedule information and integrated with the user's device using an integration mechanism. The device automatically manages this information using a scheduling app and sends notifications and reminders to the user as needed.

[0825] The processing system executes reservations and digital transactions according to the user's selection. It connects to a highly secure external payment system to automatically complete payments. Once all procedures are complete, the server notifies the user of the results using a notification system.

[0826] As a concrete example, if a user is feeling stressed, the system suggests purchasing relaxation products and allows the user to complete the purchase with a single click. In this process, the generative AI model utilizes prompts such as: "Design the specifications for a purchase support app that provides product suggestions tailored to the user's emotion when that emotion is detected. How should product suggestions be optimized if the user's emotion is relaxation?"

[0827] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0828] Step 1:

[0829] The server uses information gathering tools via a communication network to acquire event information and product data from external sources. Input is publicly available data on the internet, and output is raw data stored in a database. This data is collected via an API service and stored in the server's internal database.

[0830] Step 2:

[0831] Sensors and cameras attached to the user's device detect the user's emotional state in real time. The input is raw emotional data acquired from the sensors, and the output is analyzable emotional information sent to the server. This information is transmitted to the server as a digital signal.

[0832] Step 3:

[0833] The server analyzes emotional information using an emotion analysis API. The input is the user's emotional information, and the output is the analyzed emotional state. This analysis result is combined with the user's interest information by an information analysis tool to generate optimal event or product suggestions.

[0834] Step 4:

[0835] The server selects the most suitable events and products for the user based on the analysis and synthesis results. The input here is the analysis results, and the output is a list of selected events and products. Prompts are used to improve the accuracy of the suggestions using a generative AI model.

[0836] Step 5:

[0837] Selected event and product information is sent from the server to the user's terminal and automatically added to the scheduling app via an integration mechanism. The input is the selected event information, and the output is the scheduling app on the user's terminal.

[0838] Step 6:

[0839] The terminal initiates the reservation and purchase process for the event or product selected by the user. Input is the user's selection information, and output is information confirming the completion of the reservation or purchase. The processing mechanism integrates with an external payment system to ensure secure transactions.

[0840] Step 7:

[0841] The server notifies the user of the details of completed transactions. The input is the completed transaction information, and the output is a notification message sent to the terminal. Through this notification, the user can confirm the completion of the transaction.

[0842] Step 8:

[0843] The system uses a reminder mechanism to notify users in advance of event dates. The input is event information registered in the schedule, and the output is a reminder notification. The device provides timely notifications to ensure users don't forget events.

[0844] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0845] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0846] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0847] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0848] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0849] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0850] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0851] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0852] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0853] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0854] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0855] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0856] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0857] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0858] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0859] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0860] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0861] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0862] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0863] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0864] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0865] The following is further disclosed regarding the embodiments described above.

[0866] (Claim 1)

[0867] Information gathering means that collect information via a communication network,

[0868] An information analysis means that analyzes information related to the user's interests and outputs it as schedule information,

[0869] An integration method for consolidating schedule information onto the user's device,

[0870] A processing means that automatically executes reservations and payments,

[0871] A notification method to inform the user of the completion of the reservation and payment,

[0872] A system that includes a means of notifying users of event dates in advance as a reminder.

[0873] (Claim 2)

[0874] The system according to claim 1, wherein the information gathering means filters information based on specified keywords and conditions.

[0875] (Claim 3)

[0876] The system according to claim 1, wherein the processing means automatically performs payment processing using an external payment system.

[0877] "Example 1"

[0878] (Claim 1)

[0879] A means of collecting event information via a communication network,

[0880] A means of storing collected event information in a database,

[0881] A means for analyzing event information based on specified conditions and formatting it as schedule information,

[0882] A means of automating schedule management by sending formatted schedule information to the user's device,

[0883] A means for automatically executing reservation and payment processing in response to the user's event selection,

[0884] A system that includes means of notifying users of the completion of reservations and payments, and of notifying them of event dates in advance as a reminder.

[0885] (Claim 2)

[0886] The system according to claim 1, wherein the collection means filters event information based on specified keywords and conditions.

[0887] (Claim 3)

[0888] The system according to claim 1, wherein the processing means automatically performs settlement using an external settlement processing system.

[0889] "Application Example 1"

[0890] (Claim 1)

[0891] Information acquisition means for acquiring event information via a communication network,

[0892] An information analysis means that analyzes events related to user interests and generates them as time management information,

[0893] An integrated means for embedding time management information into the user's mobile device,

[0894] An implementation method for automating reservations and payments,

[0895] A notification method to inform the user of the completion of the reservation and payment,

[0896] A means of informing users in advance of the event date as a reminder,

[0897] A system that recommends events based on interests and includes means to integrate digital payments.

[0898] (Claim 2)

[0899] The system according to claim 1, wherein the information acquisition module selects information based on specified words and criteria.

[0900] (Claim 3)

[0901] The system according to claim 1, wherein the executable module automates payment processing using an external payment platform.

[0902] "Example 2 of combining an emotion engine"

[0903] (Claim 1)

[0904] Information acquisition means that collects data via a communication network,

[0905] An analysis means that analyzes information related to the user's interests and emotions and outputs it as activity information,

[0906] An integration means for integrating activity information into the user's device,

[0907] An execution method that automatically performs reservations and payments and integrates with external systems,

[0908] A notification method to inform the user of the completion of the reservation and payment,

[0909] A system that includes a means of notifying users in advance of proposed activity schedules as a reminder.

[0910] (Claim 2)

[0911] The system according to claim 1, wherein the information acquisition means filters data based on specified indicators and conditions.

[0912] (Claim 3)

[0913] The system according to claim 1, wherein the execution means automatically completes the payment using an external processing system.

[0914] "Application example 2 when combining with an emotional engine"

[0915] (Claim 1)

[0916] Information gathering means that collect information via a communication network,

[0917] An information analysis means that analyzes information based on the user's interests and emotional state and outputs it as schedule information,

[0918] An integration means for integrating schedule information into the user's communication device,

[0919] A processing means for automatically executing reservations and digital transactions,

[0920] A notification mechanism to inform users of the completion of reservations and digital transactions,

[0921] A means of notifying users of the event schedule in advance as a reminder,

[0922] A system that includes an emotion analysis tool to analyze user emotions and provide appropriate purchase suggestions.

[0923] (Claim 2)

[0924] The system according to claim 1, wherein the information gathering means selects information based on specified words and conditions.

[0925] (Claim 3)

[0926] The system according to claim 1, wherein the processing means automatically executes transaction processing using an external digital trading system. [Explanation of Symbols]

[0927] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Information acquisition means for acquiring event information via a communication network, An information analysis means that analyzes events related to user interests and generates them as time management information, An integrated means for embedding time management information into the user's mobile device, An implementation method for automating reservations and payments, A notification method to inform the user of the completion of the reservation and payment, A means of informing users in advance of the event date as a reminder, A system that recommends events based on interests and includes means to integrate digital payments.

2. The system according to claim 1, wherein the information acquisition means selects information based on specified words and criteria.

3. The system according to claim 1, wherein the execution means automates payment processing using an external payment platform.

Images