System

Abstract

To provide a system capable of providing a full leisure activity even in a busy daily life.SOLUTION: A system comprising: means for collecting location information from a smart device of a user; means for collecting a posting history of the user to a social networking service; means for collecting calendar schedule information of the user; means for analyzing the collected data and identifying a preference and a behavior pattern of the user; means for generating a private schedule suitable for the user based on the identified preference and behavior pattern; means for notifying the smart device of the user of the generated private schedule; means for automatically executing a necessary online reservation in response to approval from the user; and means for reflecting the executed reservation content in a calendar of the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's world, users are often so busy with school, work, family, and social interactions that they often don't have time to plan their private time. As a result, it is difficult for users to realize the leisure activities they desire. Furthermore, there is a lot of stress involved in manually booking and adjusting schedules. This can prevent users from enjoying satisfying leisure activities and can lead to a decline in their quality of life. It is necessary to solve these issues and enable users to make the most of their private time. [Means for solving the problem]

[0005] This invention provides a means for collecting location information, posting history to social networking services, and calendar schedule information from a user's smart device and analyzing this data. It proposes a system that includes a means for identifying the user's preferences and behavioral patterns based on the analysis results and generating an appropriate private schedule. This system also includes a means for notifying the user of the generated schedule to their smart device and automatically making necessary online reservations upon receiving the user's approval. It also includes a means for updating the reservation details on the user's calendar and automatically canceling the reservation if approval is not received by the specified cancellation deadline, thereby enabling users to enjoy fulfilling leisure activities even in their busy daily lives.

[0006] "Location information" means information about a user's current location obtained by a location acquisition system such as the GPS on a user's smart device.

[0007] A "social networking service" is an online platform or application that enables users to interact with other users via the Internet.

[0008] "Posting history" is a record of posts a user has made in the past on a social networking service, and is data that includes content such as text, images, and videos, as well as the date and time of posting.

[0009] "Calendar schedule" refers to information about appointments and events listed in the calendar application stored on the user's smart device.

[0010] "Analysis" is the process of processing collected data to identify user patterns and preferences.

[0011] "Private schedule" is schedule information generated to suggest optimal leisure activities and plans to users based on the analysis results.

[0012] A "smart device" is a device used by a user that can connect to the Internet, such as a computer, smartphone, or tablet.

[0013] "Notifications" are alerts or messages sent via smart devices to inform users of the generated schedule.

[0014] "Online reservations" refers to the process of making reservations for restaurants, events, etc. over the Internet.

[0015] "Approval" is an operation in which the user confirms the notified plan contents and allows the plan to be executed.

[0016] "Cancel" is an operation to cancel an already made reservation. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] MODE FOR CARRYING OUT THE INVENTION

[0039] overview

[0040] This invention is a system that collects and analyzes information such as smart device location information, social networking service (SNS) posting history, and calendar schedules with the aim of optimizing users' private time. Based on the analysis results, it generates a private schedule suited to the user and notifies the user's smart device. If the user approves, it automatically makes online reservations and manages the schedule. This system operates primarily through interactions between the server, terminals, and users.

[0041] Program processing

[0042] 1. Data Collection

[0043] Terminal

[0044] The device collects the user's location information in real time. The location information is obtained using geographic information acquisition systems such as GPS sensors. In addition, the device also collects social media posting history and calendar schedule information. The social media posting history is obtained via the API of each social media platform used by the user, and the calendar schedule is obtained using the calendar application's API.

[0045] Device -> Server

[0046] The collected data is periodically sent to a server via a secure communication protocol (e.g., HTTPS).

[0047] 2. Data analysis and plan generation

[0048] server

[0049] The server's AI engine analyzes the received data and identifies the user's behavioral patterns and preferences. Specifically, it uses machine learning algorithms to cluster and classify the user's past behavioral data, and as a result, it finds out the places the user often visits on the weekends and the activities they are interested in.

[0050] It then generates a personalized schedule based on the identified behavioral patterns and preferences. For example, if a user enjoys cafe hopping, it generates a plan to visit newly opened cafes.

[0051] 3. Plan Notification and Approval

[0052] Server -> Device

[0053] The generated plan is sent from the server to the terminal, and the notification includes specific plan contents (e.g., visit locations, times, necessary reservation information) and an interface for approval or cancellation.

[0054] Terminal

[0055] The device will display the received plan to the user, and the user will receive a push notification or in-app notification with plan details.

[0056] user

[0057] The user checks the notification and either approves or cancels the plan. If approval is given, the approval information is sent from the device to the server.

[0058] 4. Making and managing reservations

[0059] server

[0060] The server that receives the user's approval automatically executes the online reservation. For example, if a reservation is required for a restaurant or event ticket purchase, the reservation procedure is carried out via the corresponding reservation API.

[0061] Once a reservation is completed, information is sent to the device to add the reservation to the user's calendar. If the user does not approve the reservation by the specified cancellation deadline, the reservation is automatically canceled. This prevents unnecessary reservations from remaining.

[0062] Terminal

[0063] The device will then add new events to the user's calendar app based on the received reservation information, ensuring the user always has the most up-to-date schedule.

[0064] Specific examples

[0065] 1. Data Collection

[0066] The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[0067] 2. Data analysis and plan generation

[0068] The server analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[0069] 3. Plan Notification and Approval

[0070] The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[0071] 4. Making and managing reservations

[0072] The server automatically makes a reservation for the cafe based on the approved plan and reflects the reservation details on the user's calendar.

[0073] In this way, the present invention optimizes the user's private time and provides effective and stress-free leisure activities.

[0074] The processing flow will be explained below.

[0075] Step 1:

[0076] Data Collection - Location Information

[0077] The device uses a GPS sensor to obtain the user's location information in real time. Location information is collected at regular intervals (for example, every 10 minutes) and recorded along with the date and time. This allows the device to understand where the user has moved and how long they have stayed.

[0078] Step 2:

[0079] Data Collection - Social Media Post History

[0080] The device retrieves the user's posting history from social media platforms (e.g., Facebook, Instagram, Twitter). It uses each social media platform's API to collect past posting data (text, images, posting date and time, etc.). This data is used to understand the user's interests and activity patterns.

[0081] Step 3:

[0082] Data Collection - Calendar Schedule

[0083] The device retrieves schedule information using the API of the user's calendar application (e.g., Google® Calendar). Calendar information includes the event title, date, time, location, and details. This allows the device to coordinate current events with the proposed plan.

[0084] Step 4:

[0085] Data transmission

[0086] The device periodically sends the collected location information, social media posting history, and calendar schedule information to a server. The data is sent securely using a secure communication protocol (e.g., HTTPS).

[0087] Step 5:

[0088] Data analysis

[0089] The server analyzes the received data, using machine learning algorithms and data mining techniques to identify user behavioral patterns and preferences, such as the frequency of places visited in the past and the content posted on social media.

[0090] Step 6:

[0091] Creating a private schedule

[0092] The server generates an optimal private schedule for the user based on the analysis results. For example, if the server determines that the user likes to go cafe hopping on weekends, it will suggest a plan to visit a new cafe the following weekend.

[0093] Step 7:

[0094] Plan Notification

[0095] The server sends the generated schedule plan to the device. This notification includes specific plan details (visit locations, times, and necessary reservation information). Notifications are sent via push notifications or in-app notifications.

[0096] Step 8:

[0097] Plan Approval / Cancellation

[0098] The user checks the notification and approves or cancels the plan. If they approve, they press the "Approve" button on their device. The device then sends the approval information to the server.

[0099] Step 9:

[0100] Automatic booking

[0101] The server receives the plan approval information from the user and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event using a reservation API.

[0102] Step 10:

[0103] Calendar updates

[0104] The server notifies the device that the reservation has been confirmed, and the device adds the received reservation information to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule on the calendar.

[0105] Step 11:

[0106] Manage your booking

[0107] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. This information is also notified to the device, and the relevant event is deleted from the calendar. This prevents unnecessary reservations from remaining.

[0108] For example, if a user approves a plan to visit a new cafe on Sunday, the server will make a reservation for that cafe on Friday and update the calendar, allowing the user to enjoy fulfilling leisure activities based on their preferences.

[0109] Example 1

[0110] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0111] In modern society, efficiently managing and maximizing users' private time is an important issue. However, conventional methods require users to plan their own schedules and make reservations, which is time-consuming and laborious. It is also difficult to generate schedules that reflect users' preferences and behavioral patterns, making it difficult to create effective plans. Furthermore, because reservation approvals and cancellations are managed manually, there is a high risk of errors or omissions.

[0112] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0113] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to social media services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for executing necessary automatic reservations upon receiving approval from the user, means for reflecting the executed reservation details in the user's calendar, means for automatically canceling the reservation if the user does not approve by a specified cancellation deadline, and means for rescheduling based on the executed reservation details. This allows the user to receive suggestions for an optimal private schedule based on their preferences and behavioral patterns, and automates schedule planning, reservation procedures, and approval / cancellation management, reducing effort and time.

[0114] "Location information" is geographic data about where a user is currently located or where a user has previously visited.

[0115] A "social media service" is an online platform where users can post photos, comments, etc. and interact with other users.

[0116] "Posting history" refers to the history of content that a user has posted in the past on social media services.

[0117] "Calendar information" refers to digital calendar data that records a user's schedule and appointments.

[0118] "Information processing devices" are electronic devices such as smartphones, tablets, and computers that users use on a daily basis.

[0119] "Data Analysis" means the technical means of processing collected data to identify user behavior patterns and preferences.

[0120] A "private schedule" is a schedule or plan created to efficiently manage a user's personal time.

[0121] "Notification" refers to a message or alert that notifies the user of the contents of the generated private schedule.

[0122] "Automatic reservation" is a process in which the system automatically completes the reservation procedure based on the user's approval.

[0123] "Cancellation Deadline" means the final date and time by which a User can confirm or cancel a booking.

[0124] "Rescheduling" is the process of generating a new schedule when changes occur to an existing schedule.

[0125] MODE FOR CARRYING OUT THE INVENTION

[0126] overview

[0127] This invention is a system that collects and analyzes location information, social media posting history, and calendar information from information processing devices with the aim of optimizing users' private time. Based on the analysis results, a private schedule suited to the user is generated and notified to the user's information processing device. If the user approves, an automatic reservation is made and the contents are reflected in the calendar. This system operates mainly through interactions between the server, terminal, and user.

[0128] Data Collection and Transmission

[0129] The device collects the user's location information in real time using a GPS sensor. In addition, the device obtains the user's social media posting history via API and collects schedule information via the calendar application's API. The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[0130] Data analysis and plan generation

[0131] The server uses an AI engine to analyze the received location information, social media posting history, and calendar information. Using machine learning algorithms, it performs clustering and classification based on the user's past behavioral data to identify the user's behavioral patterns and preferences. For example, it analyzes the cafes the user frequently visits on weekends and their hobby activities, and generates an optimal private schedule based on that information.

[0132] Plan Notification and Approval

[0133] The generated plan is sent from the server to the device. This notification includes specific visit locations, times, and necessary reservation information, and is sent to the user via push notification or in-app notification. The user can review the notification and choose to approve or cancel the plan. If approved, the information is sent from the device to the server.

[0134] Making and managing reservations

[0135] After receiving the user's authorization information, the server automatically executes the online reservation via the appropriate reservation API, such as making a restaurant reservation or purchasing an event ticket. Once the reservation is completed, the reservation information is sent to the device to be reflected in the user's calendar, and the device adds the information to the calendar application.

[0136] If the user does not approve the plan by the specified cancellation deadline, the reservation will be automatically canceled, which prevents unnecessary reservations from remaining.

[0137] Specific examples

[0138] 1. The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[0139] 2. The server's AI engine analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[0140] 3. The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[0141] 4. The server automatically makes a reservation at the cafe based on the approved plan and updates the reservation details on the user's calendar.

[0142] Prompt Sentence Examples

[0143] "Can you recommend any new cafes for my weekend cafe crawl?"

[0144] "Please suggest the best leisure plan based on next week's schedule."

[0145] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0146] Step 1:

[0147] Location information collection

[0148] Input: The device uses the GPS sensor to obtain the user's location.

[0149] What it does: The device collects GPS data in real time at specific intervals and records the history of the places the user has visited.

[0150] Output: Generates the collected location data.

[0151] Step 2:

[0152] Acquiring SNS posting history

[0153] Input: The device accesses the API of the social media platform the user uses.

[0154] Specific operation: The device calls the API of each SNS and obtains the user's posting history data, for example, to obtain recently posted photos and comments about a cafe.

[0155] Output: The retrieved social media posting history data is generated.

[0156] Step 3:

[0157] Get calendar information

[0158] Input: The device accesses the API of the user's calendar application.

[0159] Specific operation: The device obtains the user's schedule data through the calendar API, such as upcoming events and reservation information.

[0160] Output: The retrieved calendar schedule data is generated.

[0161] Step 4:

[0162] Sending data

[0163] Input: The device sends the collected location information, social media posting history, and calendar schedule data to the server.

[0164] What it does: The device uses HTTPS to securely send collected data to the server.

[0165] Output: The data received by the server is generated.

[0166] Step 5:

[0167] Data analysis

[0168] Input: The server analyzes the received location data, social media posting history data, and calendar schedule data.

[0169] What it does: The server's AI engine uses machine learning algorithms to identify user behavioral patterns and preferences, such as how often a user visits a cafe on the weekend and the activities they are interested in.

[0170] Output: Generates analytical results about user behavior patterns and preferences.

[0171] Step 6:

[0172] Generate a plan

[0173] Input: The server generates an optimal private schedule for the user based on the analysis results.

[0174] Specific operation: The server uses the analysis results to create a schedule that combines appropriate places to visit and activities for the user. For example, it generates a plan to visit a newly opened cafe.

[0175] Output: The generated private schedule is generated.

[0176] Step 7:

[0177] Plan Notification

[0178] Input: The server sends the generated private schedule to the terminal.

[0179] What happens: The server notifies the user of the schedule details via push notification or in-app notification.

[0180] Output: A notification is generated that allows the user to review the plan details.

[0181] Step 8:

[0182] View Plans

[0183] Input: The device displays the received plan to the user.

[0184] Specific behavior: The device will notify the user of the plan details (location, time, reservation information, etc.).

[0185] Output: User-visible plan details are generated.

[0186] Step 9:

[0187] Accept or Cancel

[0188] Input: The user reviews the notified plan and accepts or cancels it.

[0189] Specific action: The user taps the button to accept or cancel the plan via the device.

[0190] Output: Approval or cancellation information is generated.

[0191] Step 10:

[0192] Sending approval information

[0193] Input: The device sends the user's authorization information to the server.

[0194] Specific operation: The device sends authorization information to the server using HTTPS communication.

[0195] Output: The authorization information received by the server is generated.

[0196] Step 11:

[0197] Automatic booking execution

[0198] Input: The server performs automatic booking based on the received authorization information.

[0199] Specific operation: The server automatically makes reservations, for example at a cafe, via a corresponding reservation API.

[0200] Output: Information that the reservation is completed is generated.

[0201] Step 12:

[0202] Reflection on the calendar

[0203] Input: The server sends the completed reservation information to the terminal.

[0204] What happens: The server sends the reservation details to the user's device, and the device adds the information to its calendar application.

[0205] Output: The booking information is generated and reflected in the user's calendar.

[0206] Step 13:

[0207] Automatic cancellation processing

[0208] Input: If the user does not accept the plan by the specified cancellation deadline.

[0209] What happens: The server automatically cancels any pending reservations.

[0210] Output: Cancelled reservation information is generated.

[0211] In this way, the system of the present invention enables efficient schedule management and automatic reservations to make the most of the user's private time.

[0212] (Application example 1)

[0213] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0214] In modern factories and other workplaces, maximizing worker efficiency and performing tasks efficiently is crucial. However, there is a lack of systems that provide workers with real-time information such as which equipment should be maintained next and which route is the shortest. In such situations, workers have to spend time and effort manually creating work plans, resulting in reduced efficiency. Furthermore, if workers cannot quickly obtain the tools and manuals they need, work delays and errors are more likely to occur.

[0215] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0216] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to online services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for automatically executing necessary online reservations upon receiving the user's approval, means for reflecting the executed reservation details in the user's calendar, means for presenting an optimal work schedule to the user in real time using smart glasses, means for collecting and analyzing the user's location information and work logs, and means for providing information for maximizing the user's work efficiency based on the analysis results. This makes it possible to provide optimal work schedules and necessary information to workers in work sites such as factories in real time, thereby maximizing work efficiency.

[0217] "Information processing device" refers to all electronic devices that have the function of collecting, analyzing, and displaying data.

[0218] "Location Information" refers to information collected using GPS or other geographic information systems to provide coordinate data for a specific location.

[0219] "Online Services" refers to social networking services and other digital services provided via the Internet.

[0220] "Posting history" refers to a record of past content and comments posted by a user to an online service.

[0221] "Calendar Information" refers to data stored in a calendar or schedule management application that contains a user's appointments and schedules.

[0222] "Preferences" refer to specific interests or tendencies that a user exhibits through their past behavior and posts.

[0223] "Behavioral patterns" refer to the tendencies of users, such as the actions they have taken regularly in the past and the places they have visited.

[0224] "Private Schedule" refers to a calendar or plan generated to optimize a user's personal time.

[0225] "Smart glasses" are a type of wearable device that has the shape of glasses and is equipped with a display function to display information.

[0226] "Work log" refers to the records and log data of work performed by a user.

[0227] "Real-time" refers to data collection, analysis, and display occurring immediately, without delay.

[0228] "Work efficiency" refers to minimizing the effort and time required to perform a task and maximizing the results.

[0229] The system for implementing this invention includes smart glasses worn by the user, a server for processing data, and a communication means for exchanging data between them. Software for collecting and analyzing user location information, posting history on online services, schedule information, etc. also plays an important role.

[0230] The server uses the following hardware and software:

[0231] Hardware: Server platform (e.g., Amazon Web Services (AWS®), Microsoft® Azure®)

[0232] Software: Machine learning algorithms for data analysis (e.g., Scikit-learn, TENSORFLOW®)

[0233] The smart glasses that serve as the terminals use the following hardware and software.

[0234] Hardware: Smart glasses (e.g., Microsoft HoloLens (registered trademark), Google Glass (registered trademark))

[0235] Software: Location information collection application, application that configures the user interface

[0236] First, the smart glasses, which are the device, collect the user's location information in real time. This location information is obtained using the GPS sensor built into the smart glasses. Work logs are also recorded and saved on the device.

[0237] Next, the device transmits the collected location information and work log data to a server via a secure communication protocol (e.g., HTTPS).

[0238] The server analyzes the received data using machine learning algorithms to identify the user's behavioral patterns and preferences, and generates a personal and work schedule tailored to the user based on the analysis results.

[0239] The generated schedule is sent in real time from the server to the device, which then displays the schedule to the user on the smart glasses, providing information such as the next best maintenance task, its location, the best route, and any necessary tools and manuals.

[0240] Once the user checks and approves the presented schedule, the server automatically makes the necessary online reservations (e.g., equipment maintenance reservations, parts orders, etc.) and reflects the reservation details in the user's calendar.

[0241] As a specific example, a factory worker wears smart glasses to perform his next maintenance task. The smart glasses identify the worker's current location and provide an optimal work schedule and route in real time. The worker can also quickly obtain the necessary tools and manuals based on the information displayed on the smart glasses, without having to search for them.

[0242] An example of a prompt to be input to a generative AI model is as follows:

[0243] User ID: user123

[0244] Location information: GPS data

[0245] Work Log: Work Log Data

[0246] Calendar Schedule: Calendar schedule data

[0247] Analyze this data and suggest the best next maintenance tasks and locations.

[0248] In this way, the present invention can maximize the user's work efficiency and realize efficient and stress-free work at work sites such as factories.

[0249] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0250] Step 1:

[0251] The device (smart glasses) collects the user's location information and work log. Location information is obtained using a built-in GPS sensor, and the work log records the user's operations and work content. The collected data is temporarily stored in the device.

[0252] Input: Location information from the GPS sensor, user operation log data

[0253] Output: Temporarily saved location information and work log

[0254] Step 2:

[0255] The device sends the collected location information and work logs to the server via a secure communication protocol (e.g., HTTPS). The data is encrypted and transmitted securely.

[0256] Input: Temporarily saved location information and work log

[0257] Output: Location information and work log data sent to the server

[0258] Step 3:

[0259] The server uses machine learning algorithms to analyze the received data, including clustering and classification based on past behavioral patterns and preferences, to identify the user's next actions and required tasks.

[0260] Input: Location information and work log sent from the device

[0261] Output: Analysis results that identify user behavior patterns and preferences

[0262] Step 4:

[0263] Based on the identified behavioral patterns and preferences, the server generates a personalized personal and work schedule for the user, including information on upcoming maintenance tasks, routes, and required tools and manuals.

[0264] Input: Identified behavioral patterns and preferences

[0265] Output: Generated private schedule and work schedule

[0266] Step 5:

[0267] The server sends the generated schedule to the device in real time, and the device (smart glasses) presents the received schedule to the user, displaying information such as the next task to be performed, the route to be taken, and the tools to be used.

[0268] Input: Generated private schedule and work schedule

[0269] Output: Schedule sent to the device

[0270] Step 6:

[0271] The user can check the schedule displayed on the smart glasses and approve or cancel it. If approved, the information is sent from the device to the server.

[0272] Input: The schedule presented to the user

[0273] Output: User authorization information

[0274] Step 7:

[0275] The server receives approval information from the user and automatically executes the necessary online reservations, such as booking equipment maintenance or ordering parts, via the reservation API.

[0276] Input: User authorization information

[0277] Output: Details of the executed net reservation

[0278] Step 8:

[0279] The server sends information to the device to reflect the executed reservation details in the user's calendar. The device adds a new appointment to the user's calendar app based on the received reservation information.

[0280] Input: Details of the online reservation

[0281] Output: Reservation details reflected in the user's calendar

[0282] Through the above processing steps, a system is realized that maximizes the user's work efficiency and allows for efficient and stress-free work.

[0283] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0284] MODE FOR CARRYING OUT THE INVENTION

[0285] overview

[0286] This invention is a system that collects and analyzes smart device location information, social networking service (SNS) posting history, and calendar schedule information in order to optimize a user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's smart device, and if approved, online reservations are automatically made and schedule management is performed.

[0287] Program processing

[0288] 1. Data Collection

[0289] Terminal

[0290] The device uses a GPS sensor to receive the user's location information in real time. The collected location information, including time information, is sent to a server. The device also periodically retrieves the user's posting history using the API of the social media platform. It also collects schedule information via the API of the user's calendar application. All of this information is sent to the server.

[0291] Device -> Server

[0292] The device periodically uploads collected location information, social media posting history, and calendar schedule information to a server. Data is transmitted securely using a secure communication protocol (e.g., HTTPS).

[0293] 2. Data Analysis and Emotion Recognition

[0294] server

[0295] The server analyzes the collected data to identify user patterns and preferences, using machine learning algorithms to cluster users' past behavioral data and identify activities of interest and frequently visited locations.

[0296] Furthermore, the emotion engine analyzes the user's voice data, facial expression data, and social media posts to recognize their current emotional state. For example, it can recognize positive emotions (joy, excitement) and negative emotions (stress, anxiety) from the user's tone of voice and social media posts.

[0297] 3. Create a private schedule

[0298] server

[0299] The server generates a personalized schedule based on the results of behavioral pattern analysis and emotion recognition. For example, if the server detects that the user is feeling stressed, it will suggest activities that will have a relaxing effect (such as relaxing at a spa or cafe). If the user is feeling very happy, it will suggest gathering with friends or participating in fun events to share the excitement.

[0300] 4. Plan Notification and Approval

[0301] Server -> Device

[0302] The server notifies the device of the generated private schedule, which includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel the plan.

[0303] Terminal

[0304] The device will display plan notifications in a user-friendly format, using push notifications and in-app notifications to inform users of plan details.

[0305] user

[0306] The user checks the notification and either accepts or cancels the plan. If the plan is accepted, the device sends the information to the server.

[0307] 5. Automatic booking and calendar updates

[0308] server

[0309] After receiving the user's authorization information, the server automatically makes the necessary online reservations, such as using a reservation API to reserve a restaurant or event ticket.

[0310] Once the reservation is complete, the reservation information is sent to the device, and if the user does not approve the plan by the specified cancellation deadline, the reservation is automatically canceled.

[0311] Terminal

[0312] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[0313] Specific examples

[0314] 1. Data Collection

[0315] The device collects location information of cafes visited by users on Sundays, as well as photos and comments posted to social media about cafes, and sends them to the server. It also obtains the user's free time slots for the next week as part of their calendar information.

[0316] 2. Data Analysis and Emotion Recognition

[0317] The server analyzes that the user likes to go to cafes, and at the same time recognizes from social media posts that the user has been feeling stressed recently.

[0318] 3. Create a private schedule

[0319] The server generates plans for visiting new cafes for a relaxing weekend getaway, and even suggests making reservations at the cafe, reducing the stress of securing a reservation.

[0320] 4. Plan Notification and Approval

[0321] The server will send the generated plan to the user's device on Friday, where the user can review the plan and press the approve button.

[0322] 5. Automatic booking and calendar updates

[0323] The server makes a reservation for the cafe based on the approved plan and sends the reservation information to the device, which then adds a new event to its calendar.

[0324] In this way, the system can optimize users' private time and provide enriching leisure activities that correspond to their emotional state.

[0325] The processing flow will be explained below.

[0326] Step 1:

[0327] Data Collection - Location Information

[0328] The device uses a GPS sensor to obtain the user's location information in real time. The device collects the user's current location information at a specified interval (e.g., every 10 minutes) and records it along with the time information. The collected location information is temporarily stored on the device.

[0329] Step 2:

[0330] Data Collection - Social Media Post History

[0331] The device uses the API of social media platforms (e.g., Facebook, Instagram, Twitter) to obtain the user's posting history. It periodically (e.g., once a day) collects social media posting data (text, images, and posting date and time), and also collects information to understand the user's emotions from acceptable social media posts.

[0332] Step 3:

[0333] Data Collection - Calendar Schedule

[0334] The device retrieves schedule information using the API of the user's calendar application (e.g., Google Calendar). The collected schedule information includes the title, date, time, location, and details of the schedule. This information is used to adjust the current schedule and the proposed new plan.

[0335] Step 4:

[0336] Data transmission

[0337] The device sends the collected location information, SNS posting history, and calendar schedule information to a server. The data is uploaded to the server at a fixed time every day (e.g., 1:00 AM) using a secure communication protocol (e.g., HTTPS).

[0338] Step 5:

[0339] Data analysis

[0340] The server analyzes the received data and uses machine learning algorithms and data mining techniques to identify user behavior patterns and preferences. For example, it analyzes the frequency with which users visit cafes on weekends and the patterns of the places they visit to understand their interests.

[0341] Step 6:

[0342] emotion recognition

[0343] The server recognizes the user's emotions using an emotion engine. It analyzes voice data, facial expression data, and SNS posts to determine the user's current emotional state (e.g., positive, negative). The emotion engine generates data that reflects the user's psychological state.

[0344] Step 7:

[0345] Creating a private schedule

[0346] The server generates a personalized schedule based on the results of data analysis and emotion recognition. For example, if the server determines that the user is feeling stressed, it will suggest a plan for effective relaxation (e.g., relaxing at a spa or cafe).

[0347] Step 8:

[0348] Plan Notification

[0349] The server notifies the device of the created private schedule. This notification includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel. Notifications are sent via push notifications or in-app notifications.

[0350] Step 9:

[0351] Plan Approval / Cancellation

[0352] The user checks the plan notification received on the device and approves or cancels the plan. If approving, the user presses the "Approve" button. The device then sends this approval information to the server. Similarly, if the plan is canceled, the device also sends cancellation information to the server.

[0353] Step 10:

[0354] Automatic booking

[0355] The server receives the user's authorization information and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event, using a reservation API. Once the reservation is complete, the information is sent to the device.

[0356] Step 11:

[0357] Calendar updates

[0358] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[0359] Step 12:

[0360] Manage your booking

[0361] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. The cancellation information will also be notified to the device, and the corresponding schedule will be deleted from the user's calendar. This prevents unnecessary reservations from remaining.

[0362] To give a concrete example, suppose a user visits a cafe on Sunday and posts on social media that they have been feeling stressed lately. The device then sends this information along with their location and calendar schedule to the server. The server recognizes that the user is feeling stressed and generates a plan suggesting a relaxing time at a cafe for the following weekend. The generated plan is notified to the device on Friday, and if the user approves, the server automatically makes a reservation at the cafe and updates the calendar with the reservation information.

[0363] Example 2

[0364] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0365] In modern society, users lead busy lives and are expected to make efficient and optimal use of their private time. However, current schedule management systems do not take into account the user's emotional state and are unable to suggest appropriate leisure activities based on their emotions and stress levels, which prevents them from fully increasing user satisfaction. In addition, booking procedures and schedule updates are often done manually, which places a burden on users.

[0366] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0367] In this invention, the server includes means for collecting location information from the user's mobile device, means for collecting the user's posting history to social networking services, means for collecting the user's schedule information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for evaluating the user's emotional state, means for generating a private schedule suitable for the user based on the identified preferences, behavioral patterns, and emotional state, means for notifying the user's mobile device of the generated private schedule, means for automatically making necessary online reservations upon receiving approval from the user, and means for reflecting the contents of the made reservations in the user's schedule. This makes it possible to suggest optimal leisure activities according to the user's emotional state and automatically adjust and update the schedule.

[0368] "User" refers to an individual who uses this system.

[0369] "Mobile device" refers to a portable device owned by a user, such as a smartphone or tablet.

[0370] "Location information" refers to the latitude and longitude data of the user's current location obtained using a GPS sensor or other device.

[0371] "Social Networking Service (SNS)" refers to an online platform where users can post and share their information.

[0372] "Posting history" refers to data such as text, images, and videos that a user has posted in the past on social media.

[0373] "Schedule information" refers to calendar information that records the user's plans and events.

[0374] "Collected data" refers to all location information, social media posting history, and schedule information collected from mobile devices.

[0375] "Analysis" refers to the processing of collected data to identify user behavioral patterns, preferences, and emotional states.

[0376] "Behavioral patterns" refer to the tendencies and patterns of behavior that a user has exhibited in the past.

[0377] "Preferences" refers to a user's hobbies and tendencies identified from analyzed data.

[0378] "Emotional state" refers to the user's current emotional state (e.g., joy, sadness, stress).

[0379] "Private schedule" refers to individual plans and events generated based on the user's emotional state and behavioral patterns.

[0380] "Notification" refers to an alert or message sent to a user's mobile device to notify them of the generated private schedule.

[0381] "Approval" refers to the act of a user reviewing and agreeing to a proposed private schedule.

[0382] "Online reservations" refers to reservation procedures made via web services (e.g., making restaurant reservations or purchasing event tickets).

[0383] "Reflecting on schedule" refers to adding or updating the reservation details that have been approved by the user to the schedule information.

[0384] "Cancellation Deadline" means the deadline by which you must accept the Plan in order to keep your Reservation.

[0385] "Rescheduling" refers to rearranging a schedule in the event of an unexpected change or cancellation.

[0386] MODE FOR CARRYING OUT THE INVENTION

[0387] overview

[0388] This invention is a system that collects and analyzes location information, social networking service (SNS) posting history, schedule information, and other information from a user's mobile device in order to optimize the user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotional state, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's mobile device, and if approved, online reservations are automatically made and schedule management is performed.

[0389] System Configuration and Operation

[0390] 1. Hardware and Software Overview

[0391] The system consists of the following main components:

[0392] Mobile device: Equipped with a GPS sensor, internet connection function, SNS application, and calendar application.

[0393] Server: Has high-performance computing resources to run data analysis, machine learning algorithms, and emotion recognition engines.

[0394] Data collection software: Includes APIs for collecting location information, social media posting history, and schedule information.

[0395] Data analysis software: Machine learning algorithms for behavioral pattern analysis and emotion recognition.

[0396] Data collection

[0397] Mobile devices

[0398] The mobile device uses a GPS sensor to collect the user's location information in real time. For example, when a user visits a cafe, the latitude and longitude of the location and the time of the visit are obtained and sent to the server. The API of the social networking platform is used to periodically obtain the user's posting history (text, images, videos). The Google Calendar API is also used to obtain the user's schedule information. All of this data is sent to the server in a secure manner.

[0399] Data analysis and emotion recognition

[0400] server

[0401] The server uses the received location information to analyze the places the user has visited and their behavioral patterns. For example, clustering is performed based on the frequency of cafe visits and length of stay to identify the user's behavioral patterns. The SNS post data is analyzed using natural language processing (NLP) algorithms to extract keywords and perform sentiment analysis. The emotion engine recognizes the user's current emotional state based on voice data, facial expression data, and SNS post data. For example, if the keyword "tired" appears frequently, it is determined that the user is in a state of stress.

[0402] Creating a private schedule

[0403] server

[0404] Based on the analyzed data, the system generates a private schedule that is optimal for the user. For example, if the system determines that the user is feeling stressed, it will suggest activities that will help relieve stress (such as a massage or relaxing at a cafe). The proposed plan is automatically adjusted to avoid overlapping with existing schedules.

[0405] Plan Notification and Approval

[0406] Server -> Mobile device

[0407] The generated private schedule is sent from the server to the mobile device via push notification or in-app notification, and includes specific plan details (places to visit, times, and necessary reservation information).

[0408] user

[0409] The user can then review the notification and accept or cancel the proposed plan. If acceptance is made, the mobile device sends the information to the server.

[0410] Automatic booking and schedule updates

[0411] server

[0412] The server receives the user's approval information and automatically makes the online reservation. For example, a restaurant reservation API is used to make a reservation for a specified date and time. If the reservation is successful, detailed information (reservation number, date and time, location, etc.) is sent to the mobile device. If approval is not received by the specified cancellation deadline, the reservation is automatically canceled.

[0413] Mobile devices

[0414] The mobile device adds the reservation information received from the server to the user's calendar app, making it easier for the user to check the latest schedule.

[0415] Specific examples

[0416] Data collection

[0417] The mobile device collects the location information of the cafe the user visited on Sunday, as well as photos and comments of the cafe posted on social media, and sends them to the server. The Google Calendar API is used to obtain available times for the next week.

[0418] Data analysis and emotion recognition

[0419] The server analyzes the user's preference for cafe hopping and determines from social media posts that the user has been feeling stressed recently. For example, if a user's posts frequently contain keywords such as "tired" and "stressed," the server determines that the user is under stress.

[0420] Creating a private schedule

[0421] The server generates a plan to visit a new cafe for relaxation next weekend, using the cafe's reservation API to reserve some time to relax.

[0422] Plan Notification and Approval

[0423] The server will notify the user of the generated plan on Friday. A push notification will be displayed and the details of the plan can be viewed in the app. The user will review the plan and press the "Approve" button.

[0424] Automatic booking and schedule updates

[0425] The server makes a reservation based on the approved plan and sends the reservation information to the mobile device. The mobile device then uses the Google Calendar API to add the reservation information to the calendar and update the user's schedule.

[0426] Example prompts (input to generative AI models)

[0427] Please tell me how to collect the location information of the cafe you visited on Sunday, as well as the photos and comments of the cafe you posted on social media.

[0428] How do you analyze social media posts to see if a user is experiencing stress?

[0429] I would like to know the specific algorithm that suggests new cafes for users to relax in.

[0430] This allows the system to optimally manage the user's private time and provide fulfilling leisure activities according to their emotional state.

[0431] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0432] Step 1: Data collection

[0433] The device collects the user's location information in real time and periodically obtains SNS posting history and schedule information. The input is current location information from the GPS sensor, user posting data from the SNS API, and schedule data from the calendar API. The output is a set of these data, which is sent to the server using secure communication (e.g., HTTPS). Specifically, the device polls the GPS sensor, SNS, and calendar API every hour, obtains the data, and then uploads it to the server.

[0434] Step 2: Save data

[0435] The server temporarily stores the received location information, SNS posting history, and schedule information in a database. The input is the various data sent from the device. The output is the state saved in the database. The specific operation is to accurately store the received data in the corresponding table in the database.

[0436] Step 3: Data analysis and emotion recognition

[0437] The server analyzes the stored data to identify the user's behavioral patterns and preferences. The input is location information, SNS posting history, and schedule information obtained from the database. The output is a report on the user's behavioral patterns and preferences. A machine learning algorithm is used for the analysis, performing clustering and frequency analysis. For example, it can identify the locations and times of day that a user frequently visits. The emotion engine analyzes SNS posting data, voice data, and facial expression data to recognize the user's emotional state. Specifically, it uses an NLP algorithm to analyze SNS text and calculate an emotion score.

[0438] Step 4: Create a private schedule

[0439] The server generates an optimal private schedule for the user based on the results of behavioral pattern analysis and emotion recognition. The input is the behavioral pattern and emotional state report created in the previous step. The output is a specific schedule proposed to the user. The specific operation is to automatically generate a relaxation and entertainment plan based on the user's free time and preferences. For example, if the user is feeling tired, it will suggest making a reservation at a nearby spa.

[0440] Step 5: Plan Notification

[0441] The server notifies the user's device of the generated private schedule. The input is the generated schedule. The output is the notification sent to the device. The specific operation is to send the user detailed plan contents (visit locations, times, and necessary reservation information) via push notification or email.

[0442] Step 6: Plan Approval

[0443] The user checks the received notification and approves or cancels the proposed plan. The input is the plan notification sent from the server. The output is the user's intention to approve or cancel. The specific action is to press the "Approve" or "Cancel" button on the terminal.

[0444] Step 7: Automated booking

[0445] The server receives approval information from the user and automatically executes the necessary online reservation. The input is the user's approval information. The output is the completed reservation information. The specific operation is to make a reservation at the specified time using the restaurant or spa reservation API. Once the reservation is completed, the reservation information is sent to the user's device.

[0446] Step 8: Update the schedule

[0447] The device adds the reservation information received from the server to the user's calendar app. The input is the completed reservation information. The output is the updated schedule. The specific operation is to use the Google Calendar API to add new events to the calendar and keep the user's schedule up to date.

[0448] (Application example 2)

[0449] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0450] In today's busy lifestyles, it is difficult for users to make optimal use of their private time and fully relax and enjoy themselves. It is also difficult to suggest necessary products at the appropriate time while taking into account the user's emotional state. Furthermore, there is no system that automatically integrates this information to create an optimal private schedule and recommend products. Therefore, there is a need for a system that analyzes a user's location information, social media posting history, calendar schedule information, and emotional state, and generates and notifies the user of an optimal private schedule while also suggesting appropriate products.

[0451] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0452] In this invention, the server includes: means for collecting location information from the user's smart device; means for collecting the user's posting history to social networking services; means for collecting the user's calendar schedule information; means for analyzing the collected data and identifying the user's preferences and behavioral patterns; means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns; means for notifying the user's smart device of the generated private schedule; an emotion engine including an emotion engine that recognizes the user's emotional state and adjusting the private schedule based on the emotional state; means for automatically making necessary online reservations upon receiving approval from the user; means for updating the executed reservation details on the user's calendar; and means for providing product purchase links including a recommendation engine that suggests optimal products based on the user's emotional state and schedule. This allows the user to secure optimal private time according to their emotional state and purchase products that suit their preferences at the appropriate time.

[0453] "User's smart device" refers to a communication device that collects or transmits the user's personal information, including GPS sensors, social networking applications, and calendar applications.

[0454] "Location information" is data indicating the user's current location obtained using a GPS sensor or other device.

[0455] A "social networking service" is an online platform that enables users to share information and feelings with other people.

[0456] "Posting history" is a record of messages, images, etc. that a user has posted on a social networking service.

[0457] "Calendar schedule information" is data that records the date, time, and content of a user's plans and events.

[0458] The "means of analyzing data" refers to a system that includes algorithms that analyze user behavior patterns and preferences based on collected location information, posting history, and calendar schedule information.

[0459] A "Private Schedule" is a list of appointments tailored to optimize a user's personal time.

[0460] The "emotion engine" is a technology that has the ability to analyze a user's emotional state based on their posts, behavior, voice, etc.

[0461] "Online reservation" refers to the entire reservation process carried out using an online system.

[0462] A "recommendation engine" is an algorithm that suggests individually optimal products and services based on a user's behavior and emotions.

[0463] "Purchase Link" means a web link that allows users to easily purchase the suggested product.

[0464] This invention is a system that optimizes a user's private time and suggests appropriate products based on their emotional state and behavioral patterns. This system is mainly composed of three elements: a server, a terminal, and the user.

[0465] server

[0466] Hardware and Software

[0467] The server has high-performance computing resources and is responsible for data analysis and emotion recognition. Specifically, it uses the following hardware and software:

[0468] Hardware:

[0469] A server with a fast processor and sufficient memory

[0470] software:

[0471] Machine learning libraries (e.g., scikit-learn)

[0472] Emotion recognition engine (e.g., EmotionEngine)

[0473] Database management system (e.g., MySQL (registered trademark))

[0474] Processing content

[0475] The server operates as follows:

[0476] 1. Data collection: The server receives location information, social media posting history, and calendar schedule information collected from the user's device and stores it in a database.

[0477] 2. Emotion recognition: Analyzes social media posts and user voice data to identify emotional states.

[0478] 3. Data analysis: Analyze the collected data to identify user behavior patterns and preferences using machine learning algorithms (e.g., KMeans clustering).

[0479] 4. Generating a private schedule: Based on the analysis results and emotion recognition results, a private schedule optimal for the user is generated.

[0480] 5. Product Recommendation: Use a recommendation engine to recommend appropriate products based on the user's emotional state and schedule.

[0481] Terminal

[0482] Hardware and Software

[0483] The devices used are mainly smartphones and smart glasses that users use on a daily basis.

[0484] Hardware:

[0485] GPS sensor

[0486] Internet connection function

[0487] software:

[0488] Calendar app (e.g. iCal)

[0489] Social networking apps (e.g. Twitter API / Earwig API)

[0490] A library for emotion engines

[0491] Processing content

[0492] The device's primary role is to collect data and notify the user.

[0493] 1. Data collection: We use a GPS sensor to collect location information, use the API of social media platforms to obtain posting history, and obtain schedule information from calendar apps.

[0494] 2. Data transmission: The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[0495] 3. Notification and Approval: Notify the user of private schedules and product recommendations sent from the server and provide the option to approve or cancel.

[0496] 4. Schedule update: Sends the user's approval information to the server and adds the approved reservation to the calendar.

[0497] user

[0498] Roles and Operations

[0499] The user mainly performs the following operations:

[0500] 1. Data provision: Location information, social media posts, and schedule information are indirectly provided through everyday use of devices.

[0501] 2. Confirm notifications: Check the private schedule and product recommendations notified on your device and choose to accept or cancel.

[0502] 3. Schedule Management: Review approved schedules and booking information and coordinate daily activities.

[0503] Specific examples

[0504] For example, if a user's social media posts indicate that they have been feeling stressed recently, the system can recommend a relaxation product (e.g., an aroma diffuser). The system then notifies the user of this recommendation and, if the user agrees, provides a link to purchase the product. If the user has time to relax on the weekend, the system can add a plan to visit a new cafe to their private schedule.

[0505] Prompt Sentence Examples

[0506] "Analyze users' social media posts to see if they are in an emotional state that requires a relaxing effect."

[0507] "Use a clustering algorithm to identify products that users prefer based on their past schedules and emotional state."

[0508] "Promote purchases by suggesting the best products in a timely manner based on the user's emotional state and schedule."

[0509] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0510] Step 1:

[0511] Data collection

[0512] Input: User location information, social media posting history, calendar schedule information

[0513] Processing: The device collects location information using the GPS sensor, retrieves posting history using the SNS API, and collects schedule information from the calendar app.

[0514] Output: Real-time location data, social media posting history data, calendar schedule data

[0515] Step 2:

[0516] Data transmission

[0517] Input: Location information collected in Step 1, social media posting history, and calendar schedule information

[0518] Processing: The device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[0519] Output: Location data stored on the server, SNS posting history data, calendar schedule data

[0520] Step 3:

[0521] emotion recognition

[0522] Input: Social media posting history stored on the server

[0523] Processing: The server's emotion engine analyzes the content of social media posts and identifies the user's emotional state. For example, it detects positive emotions (joy, anticipation) or negative emotions (stress, anxiety) from the context and expressions of the posts.

[0524] Output: User's emotional state data (e.g., positive, negative)

[0525] Step 4:

[0526] Data analysis

[0527] Input: Location data, calendar schedule data, emotional state data stored on the server

[0528] Processing: The server uses machine learning algorithms (e.g., KMeans clustering) to cluster historical behavioral data and identify user behavioral patterns and preferences.

[0529] Output: User behavior pattern data, preference data

[0530] Step 5:

[0531] Creating a private schedule

[0532] Input: behavioral pattern data, preference data, emotional state data

[0533] Processing: Based on the analysis results, the server generates an optimal private schedule for the user. For example, it suggests relaxation activities when the user is feeling stressed and adjusts the schedule to fit available time slots on the calendar.

[0534] Output: Private schedule data

[0535] Step 6:

[0536] Generating Product Recommendations

[0537] Input: behavioral pattern data, preference data, emotional state data

[0538] Processing: The server's recommendation engine selects the most suitable product based on the user's emotional state and schedule, and generates a purchase link. Specifically, if the user needs a product with a relaxing effect, it will recommend that product.

[0539] Output: Recommended product data, purchase link

[0540] Step 7:

[0541] Private schedule and product notifications

[0542] Input: Private schedule data, recommended product data, purchase link

[0543] Processing: The server sends the generated private schedule and product recommendations to the device, which then provides this information to the user via push notifications or in-app notifications.

[0544] Output: Private schedule and recommended products displayed on the user's device

[0545] Step 8:

[0546] User Acknowledgment and Feedback

[0547] Input: User's decision (approval or cancellation)

[0548] Processing: The user checks the private schedule and recommended products displayed on the device and indicates their intention to approve or cancel. The device then sends this information to the server.

[0549] Output: Approval or cancellation data

[0550] Step 9:

[0551] Online booking and calendar updates

[0552] Input: Approved private schedule data, recommended product data

[0553] Processing: The server automatically makes the necessary online reservations based on the user's approval information. After the reservation is completed, the information is sent to the device, which then updates the calendar with the reservation details.

[0554] Output: Confirmed online booking information, updated calendar data

[0555] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0556] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0557] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0558] [Second embodiment]

[0559] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0560] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0561] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0562] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0563] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0564] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0565] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0566] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0567] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0568] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0569] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0570] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0571] MODE FOR CARRYING OUT THE INVENTION

[0572] overview

[0573] This invention is a system that collects and analyzes information such as smart device location information, social networking service (SNS) posting history, and calendar schedules with the aim of optimizing users' private time. Based on the analysis results, it generates a private schedule suited to the user and notifies the user's smart device. If the user approves, it automatically makes online reservations and manages the schedule. This system operates primarily through interactions between the server, terminals, and users.

[0574] Program processing

[0575] 1. Data Collection

[0576] Terminal

[0577] The device collects the user's location information in real time. The location information is obtained using geographic information acquisition systems such as GPS sensors. In addition, the device also collects social media posting history and calendar schedule information. The social media posting history is obtained via the API of each social media platform used by the user, and the calendar schedule is obtained using the calendar application's API.

[0578] Device -> Server

[0579] The collected data is periodically sent to a server via a secure communication protocol (e.g., HTTPS).

[0580] 2. Data analysis and plan generation

[0581] server

[0582] The server's AI engine analyzes the received data and identifies the user's behavioral patterns and preferences. Specifically, it uses machine learning algorithms to cluster and classify the user's past behavioral data, and as a result, it finds out the places the user often visits on the weekends and the activities they are interested in.

[0583] It then generates a personalized schedule based on the identified behavioral patterns and preferences. For example, if a user enjoys cafe hopping, it generates a plan to visit newly opened cafes.

[0584] 3. Plan Notification and Approval

[0585] Server -> Device

[0586] The generated plan is sent from the server to the terminal, and the notification includes specific plan contents (e.g., visit locations, times, necessary reservation information) and an interface for approval or cancellation.

[0587] Terminal

[0588] The device will display the received plan to the user, and the user will receive a push notification or in-app notification with plan details.

[0589] user

[0590] The user checks the notification and either approves or cancels the plan. If approval is given, the approval information is sent from the device to the server.

[0591] 4. Making and managing reservations

[0592] server

[0593] The server that receives the user's approval automatically executes the online reservation. For example, if a reservation is required for a restaurant or event ticket purchase, the reservation procedure is carried out via the corresponding reservation API.

[0594] Once a reservation is completed, information is sent to the device to add the reservation to the user's calendar. If the user does not approve the reservation by the specified cancellation deadline, the reservation is automatically canceled. This prevents unnecessary reservations from remaining.

[0595] Terminal

[0596] The device will then add new events to the user's calendar app based on the received reservation information, ensuring the user always has the most up-to-date schedule.

[0597] Specific examples

[0598] 1. Data Collection

[0599] The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[0600] 2. Data analysis and plan generation

[0601] The server analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[0602] 3. Plan Notification and Approval

[0603] The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[0604] 4. Making and managing reservations

[0605] The server automatically makes a reservation for the cafe based on the approved plan and reflects the reservation details on the user's calendar.

[0606] In this way, the present invention optimizes the user's private time and provides effective and stress-free leisure activities.

[0607] The processing flow will be explained below.

[0608] Step 1:

[0609] Data Collection - Location Information

[0610] The device uses a GPS sensor to obtain the user's location information in real time. Location information is collected at regular intervals (for example, every 10 minutes) and recorded along with the date and time. This allows the device to understand where the user has moved and how long they have stayed.

[0611] Step 2:

[0612] Data Collection - Social Media Post History

[0613] The device retrieves the user's posting history from social media platforms (e.g., Facebook, Instagram, Twitter). It uses each social media platform's API to collect past posting data (text, images, posting date and time, etc.). This data is used to understand the user's interests and activity patterns.

[0614] Step 3:

[0615] Data Collection - Calendar Schedule

[0616] The device uses the API of the user's calendar application (e.g., Google Calendar) to retrieve schedule information, including the event title, date, time, location, and details, to coordinate current events and plan suggestions.

[0617] Step 4:

[0618] Data transmission

[0619] The device periodically sends the collected location information, social media posting history, and calendar schedule information to a server. The data is sent securely using a secure communication protocol (e.g., HTTPS).

[0620] Step 5:

[0621] Data analysis

[0622] The server analyzes the received data, using machine learning algorithms and data mining techniques to identify user behavioral patterns and preferences, such as the frequency of places visited in the past and the content posted on social media.

[0623] Step 6:

[0624] Creating a private schedule

[0625] The server generates an optimal private schedule for the user based on the analysis results. For example, if the server determines that the user likes to go cafe hopping on weekends, it will suggest a plan to visit a new cafe the following weekend.

[0626] Step 7:

[0627] Plan Notification

[0628] The server sends the generated schedule plan to the device. This notification includes specific plan details (visit locations, times, and necessary reservation information). Notifications are sent via push notifications or in-app notifications.

[0629] Step 8:

[0630] Plan Approval / Cancellation

[0631] The user checks the notification and approves or cancels the plan. If they approve, they press the "Approve" button on their device. The device then sends the approval information to the server.

[0632] Step 9:

[0633] Automatic booking

[0634] The server receives the plan approval information from the user and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event using a reservation API.

[0635] Step 10:

[0636] Calendar updates

[0637] The server notifies the device that the reservation has been confirmed, and the device adds the received reservation information to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule on the calendar.

[0638] Step 11:

[0639] Manage your booking

[0640] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. This information is also notified to the device, and the relevant event is deleted from the calendar. This prevents unnecessary reservations from remaining.

[0641] For example, if a user approves a plan to visit a new cafe on Sunday, the server will make a reservation for that cafe on Friday and update the calendar, allowing the user to enjoy fulfilling leisure activities based on their preferences.

[0642] Example 1

[0643] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0644] In modern society, efficiently managing and maximizing users' private time is an important issue. However, conventional methods require users to plan their own schedules and make reservations, which is time-consuming and laborious. It is also difficult to generate schedules that reflect users' preferences and behavioral patterns, making it difficult to create effective plans. Furthermore, because reservation approvals and cancellations are managed manually, there is a high risk of errors or omissions.

[0645] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0646] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to social media services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for executing necessary automatic reservations upon receiving approval from the user, means for reflecting the executed reservation details in the user's calendar, means for automatically canceling the reservation if the user does not approve by a specified cancellation deadline, and means for rescheduling based on the executed reservation details. This allows the user to receive suggestions for an optimal private schedule based on their preferences and behavioral patterns, and automates schedule planning, reservation procedures, and approval / cancellation management, reducing effort and time.

[0647] "Location information" is geographic data about where a user is currently located or where a user has previously visited.

[0648] A "social media service" is an online platform where users can post photos, comments, etc. and interact with other users.

[0649] "Posting history" refers to the history of content that a user has posted in the past on social media services.

[0650] "Calendar information" refers to digital calendar data that records a user's schedule and appointments.

[0651] "Information processing devices" are electronic devices such as smartphones, tablets, and computers that users use on a daily basis.

[0652] "Data Analysis" means the technical means of processing collected data to identify user behavior patterns and preferences.

[0653] A "private schedule" is a schedule or plan created to efficiently manage a user's personal time.

[0654] "Notification" refers to a message or alert that notifies the user of the contents of the generated private schedule.

[0655] "Automatic reservation" is a process in which the system automatically completes the reservation procedure based on the user's approval.

[0656] "Cancellation Deadline" means the final date and time by which a User can confirm or cancel a booking.

[0657] "Rescheduling" is the process of generating a new schedule when changes occur to an existing schedule.

[0658] MODE FOR CARRYING OUT THE INVENTION

[0659] overview

[0660] This invention is a system that collects and analyzes location information, social media posting history, and calendar information from information processing devices with the aim of optimizing users' private time. Based on the analysis results, a private schedule suited to the user is generated and notified to the user's information processing device. If the user approves, an automatic reservation is made and the contents are reflected in the calendar. This system operates mainly through interactions between the server, terminal, and user.

[0661] Data Collection and Transmission

[0662] The device collects the user's location information in real time using a GPS sensor. In addition, the device obtains the user's social media posting history via API and collects schedule information via the calendar application's API. The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[0663] Data analysis and plan generation

[0664] The server uses an AI engine to analyze the received location information, social media posting history, and calendar information. Using machine learning algorithms, it performs clustering and classification based on the user's past behavioral data to identify the user's behavioral patterns and preferences. For example, it analyzes the cafes the user frequently visits on weekends and their hobby activities, and generates an optimal private schedule based on that information.

[0665] Plan Notification and Approval

[0666] The generated plan is sent from the server to the device. This notification includes specific visit locations, times, and necessary reservation information, and is sent to the user via push notification or in-app notification. The user can review the notification and choose to approve or cancel the plan. If approved, the information is sent from the device to the server.

[0667] Making and managing reservations

[0668] After receiving the user's authorization information, the server automatically executes the online reservation via the appropriate reservation API, such as making a restaurant reservation or purchasing an event ticket. Once the reservation is completed, the reservation information is sent to the device to be reflected in the user's calendar, and the device adds the information to the calendar application.

[0669] If the user does not approve the plan by the specified cancellation deadline, the reservation will be automatically canceled, which prevents unnecessary reservations from remaining.

[0670] Specific examples

[0671] 1. The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[0672] 2. The server's AI engine analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[0673] 3. The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[0674] 4. The server automatically makes a reservation at the cafe based on the approved plan and updates the reservation details on the user's calendar.

[0675] Prompt Sentence Examples

[0676] "Can you recommend any new cafes for my weekend cafe crawl?"

[0677] "Please suggest the best leisure plan based on next week's schedule."

[0678] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0679] Step 1:

[0680] Location information collection

[0681] Input: The device uses the GPS sensor to obtain the user's location.

[0682] What it does: The device collects GPS data in real time at specific intervals and records the history of the places the user has visited.

[0683] Output: Generates the collected location data.

[0684] Step 2:

[0685] Acquiring SNS posting history

[0686] Input: The device accesses the API of the social media platform the user uses.

[0687] Specific operation: The device calls the API of each SNS and obtains the user's posting history data, for example, to obtain recently posted photos and comments about a cafe.

[0688] Output: The retrieved social media posting history data is generated.

[0689] Step 3:

[0690] Get calendar information

[0691] Input: The device accesses the API of the user's calendar application.

[0692] Specific operation: The device obtains the user's schedule data through the calendar API, such as upcoming events and reservation information.

[0693] Output: The retrieved calendar schedule data is generated.

[0694] Step 4:

[0695] Sending data

[0696] Input: The device sends the collected location information, social media posting history, and calendar schedule data to the server.

[0697] What it does: The device uses HTTPS to securely send collected data to the server.

[0698] Output: The data received by the server is generated.

[0699] Step 5:

[0700] Data analysis

[0701] Input: The server analyzes the received location data, social media posting history data, and calendar schedule data.

[0702] What it does: The server's AI engine uses machine learning algorithms to identify user behavioral patterns and preferences, such as how often a user visits a cafe on the weekend and the activities they are interested in.

[0703] Output: Generates analytical results about user behavior patterns and preferences.

[0704] Step 6:

[0705] Generate a plan

[0706] Input: The server generates an optimal private schedule for the user based on the analysis results.

[0707] Specific operation: The server uses the analysis results to create a schedule that combines appropriate places to visit and activities for the user. For example, it generates a plan to visit a newly opened cafe.

[0708] Output: The generated private schedule is generated.

[0709] Step 7:

[0710] Plan Notification

[0711] Input: The server sends the generated private schedule to the terminal.

[0712] What happens: The server notifies the user of the schedule details via push notification or in-app notification.

[0713] Output: A notification is generated that allows the user to review the plan details.

[0714] Step 8:

[0715] View Plans

[0716] Input: The device displays the received plan to the user.

[0717] Specific behavior: The device will notify the user of the plan details (location, time, reservation information, etc.).

[0718] Output: User-visible plan details are generated.

[0719] Step 9:

[0720] Accept or Cancel

[0721] Input: The user reviews the notified plan and accepts or cancels it.

[0722] Specific action: The user taps the button to accept or cancel the plan via the device.

[0723] Output: Approval or cancellation information is generated.

[0724] Step 10:

[0725] Sending approval information

[0726] Input: The device sends the user's authorization information to the server.

[0727] Specific operation: The device sends authorization information to the server using HTTPS communication.

[0728] Output: The authorization information received by the server is generated.

[0729] Step 11:

[0730] Automatic booking execution

[0731] Input: The server performs automatic booking based on the received authorization information.

[0732] Specific operation: The server automatically makes reservations, for example at a cafe, via a corresponding reservation API.

[0733] Output: Information that the reservation is completed is generated.

[0734] Step 12:

[0735] Reflection on the calendar

[0736] Input: The server sends the completed reservation information to the terminal.

[0737] What happens: The server sends the reservation details to the user's device, and the device adds the information to its calendar application.

[0738] Output: The booking information is generated and reflected in the user's calendar.

[0739] Step 13:

[0740] Automatic cancellation processing

[0741] Input: If the user does not accept the plan by the specified cancellation deadline.

[0742] What happens: The server automatically cancels any pending reservations.

[0743] Output: Cancelled reservation information is generated.

[0744] In this way, the system of the present invention enables efficient schedule management and automatic reservations to make the most of the user's private time.

[0745] (Application example 1)

[0746] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0747] In modern factories and other workplaces, maximizing worker efficiency and performing tasks efficiently is crucial. However, there is a lack of systems that provide workers with real-time information such as which equipment should be maintained next and which route is the shortest. In such situations, workers have to spend time and effort manually creating work plans, resulting in reduced efficiency. Furthermore, if workers cannot quickly obtain the tools and manuals they need, work delays and errors are more likely to occur.

[0748] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0749] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to online services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for automatically executing necessary online reservations upon receiving the user's approval, means for reflecting the executed reservation details in the user's calendar, means for presenting an optimal work schedule to the user in real time using smart glasses, means for collecting and analyzing the user's location information and work logs, and means for providing information for maximizing the user's work efficiency based on the analysis results. This makes it possible to provide optimal work schedules and necessary information to workers in work sites such as factories in real time, thereby maximizing work efficiency.

[0750] "Information processing device" refers to all electronic devices that have the function of collecting, analyzing, and displaying data.

[0751] "Location Information" refers to information collected using GPS or other geographic information systems to provide coordinate data for a specific location.

[0752] "Online Services" refers to social networking services and other digital services provided via the Internet.

[0753] "Posting history" refers to a record of past content and comments posted by a user to an online service.

[0754] "Calendar Information" refers to data stored in a calendar or schedule management application that contains a user's appointments and schedules.

[0755] "Preferences" refer to specific interests or tendencies that a user exhibits through their past behavior and posts.

[0756] "Behavioral patterns" refer to the tendencies of users, such as the actions they have taken regularly in the past and the places they have visited.

[0757] "Private Schedule" refers to a calendar or plan generated to optimize a user's personal time.

[0758] "Smart glasses" are a type of wearable device that has the shape of glasses and is equipped with a display function to display information.

[0759] "Work log" refers to the records and log data of work performed by a user.

[0760] "Real-time" refers to data collection, analysis, and display occurring immediately, without delay.

[0761] "Work efficiency" refers to minimizing the effort and time required to perform a task and maximizing the results.

[0762] The system for implementing this invention includes smart glasses worn by the user, a server for processing data, and a communication means for exchanging data between them. Software for collecting and analyzing user location information, posting history on online services, schedule information, etc. also plays an important role.

[0763] The server uses the following hardware and software:

[0764] Hardware: Server platform (e.g., Amazon Web Services (AWS), Microsoft Azure)

[0765] Software: Machine learning algorithms for data analysis (e.g., Scikit-learn, TensorFlow)

[0766] The smart glasses that serve as the terminals use the following hardware and software.

[0767] Hardware: Smart glasses (e.g., Microsoft HoloLens, Google Glass)

[0768] Software: Location information collection application, application that configures the user interface

[0769] First, the smart glasses, which are the device, collect the user's location information in real time. This location information is obtained using the GPS sensor built into the smart glasses. Work logs are also recorded and saved on the device.

[0770] Next, the device transmits the collected location information and work log data to a server via a secure communication protocol (e.g., HTTPS).

[0771] The server analyzes the received data using machine learning algorithms to identify the user's behavioral patterns and preferences, and generates a personal and work schedule tailored to the user based on the analysis results.

[0772] The generated schedule is sent in real time from the server to the device, which then displays the schedule to the user on the smart glasses, providing information such as the next best maintenance task, its location, the best route, and any necessary tools and manuals.

[0773] Once the user checks and approves the presented schedule, the server automatically makes the necessary online reservations (e.g., equipment maintenance reservations, parts orders, etc.) and reflects the reservation details in the user's calendar.

[0774] As a specific example, a factory worker wears smart glasses to perform his next maintenance task. The smart glasses identify the worker's current location and provide an optimal work schedule and route in real time. The worker can also quickly obtain the necessary tools and manuals based on the information displayed on the smart glasses, without having to search for them.

[0775] An example of a prompt to be input to a generative AI model is as follows:

[0776] User ID: user123

[0777] Location information: GPS data

[0778] Work Log: Work Log Data

[0779] Calendar Schedule: Calendar schedule data

[0780] Analyze this data and suggest the best next maintenance tasks and locations.

[0781] In this way, the present invention can maximize the user's work efficiency and realize efficient and stress-free work at work sites such as factories.

[0782] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0783] Step 1:

[0784] The device (smart glasses) collects the user's location information and work log. Location information is obtained using a built-in GPS sensor, and the work log records the user's operations and work content. The collected data is temporarily stored in the device.

[0785] Input: Location information from the GPS sensor, user operation log data

[0786] Output: Temporarily saved location information and work log

[0787] Step 2:

[0788] The device sends the collected location information and work logs to the server via a secure communication protocol (e.g., HTTPS). The data is encrypted and transmitted securely.

[0789] Input: Temporarily saved location information and work log

[0790] Output: Location information and work log data sent to the server

[0791] Step 3:

[0792] The server uses machine learning algorithms to analyze the received data, including clustering and classification based on past behavioral patterns and preferences, to identify the user's next actions and required tasks.

[0793] Input: Location information and work log sent from the device

[0794] Output: Analysis results that identify user behavior patterns and preferences

[0795] Step 4:

[0796] Based on the identified behavioral patterns and preferences, the server generates a personalized personal and work schedule for the user, including information on upcoming maintenance tasks, routes, and required tools and manuals.

[0797] Input: Identified behavioral patterns and preferences

[0798] Output: Generated private schedule and work schedule

[0799] Step 5:

[0800] The server sends the generated schedule to the device in real time, and the device (smart glasses) presents the received schedule to the user, displaying information such as the next task to be performed, the route to be taken, and the tools to be used.

[0801] Input: Generated private schedule and work schedule

[0802] Output: Schedule sent to the device

[0803] Step 6:

[0804] The user can check the schedule displayed on the smart glasses and approve or cancel it. If approved, the information is sent from the device to the server.

[0805] Input: The schedule presented to the user

[0806] Output: User authorization information

[0807] Step 7:

[0808] The server receives approval information from the user and automatically executes the necessary online reservations, such as booking equipment maintenance or ordering parts, via the reservation API.

[0809] Input: User authorization information

[0810] Output: Details of the executed net reservation

[0811] Step 8:

[0812] The server sends information to the device to reflect the executed reservation details in the user's calendar. The device adds a new appointment to the user's calendar app based on the received reservation information.

[0813] Input: Details of the online reservation

[0814] Output: Reservation details reflected in the user's calendar

[0815] Through the above processing steps, a system is realized that maximizes the user's work efficiency and allows for efficient and stress-free work.

[0816] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0817] MODE FOR CARRYING OUT THE INVENTION

[0818] overview

[0819] This invention is a system that collects and analyzes smart device location information, social networking service (SNS) posting history, and calendar schedule information in order to optimize a user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's smart device, and if approved, online reservations are automatically made and schedule management is performed.

[0820] Program processing

[0821] 1. Data Collection

[0822] Terminal

[0823] The device uses a GPS sensor to receive the user's location information in real time. The collected location information, including time information, is sent to a server. The device also periodically retrieves the user's posting history using the API of the social media platform. It also collects schedule information via the API of the user's calendar application. All of this information is sent to the server.

[0824] Device -> Server

[0825] The device periodically uploads collected location information, social media posting history, and calendar schedule information to a server. Data is transmitted securely using a secure communication protocol (e.g., HTTPS).

[0826] 2. Data Analysis and Emotion Recognition

[0827] server

[0828] The server analyzes the collected data to identify user patterns and preferences, using machine learning algorithms to cluster users' past behavioral data and identify activities of interest and frequently visited locations.

[0829] Furthermore, the emotion engine analyzes the user's voice data, facial expression data, and social media posts to recognize their current emotional state. For example, it can recognize positive emotions (joy, excitement) and negative emotions (stress, anxiety) from the user's tone of voice and social media posts.

[0830] 3. Create a private schedule

[0831] server

[0832] The server generates a personalized schedule based on the results of behavioral pattern analysis and emotion recognition. For example, if the server detects that the user is feeling stressed, it will suggest activities that will have a relaxing effect (such as relaxing at a spa or cafe). If the user is feeling very happy, it will suggest gathering with friends or participating in fun events to share the excitement.

[0833] 4. Plan Notification and Approval

[0834] Server -> Device

[0835] The server notifies the device of the generated private schedule, which includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel the plan.

[0836] Terminal

[0837] The device will display plan notifications in a user-friendly format, using push notifications and in-app notifications to inform users of plan details.

[0838] user

[0839] The user checks the notification and either accepts or cancels the plan. If the plan is accepted, the device sends the information to the server.

[0840] 5. Automatic booking and calendar updates

[0841] server

[0842] After receiving the user's authorization information, the server automatically makes the necessary online reservations, such as using a reservation API to reserve a restaurant or event ticket.

[0843] Once the reservation is complete, the reservation information is sent to the device, and if the user does not approve the plan by the specified cancellation deadline, the reservation is automatically canceled.

[0844] Terminal

[0845] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[0846] Specific examples

[0847] 1. Data Collection

[0848] The device collects location information of cafes visited by users on Sundays, as well as photos and comments posted to social media about cafes, and sends them to the server. It also obtains the user's free time slots for the next week as part of their calendar information.

[0849] 2. Data Analysis and Emotion Recognition

[0850] The server analyzes that the user likes to go to cafes, and at the same time recognizes from social media posts that the user has been feeling stressed recently.

[0851] 3. Create a private schedule

[0852] The server generates plans for visiting new cafes for a relaxing weekend getaway, and even suggests making reservations at the cafe, reducing the stress of securing a reservation.

[0853] 4. Plan Notification and Approval

[0854] The server will send the generated plan to the user's device on Friday, where the user can review the plan and press the approve button.

[0855] 5. Automatic booking and calendar updates

[0856] The server makes a reservation for the cafe based on the approved plan and sends the reservation information to the device, which then adds a new event to its calendar.

[0857] In this way, the system can optimize users' private time and provide enriching leisure activities that correspond to their emotional state.

[0858] The processing flow will be explained below.

[0859] Step 1:

[0860] Data Collection - Location Information

[0861] The device uses a GPS sensor to obtain the user's location information in real time. The device collects the user's current location information at a specified interval (e.g., every 10 minutes) and records it along with the time information. The collected location information is temporarily stored on the device.

[0862] Step 2:

[0863] Data Collection - Social Media Post History

[0864] The device uses the API of social media platforms (e.g., Facebook, Instagram, Twitter) to obtain the user's posting history. It periodically (e.g., once a day) collects social media posting data (text, images, and posting date and time), and also collects information to understand the user's emotions from acceptable social media posts.

[0865] Step 3:

[0866] Data Collection - Calendar Schedule

[0867] The device retrieves schedule information using the API of the user's calendar application (e.g., Google Calendar). The collected schedule information includes the title, date, time, location, and details of the schedule. This information is used to adjust the current schedule and the proposed new plan.

[0868] Step 4:

[0869] Data transmission

[0870] The device sends the collected location information, SNS posting history, and calendar schedule information to a server. The data is uploaded to the server at a fixed time every day (e.g., 1:00 AM) using a secure communication protocol (e.g., HTTPS).

[0871] Step 5:

[0872] Data analysis

[0873] The server analyzes the received data and uses machine learning algorithms and data mining techniques to identify user behavior patterns and preferences. For example, it analyzes the frequency with which users visit cafes on weekends and the patterns of the places they visit to understand their interests.

[0874] Step 6:

[0875] emotion recognition

[0876] The server recognizes the user's emotions using an emotion engine. It analyzes voice data, facial expression data, and SNS posts to determine the user's current emotional state (e.g., positive, negative). The emotion engine generates data that reflects the user's psychological state.

[0877] Step 7:

[0878] Creating a private schedule

[0879] The server generates a personalized schedule based on the results of data analysis and emotion recognition. For example, if the server determines that the user is feeling stressed, it will suggest a plan for effective relaxation (e.g., relaxing at a spa or cafe).

[0880] Step 8:

[0881] Plan Notification

[0882] The server notifies the device of the created private schedule. This notification includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel. Notifications are sent via push notifications or in-app notifications.

[0883] Step 9:

[0884] Plan Approval / Cancellation

[0885] The user checks the plan notification received on the device and approves or cancels the plan. If approving, the user presses the "Approve" button. The device then sends this approval information to the server. Similarly, if the plan is canceled, the device also sends cancellation information to the server.

[0886] Step 10:

[0887] Automatic booking

[0888] The server receives the user's authorization information and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event, using a reservation API. Once the reservation is complete, the information is sent to the device.

[0889] Step 11:

[0890] Calendar updates

[0891] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[0892] Step 12:

[0893] Manage your booking

[0894] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. The cancellation information will also be notified to the device, and the corresponding schedule will be deleted from the user's calendar. This prevents unnecessary reservations from remaining.

[0895] To give a concrete example, suppose a user visits a cafe on Sunday and posts on social media that they have been feeling stressed lately. The device then sends this information along with their location and calendar schedule to the server. The server recognizes that the user is feeling stressed and generates a plan suggesting a relaxing time at a cafe for the following weekend. The generated plan is notified to the device on Friday, and if the user approves, the server automatically makes a reservation at the cafe and updates the calendar with the reservation information.

[0896] Example 2

[0897] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0898] In modern society, users lead busy lives and are expected to make efficient and optimal use of their private time. However, current schedule management systems do not take into account the user's emotional state and are unable to suggest appropriate leisure activities based on their emotions and stress levels, which prevents them from fully increasing user satisfaction. In addition, booking procedures and schedule updates are often done manually, which places a burden on users.

[0899] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0900] In this invention, the server includes means for collecting location information from the user's mobile device, means for collecting the user's posting history to social networking services, means for collecting the user's schedule information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for evaluating the user's emotional state, means for generating a private schedule suitable for the user based on the identified preferences, behavioral patterns, and emotional state, means for notifying the user's mobile device of the generated private schedule, means for automatically making necessary online reservations upon receiving approval from the user, and means for reflecting the contents of the made reservations in the user's schedule. This makes it possible to suggest optimal leisure activities according to the user's emotional state and automatically adjust and update the schedule.

[0901] "User" refers to an individual who uses this system.

[0902] "Mobile device" refers to a portable device owned by a user, such as a smartphone or tablet.

[0903] "Location information" refers to the latitude and longitude data of the user's current location obtained using a GPS sensor or other device.

[0904] "Social Networking Service (SNS)" refers to an online platform where users can post and share their information.

[0905] "Posting history" refers to data such as text, images, and videos that a user has posted in the past on social media.

[0906] "Schedule information" refers to calendar information that records the user's plans and events.

[0907] "Collected data" refers to all location information, social media posting history, and schedule information collected from mobile devices.

[0908] "Analysis" refers to the processing of collected data to identify user behavioral patterns, preferences, and emotional states.

[0909] "Behavioral patterns" refer to the tendencies and patterns of behavior that a user has exhibited in the past.

[0910] "Preferences" refers to a user's hobbies and tendencies identified from analyzed data.

[0911] "Emotional state" refers to the user's current emotional state (e.g., joy, sadness, stress).

[0912] "Private schedule" refers to individual plans and events generated based on the user's emotional state and behavioral patterns.

[0913] "Notification" refers to an alert or message sent to a user's mobile device to notify them of the generated private schedule.

[0914] "Approval" refers to the act of a user reviewing and agreeing to a proposed private schedule.

[0915] "Online reservations" refers to reservation procedures made via web services (e.g., making restaurant reservations or purchasing event tickets).

[0916] "Reflecting on schedule" refers to adding or updating the reservation details that have been approved by the user to the schedule information.

[0917] "Cancellation Deadline" means the deadline by which you must accept the Plan in order to keep your Reservation.

[0918] "Rescheduling" refers to rearranging a schedule in the event of an unexpected change or cancellation.

[0919] MODE FOR CARRYING OUT THE INVENTION

[0920] overview

[0921] This invention is a system that collects and analyzes location information, social networking service (SNS) posting history, schedule information, and other information from a user's mobile device in order to optimize the user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotional state, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's mobile device, and if approved, online reservations are automatically made and schedule management is performed.

[0922] System Configuration and Operation

[0923] 1. Hardware and Software Overview

[0924] The system consists of the following main components:

[0925] Mobile device: Equipped with a GPS sensor, internet connection function, SNS application, and calendar application.

[0926] Server: Has high-performance computing resources to run data analysis, machine learning algorithms, and emotion recognition engines.

[0927] Data collection software: Includes APIs for collecting location information, social media posting history, and schedule information.

[0928] Data analysis software: Machine learning algorithms for behavioral pattern analysis and emotion recognition.

[0929] Data collection

[0930] Mobile devices

[0931] The mobile device uses a GPS sensor to collect the user's location information in real time. For example, when a user visits a cafe, the latitude and longitude of the location and the time of the visit are obtained and sent to the server. The API of the social networking platform is used to periodically obtain the user's posting history (text, images, videos). The Google Calendar API is also used to obtain the user's schedule information. All of this data is sent to the server in a secure manner.

[0932] Data analysis and emotion recognition

[0933] server

[0934] The server uses the received location information to analyze the places the user has visited and their behavioral patterns. For example, clustering is performed based on the frequency of cafe visits and length of stay to identify the user's behavioral patterns. The SNS post data is analyzed using natural language processing (NLP) algorithms to extract keywords and perform sentiment analysis. The emotion engine recognizes the user's current emotional state based on voice data, facial expression data, and SNS post data. For example, if the keyword "tired" appears frequently, it is determined that the user is in a state of stress.

[0935] Creating a private schedule

[0936] server

[0937] Based on the analyzed data, the system generates a private schedule that is optimal for the user. For example, if the system determines that the user is feeling stressed, it will suggest activities that will help relieve stress (such as a massage or relaxing at a cafe). The proposed plan is automatically adjusted to avoid overlapping with existing schedules.

[0938] Plan Notification and Approval

[0939] Server -> Mobile device

[0940] The generated private schedule is sent from the server to the mobile device via push notification or in-app notification, and includes specific plan details (places to visit, times, and necessary reservation information).

[0941] user

[0942] The user can then review the notification and accept or cancel the proposed plan. If acceptance is made, the mobile device sends the information to the server.

[0943] Automatic booking and schedule updates

[0944] server

[0945] The server receives the user's approval information and automatically makes the online reservation. For example, a restaurant reservation API is used to make a reservation for a specified date and time. If the reservation is successful, detailed information (reservation number, date and time, location, etc.) is sent to the mobile device. If approval is not received by the specified cancellation deadline, the reservation is automatically canceled.

[0946] Mobile devices

[0947] The mobile device adds the reservation information received from the server to the user's calendar app, making it easier for the user to check the latest schedule.

[0948] Specific examples

[0949] Data collection

[0950] The mobile device collects the location information of the cafe the user visited on Sunday, as well as photos and comments of the cafe posted on social media, and sends them to the server. The Google Calendar API is used to obtain available times for the next week.

[0951] Data analysis and emotion recognition

[0952] The server analyzes the user's preference for cafe hopping and determines from social media posts that the user has been feeling stressed recently. For example, if a user's posts frequently contain keywords such as "tired" and "stressed," the server determines that the user is under stress.

[0953] Creating a private schedule

[0954] The server generates a plan to visit a new cafe for relaxation next weekend, using the cafe's reservation API to reserve some time to relax.

[0955] Plan Notification and Approval

[0956] The server will notify the user of the generated plan on Friday. A push notification will be displayed and the details of the plan can be viewed in the app. The user will review the plan and press the "Approve" button.

[0957] Automatic booking and schedule updates

[0958] The server makes a reservation based on the approved plan and sends the reservation information to the mobile device. The mobile device then uses the Google Calendar API to add the reservation information to the calendar and update the user's schedule.

[0959] Example prompts (input to generative AI models)

[0960] Please tell me how to collect the location information of the cafe you visited on Sunday, as well as the photos and comments of the cafe you posted on social media.

[0961] How do you analyze social media posts to see if a user is experiencing stress?

[0962] I would like to know the specific algorithm that suggests new cafes for users to relax in.

[0963] This allows the system to optimally manage the user's private time and provide fulfilling leisure activities according to their emotional state.

[0964] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0965] Step 1: Data collection

[0966] The device collects the user's location information in real time and periodically obtains SNS posting history and schedule information. The input is current location information from the GPS sensor, user posting data from the SNS API, and schedule data from the calendar API. The output is a set of these data, which is sent to the server using secure communication (e.g., HTTPS). Specifically, the device polls the GPS sensor, SNS, and calendar API every hour, obtains the data, and then uploads it to the server.

[0967] Step 2: Save data

[0968] The server temporarily stores the received location information, SNS posting history, and schedule information in a database. The input is the various data sent from the device. The output is the state saved in the database. The specific operation is to accurately store the received data in the corresponding table in the database.

[0969] Step 3: Data analysis and emotion recognition

[0970] The server analyzes the stored data to identify the user's behavioral patterns and preferences. The input is location information, SNS posting history, and schedule information obtained from the database. The output is a report on the user's behavioral patterns and preferences. A machine learning algorithm is used for the analysis, performing clustering and frequency analysis. For example, it can identify the locations and times of day that a user frequently visits. The emotion engine analyzes SNS posting data, voice data, and facial expression data to recognize the user's emotional state. Specifically, it uses an NLP algorithm to analyze SNS text and calculate an emotion score.

[0971] Step 4: Create a private schedule

[0972] The server generates an optimal private schedule for the user based on the results of behavioral pattern analysis and emotion recognition. The input is the behavioral pattern and emotional state report created in the previous step. The output is a specific schedule proposed to the user. The specific operation is to automatically generate a relaxation and entertainment plan based on the user's free time and preferences. For example, if the user is feeling tired, it will suggest making a reservation at a nearby spa.

[0973] Step 5: Plan Notification

[0974] The server notifies the user's device of the generated private schedule. The input is the generated schedule. The output is the notification sent to the device. The specific operation is to send the user detailed plan contents (visit locations, times, and necessary reservation information) via push notification or email.

[0975] Step 6: Plan Approval

[0976] The user checks the received notification and approves or cancels the proposed plan. The input is the plan notification sent from the server. The output is the user's intention to approve or cancel. The specific action is to press the "Approve" or "Cancel" button on the terminal.

[0977] Step 7: Automated booking

[0978] The server receives approval information from the user and automatically executes the necessary online reservation. The input is the user's approval information. The output is the completed reservation information. The specific operation is to make a reservation at the specified time using the restaurant or spa reservation API. Once the reservation is completed, the reservation information is sent to the user's device.

[0979] Step 8: Update the schedule

[0980] The device adds the reservation information received from the server to the user's calendar app. The input is the completed reservation information. The output is the updated schedule. The specific operation is to use the Google Calendar API to add new events to the calendar and keep the user's schedule up to date.

[0981] (Application example 2)

[0982] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0983] In today's busy lifestyles, it is difficult for users to make optimal use of their private time and fully relax and enjoy themselves. It is also difficult to suggest necessary products at the appropriate time while taking into account the user's emotional state. Furthermore, there is no system that automatically integrates this information to create an optimal private schedule and recommend products. Therefore, there is a need for a system that analyzes a user's location information, social media posting history, calendar schedule information, and emotional state, and generates and notifies the user of an optimal private schedule while also suggesting appropriate products.

[0984] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0985] In this invention, the server includes: means for collecting location information from the user's smart device; means for collecting the user's posting history to social networking services; means for collecting the user's calendar schedule information; means for analyzing the collected data and identifying the user's preferences and behavioral patterns; means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns; means for notifying the user's smart device of the generated private schedule; an emotion engine including an emotion engine that recognizes the user's emotional state and adjusting the private schedule based on the emotional state; means for automatically making necessary online reservations upon receiving approval from the user; means for updating the executed reservation details on the user's calendar; and means for providing product purchase links including a recommendation engine that suggests optimal products based on the user's emotional state and schedule. This allows the user to secure optimal private time according to their emotional state and purchase products that suit their preferences at the appropriate time.

[0986] "User's smart device" refers to a communication device that collects or transmits the user's personal information, including GPS sensors, social networking applications, and calendar applications.

[0987] "Location information" is data indicating the user's current location obtained using a GPS sensor or other device.

[0988] A "social networking service" is an online platform that enables users to share information and feelings with other people.

[0989] "Posting history" is a record of messages, images, etc. that a user has posted on a social networking service.

[0990] "Calendar schedule information" is data that records the date, time, and content of a user's plans and events.

[0991] The "means of analyzing data" refers to a system that includes algorithms that analyze user behavior patterns and preferences based on collected location information, posting history, and calendar schedule information.

[0992] A "Private Schedule" is a list of appointments tailored to optimize a user's personal time.

[0993] The "emotion engine" is a technology that has the ability to analyze a user's emotional state based on their posts, behavior, voice, etc.

[0994] "Online reservation" refers to the entire reservation process carried out using an online system.

[0995] A "recommendation engine" is an algorithm that suggests individually optimal products and services based on a user's behavior and emotions.

[0996] "Purchase Link" means a web link that allows users to easily purchase the suggested product.

[0997] This invention is a system that optimizes a user's private time and suggests appropriate products based on their emotional state and behavioral patterns. This system is mainly composed of three elements: a server, a terminal, and the user.

[0998] server

[0999] Hardware and Software

[1000] The server has high-performance computing resources and is responsible for data analysis and emotion recognition. Specifically, it uses the following hardware and software:

[1001] Hardware:

[1002] A server with a fast processor and sufficient memory

[1003] software:

[1004] Machine learning libraries (e.g., scikit-learn)

[1005] Emotion recognition engine (e.g., EmotionEngine)

[1006] Database management system (e.g. MySQL)

[1007] Processing content

[1008] The server operates as follows:

[1009] 1. Data collection: The server receives location information, social media posting history, and calendar schedule information collected from the user's device and stores it in a database.

[1010] 2. Emotion recognition: Analyzes social media posts and user voice data to identify emotional states.

[1011] 3. Data analysis: Analyze the collected data to identify user behavior patterns and preferences using machine learning algorithms (e.g., KMeans clustering).

[1012] 4. Generating a private schedule: Based on the analysis results and emotion recognition results, a private schedule optimal for the user is generated.

[1013] 5. Product Recommendation: Use a recommendation engine to recommend appropriate products based on the user's emotional state and schedule.

[1014] Terminal

[1015] Hardware and Software

[1016] The devices used are mainly smartphones and smart glasses that users use on a daily basis.

[1017] Hardware:

[1018] GPS sensor

[1019] Internet connection function

[1020] software:

[1021] Calendar app (e.g. iCal)

[1022] Social networking apps (e.g. Twitter API / Earwig API)

[1023] A library for emotion engines

[1024] Processing content

[1025] The device's primary role is to collect data and notify the user.

[1026] 1. Data collection: We use a GPS sensor to collect location information, use the API of social media platforms to obtain posting history, and obtain schedule information from calendar apps.

[1027] 2. Data transmission: The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[1028] 3. Notification and Approval: Notify the user of private schedules and product recommendations sent from the server and provide the option to approve or cancel.

[1029] 4. Schedule update: Sends the user's approval information to the server and adds the approved reservation to the calendar.

[1030] user

[1031] Roles and Operations

[1032] The user mainly performs the following operations:

[1033] 1. Data provision: Location information, social media posts, and schedule information are indirectly provided through everyday use of devices.

[1034] 2. Confirm notifications: Check the private schedule and product recommendations notified on your device and choose to accept or cancel.

[1035] 3. Schedule Management: Review approved schedules and booking information and coordinate daily activities.

[1036] Specific examples

[1037] For example, if a user's social media posts indicate that they have been feeling stressed recently, the system can recommend a relaxation product (e.g., an aroma diffuser). The system then notifies the user of this recommendation and, if the user agrees, provides a link to purchase the product. If the user has time to relax on the weekend, the system can add a plan to visit a new cafe to their private schedule.

[1038] Prompt Sentence Examples

[1039] "Analyze users' social media posts to see if they are in an emotional state that requires a relaxing effect."

[1040] "Use a clustering algorithm to identify products that users prefer based on their past schedules and emotional state."

[1041] "Promote purchases by suggesting the best products in a timely manner based on the user's emotional state and schedule."

[1042] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1043] Step 1:

[1044] Data collection

[1045] Input: User location information, social media posting history, calendar schedule information

[1046] Processing: The device collects location information using the GPS sensor, retrieves posting history using the SNS API, and collects schedule information from the calendar app.

[1047] Output: Real-time location data, social media posting history data, calendar schedule data

[1048] Step 2:

[1049] Data transmission

[1050] Input: Location information collected in Step 1, social media posting history, and calendar schedule information

[1051] Processing: The device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[1052] Output: Location data stored on the server, SNS posting history data, calendar schedule data

[1053] Step 3:

[1054] emotion recognition

[1055] Input: Social media posting history stored on the server

[1056] Processing: The server's emotion engine analyzes the content of social media posts and identifies the user's emotional state. For example, it detects positive emotions (joy, anticipation) or negative emotions (stress, anxiety) from the context and expressions of the posts.

[1057] Output: User's emotional state data (e.g., positive, negative)

[1058] Step 4:

[1059] Data analysis

[1060] Input: Location data, calendar schedule data, emotional state data stored on the server

[1061] Processing: The server uses machine learning algorithms (e.g., KMeans clustering) to cluster historical behavioral data and identify user behavioral patterns and preferences.

[1062] Output: User behavior pattern data, preference data

[1063] Step 5:

[1064] Creating a private schedule

[1065] Input: behavioral pattern data, preference data, emotional state data

[1066] Processing: Based on the analysis results, the server generates an optimal private schedule for the user. For example, it suggests relaxation activities when the user is feeling stressed and adjusts the schedule to fit available time slots on the calendar.

[1067] Output: Private schedule data

[1068] Step 6:

[1069] Generating Product Recommendations

[1070] Input: behavioral pattern data, preference data, emotional state data

[1071] Processing: The server's recommendation engine selects the most suitable product based on the user's emotional state and schedule, and generates a purchase link. Specifically, if the user needs a product with a relaxing effect, it will recommend that product.

[1072] Output: Recommended product data, purchase link

[1073] Step 7:

[1074] Private schedule and product notifications

[1075] Input: Private schedule data, recommended product data, purchase link

[1076] Processing: The server sends the generated private schedule and product recommendations to the device, which then provides this information to the user via push notifications or in-app notifications.

[1077] Output: Private schedule and recommended products displayed on the user's device

[1078] Step 8:

[1079] User Acknowledgment and Feedback

[1080] Input: User's decision (approval or cancellation)

[1081] Processing: The user checks the private schedule and recommended products displayed on the device and indicates their intention to approve or cancel. The device then sends this information to the server.

[1082] Output: Approval or cancellation data

[1083] Step 9:

[1084] Online booking and calendar updates

[1085] Input: Approved private schedule data, recommended product data

[1086] Processing: The server automatically makes the necessary online reservations based on the user's approval information. After the reservation is completed, the information is sent to the device, which then updates the calendar with the reservation details.

[1087] Output: Confirmed online booking information, updated calendar data

[1088] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1089] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1090] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1091] [Third embodiment]

[1092] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1093] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1094] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1095] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1096] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1097] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1098] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1099] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1100] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1101] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1102] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1103] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1104] MODE FOR CARRYING OUT THE INVENTION

[1105] overview

[1106] This invention is a system that collects and analyzes information such as smart device location information, social networking service (SNS) posting history, and calendar schedules with the aim of optimizing users' private time. Based on the analysis results, it generates a private schedule suited to the user and notifies the user's smart device. If the user approves, it automatically makes online reservations and manages the schedule. This system operates primarily through interactions between the server, terminals, and users.

[1107] Program processing

[1108] 1. Data Collection

[1109] Terminal

[1110] The device collects the user's location information in real time. The location information is obtained using geographic information acquisition systems such as GPS sensors. In addition, the device also collects social media posting history and calendar schedule information. The social media posting history is obtained via the API of each social media platform used by the user, and the calendar schedule is obtained using the calendar application's API.

[1111] Device -> Server

[1112] The collected data is periodically sent to a server via a secure communication protocol (e.g., HTTPS).

[1113] 2. Data analysis and plan generation

[1114] server

[1115] The server's AI engine analyzes the received data and identifies the user's behavioral patterns and preferences. Specifically, it uses machine learning algorithms to cluster and classify the user's past behavioral data, and as a result, it finds out the places the user often visits on the weekends and the activities they are interested in.

[1116] It then generates a personalized schedule based on the identified behavioral patterns and preferences. For example, if a user enjoys cafe hopping, it generates a plan to visit newly opened cafes.

[1117] 3. Plan Notification and Approval

[1118] Server -> Device

[1119] The generated plan is sent from the server to the terminal, and the notification includes specific plan contents (e.g., visit locations, times, necessary reservation information) and an interface for approval or cancellation.

[1120] Terminal

[1121] The device will display the received plan to the user, and the user will receive a push notification or in-app notification with plan details.

[1122] user

[1123] The user checks the notification and either approves or cancels the plan. If approval is given, the approval information is sent from the device to the server.

[1124] 4. Making and managing reservations

[1125] server

[1126] The server that receives the user's approval automatically executes the online reservation. For example, if a reservation is required for a restaurant or event ticket purchase, the reservation procedure is carried out via the corresponding reservation API.

[1127] Once a reservation is completed, information is sent to the device to add the reservation to the user's calendar. If the user does not approve the reservation by the specified cancellation deadline, the reservation is automatically canceled. This prevents unnecessary reservations from remaining.

[1128] Terminal

[1129] The device will then add new events to the user's calendar app based on the received reservation information, ensuring the user always has the most up-to-date schedule.

[1130] Specific examples

[1131] 1. Data Collection

[1132] The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[1133] 2. Data analysis and plan generation

[1134] The server analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[1135] 3. Plan Notification and Approval

[1136] The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[1137] 4. Making and managing reservations

[1138] The server automatically makes a reservation for the cafe based on the approved plan and reflects the reservation details on the user's calendar.

[1139] In this way, the present invention optimizes the user's private time and provides effective and stress-free leisure activities.

[1140] The processing flow will be explained below.

[1141] Step 1:

[1142] Data Collection - Location Information

[1143] The device uses a GPS sensor to obtain the user's location information in real time. Location information is collected at regular intervals (for example, every 10 minutes) and recorded along with the date and time. This allows the device to understand where the user has moved and how long they have stayed.

[1144] Step 2:

[1145] Data Collection - Social Media Post History

[1146] The device retrieves the user's posting history from social media platforms (e.g., Facebook, Instagram, Twitter). It uses each social media platform's API to collect past posting data (text, images, posting date and time, etc.). This data is used to understand the user's interests and activity patterns.

[1147] Step 3:

[1148] Data Collection - Calendar Schedule

[1149] The device uses the API of the user's calendar application (e.g., Google Calendar) to retrieve schedule information, including the event title, date, time, location, and details, to coordinate current events and plan suggestions.

[1150] Step 4:

[1151] Data transmission

[1152] The device periodically sends the collected location information, social media posting history, and calendar schedule information to a server. The data is sent securely using a secure communication protocol (e.g., HTTPS).

[1153] Step 5:

[1154] Data analysis

[1155] The server analyzes the received data, using machine learning algorithms and data mining techniques to identify user behavioral patterns and preferences, such as the frequency of places visited in the past and the content posted on social media.

[1156] Step 6:

[1157] Creating a private schedule

[1158] The server generates an optimal private schedule for the user based on the analysis results. For example, if the server determines that the user likes to go cafe hopping on weekends, it will suggest a plan to visit a new cafe the following weekend.

[1159] Step 7:

[1160] Plan Notification

[1161] The server sends the generated schedule plan to the device. This notification includes specific plan details (visit locations, times, and necessary reservation information). Notifications are sent via push notifications or in-app notifications.

[1162] Step 8:

[1163] Plan Approval / Cancellation

[1164] The user checks the notification and approves or cancels the plan. If they approve, they press the "Approve" button on their device. The device then sends the approval information to the server.

[1165] Step 9:

[1166] Automatic booking

[1167] The server receives the plan approval information from the user and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event using a reservation API.

[1168] Step 10:

[1169] Calendar updates

[1170] The server notifies the device that the reservation has been confirmed, and the device adds the received reservation information to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule on the calendar.

[1171] Step 11:

[1172] Manage your booking

[1173] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. This information is also notified to the device, and the relevant event is deleted from the calendar. This prevents unnecessary reservations from remaining.

[1174] For example, if a user approves a plan to visit a new cafe on Sunday, the server will make a reservation for that cafe on Friday and update the calendar, allowing the user to enjoy fulfilling leisure activities based on their preferences.

[1175] Example 1

[1176] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1177] In modern society, efficiently managing and maximizing users' private time is an important issue. However, conventional methods require users to plan their own schedules and make reservations, which is time-consuming and laborious. It is also difficult to generate schedules that reflect users' preferences and behavioral patterns, making it difficult to create effective plans. Furthermore, because reservation approvals and cancellations are managed manually, there is a high risk of errors or omissions.

[1178] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1179] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to social media services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for executing necessary automatic reservations upon receiving approval from the user, means for reflecting the executed reservation details in the user's calendar, means for automatically canceling the reservation if the user does not approve by a specified cancellation deadline, and means for rescheduling based on the executed reservation details. This allows the user to receive suggestions for an optimal private schedule based on their preferences and behavioral patterns, and automates schedule planning, reservation procedures, and approval / cancellation management, reducing effort and time.

[1180] "Location information" is geographic data about where a user is currently located or where a user has previously visited.

[1181] A "social media service" is an online platform where users can post photos, comments, etc. and interact with other users.

[1182] "Posting history" refers to the history of content that a user has posted in the past on social media services.

[1183] "Calendar information" refers to digital calendar data that records a user's schedule and appointments.

[1184] "Information processing devices" are electronic devices such as smartphones, tablets, and computers that users use on a daily basis.

[1185] "Data Analysis" means the technical means of processing collected data to identify user behavior patterns and preferences.

[1186] A "private schedule" is a schedule or plan created to efficiently manage a user's personal time.

[1187] "Notification" refers to a message or alert that notifies the user of the contents of the generated private schedule.

[1188] "Automatic reservation" is a process in which the system automatically completes the reservation procedure based on the user's approval.

[1189] "Cancellation Deadline" means the final date and time by which a User can confirm or cancel a booking.

[1190] "Rescheduling" is the process of generating a new schedule when changes occur to an existing schedule.

[1191] MODE FOR CARRYING OUT THE INVENTION

[1192] overview

[1193] This invention is a system that collects and analyzes location information, social media posting history, and calendar information from information processing devices with the aim of optimizing users' private time. Based on the analysis results, a private schedule suited to the user is generated and notified to the user's information processing device. If the user approves, an automatic reservation is made and the contents are reflected in the calendar. This system operates mainly through interactions between the server, terminal, and user.

[1194] Data Collection and Transmission

[1195] The device collects the user's location information in real time using a GPS sensor. In addition, the device obtains the user's social media posting history via API and collects schedule information via the calendar application's API. The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[1196] Data analysis and plan generation

[1197] The server uses an AI engine to analyze the received location information, social media posting history, and calendar information. Using machine learning algorithms, it performs clustering and classification based on the user's past behavioral data to identify the user's behavioral patterns and preferences. For example, it analyzes the cafes the user frequently visits on weekends and their hobby activities, and generates an optimal private schedule based on that information.

[1198] Plan Notification and Approval

[1199] The generated plan is sent from the server to the device. This notification includes specific visit locations, times, and necessary reservation information, and is sent to the user via push notification or in-app notification. The user can review the notification and choose to approve or cancel the plan. If approved, the information is sent from the device to the server.

[1200] Making and managing reservations

[1201] After receiving the user's authorization information, the server automatically executes the online reservation via the appropriate reservation API, such as making a restaurant reservation or purchasing an event ticket. Once the reservation is completed, the reservation information is sent to the device to be reflected in the user's calendar, and the device adds the information to the calendar application.

[1202] If the user does not approve the plan by the specified cancellation deadline, the reservation will be automatically canceled, which prevents unnecessary reservations from remaining.

[1203] Specific examples

[1204] 1. The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[1205] 2. The server's AI engine analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[1206] 3. The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[1207] 4. The server automatically makes a reservation at the cafe based on the approved plan and updates the reservation details on the user's calendar.

[1208] Prompt Sentence Examples

[1209] "Can you recommend any new cafes for my weekend cafe crawl?"

[1210] "Please suggest the best leisure plan based on next week's schedule."

[1211] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1212] Step 1:

[1213] Location information collection

[1214] Input: The device uses the GPS sensor to obtain the user's location.

[1215] What it does: The device collects GPS data in real time at specific intervals and records the history of the places the user has visited.

[1216] Output: Generates the collected location data.

[1217] Step 2:

[1218] Acquiring SNS posting history

[1219] Input: The device accesses the API of the social media platform the user uses.

[1220] Specific operation: The device calls the API of each SNS and obtains the user's posting history data, for example, to obtain recently posted photos and comments about a cafe.

[1221] Output: The retrieved social media posting history data is generated.

[1222] Step 3:

[1223] Get calendar information

[1224] Input: The device accesses the API of the user's calendar application.

[1225] Specific operation: The device obtains the user's schedule data through the calendar API, such as upcoming events and reservation information.

[1226] Output: The retrieved calendar schedule data is generated.

[1227] Step 4:

[1228] Sending data

[1229] Input: The device sends the collected location information, social media posting history, and calendar schedule data to the server.

[1230] What it does: The device uses HTTPS to securely send collected data to the server.

[1231] Output: The data received by the server is generated.

[1232] Step 5:

[1233] Data analysis

[1234] Input: The server analyzes the received location data, social media posting history data, and calendar schedule data.

[1235] What it does: The server's AI engine uses machine learning algorithms to identify user behavioral patterns and preferences, such as how often a user visits a cafe on the weekend and the activities they are interested in.

[1236] Output: Generates analytical results about user behavior patterns and preferences.

[1237] Step 6:

[1238] Generate a plan

[1239] Input: The server generates an optimal private schedule for the user based on the analysis results.

[1240] Specific operation: The server uses the analysis results to create a schedule that combines appropriate places to visit and activities for the user. For example, it generates a plan to visit a newly opened cafe.

[1241] Output: The generated private schedule is generated.

[1242] Step 7:

[1243] Plan Notification

[1244] Input: The server sends the generated private schedule to the terminal.

[1245] What happens: The server notifies the user of the schedule details via push notification or in-app notification.

[1246] Output: A notification is generated that allows the user to review the plan details.

[1247] Step 8:

[1248] View Plans

[1249] Input: The device displays the received plan to the user.

[1250] Specific behavior: The device will notify the user of the plan details (location, time, reservation information, etc.).

[1251] Output: User-visible plan details are generated.

[1252] Step 9:

[1253] Accept or Cancel

[1254] Input: The user reviews the notified plan and accepts or cancels it.

[1255] Specific action: The user taps the button to accept or cancel the plan via the device.

[1256] Output: Approval or cancellation information is generated.

[1257] Step 10:

[1258] Sending approval information

[1259] Input: The device sends the user's authorization information to the server.

[1260] Specific operation: The device sends authorization information to the server using HTTPS communication.

[1261] Output: The authorization information received by the server is generated.

[1262] Step 11:

[1263] Automatic booking execution

[1264] Input: The server performs automatic booking based on the received authorization information.

[1265] Specific operation: The server automatically makes reservations, for example at a cafe, via a corresponding reservation API.

[1266] Output: Information that the reservation is completed is generated.

[1267] Step 12:

[1268] Reflection on the calendar

[1269] Input: The server sends the completed reservation information to the terminal.

[1270] What happens: The server sends the reservation details to the user's device, and the device adds the information to its calendar application.

[1271] Output: The booking information is generated and reflected in the user's calendar.

[1272] Step 13:

[1273] Automatic cancellation processing

[1274] Input: If the user does not accept the plan by the specified cancellation deadline.

[1275] What happens: The server automatically cancels any pending reservations.

[1276] Output: Cancelled reservation information is generated.

[1277] In this way, the system of the present invention enables efficient schedule management and automatic reservations to make the most of the user's private time.

[1278] (Application example 1)

[1279] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1280] In modern factories and other workplaces, maximizing worker efficiency and performing tasks efficiently is crucial. However, there is a lack of systems that provide workers with real-time information such as which equipment should be maintained next and which route is the shortest. In such situations, workers have to spend time and effort manually creating work plans, resulting in reduced efficiency. Furthermore, if workers cannot quickly obtain the tools and manuals they need, work delays and errors are more likely to occur.

[1281] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1282] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to online services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for automatically executing necessary online reservations upon receiving the user's approval, means for reflecting the executed reservation details in the user's calendar, means for presenting an optimal work schedule to the user in real time using smart glasses, means for collecting and analyzing the user's location information and work logs, and means for providing information for maximizing the user's work efficiency based on the analysis results. This makes it possible to provide optimal work schedules and necessary information to workers in work sites such as factories in real time, thereby maximizing work efficiency.

[1283] "Information processing device" refers to all electronic devices that have the function of collecting, analyzing, and displaying data.

[1284] "Location Information" refers to information collected using GPS or other geographic information systems to provide coordinate data for a specific location.

[1285] "Online Services" refers to social networking services and other digital services provided via the Internet.

[1286] "Posting history" refers to a record of past content and comments posted by a user to an online service.

[1287] "Calendar Information" refers to data stored in a calendar or schedule management application that contains a user's appointments and schedules.

[1288] "Preferences" refer to specific interests or tendencies that a user exhibits through their past behavior and posts.

[1289] "Behavioral patterns" refer to the tendencies of users, such as the actions they have taken regularly in the past and the places they have visited.

[1290] "Private Schedule" refers to a calendar or plan generated to optimize a user's personal time.

[1291] "Smart glasses" are a type of wearable device that has the shape of glasses and is equipped with a display function to display information.

[1292] "Work log" refers to the records and log data of work performed by a user.

[1293] "Real-time" refers to data collection, analysis, and display occurring immediately, without delay.

[1294] "Work efficiency" refers to minimizing the effort and time required to perform a task and maximizing the results.

[1295] The system for implementing this invention includes smart glasses worn by the user, a server for processing data, and a communication means for exchanging data between them. Software for collecting and analyzing user location information, posting history on online services, schedule information, etc. also plays an important role.

[1296] The server uses the following hardware and software:

[1297] Hardware: Server platform (e.g., Amazon Web Services (AWS), Microsoft Azure)

[1298] Software: Machine learning algorithms for data analysis (e.g., Scikit-learn, TensorFlow)

[1299] The smart glasses that serve as the terminals use the following hardware and software.

[1300] Hardware: Smart glasses (e.g., Microsoft HoloLens, Google Glass)

[1301] Software: Location information collection application, application that configures the user interface

[1302] First, the smart glasses, which are the device, collect the user's location information in real time. This location information is obtained using the GPS sensor built into the smart glasses. Work logs are also recorded and saved on the device.

[1303] Next, the device transmits the collected location information and work log data to a server via a secure communication protocol (e.g., HTTPS).

[1304] The server analyzes the received data using machine learning algorithms to identify the user's behavioral patterns and preferences, and generates a personal and work schedule tailored to the user based on the analysis results.

[1305] The generated schedule is sent in real time from the server to the device, which then displays the schedule to the user on the smart glasses, providing information such as the next best maintenance task, its location, the best route, and any necessary tools and manuals.

[1306] Once the user checks and approves the presented schedule, the server automatically makes the necessary online reservations (e.g., equipment maintenance reservations, parts orders, etc.) and reflects the reservation details in the user's calendar.

[1307] As a specific example, a factory worker wears smart glasses to perform his next maintenance task. The smart glasses identify the worker's current location and provide an optimal work schedule and route in real time. The worker can also quickly obtain the necessary tools and manuals based on the information displayed on the smart glasses, without having to search for them.

[1308] An example of a prompt to be input to a generative AI model is as follows:

[1309] User ID: user123

[1310] Location information: GPS data

[1311] Work Log: Work Log Data

[1312] Calendar Schedule: Calendar schedule data

[1313] Analyze this data and suggest the best next maintenance tasks and locations.

[1314] In this way, the present invention can maximize the user's work efficiency and realize efficient and stress-free work at work sites such as factories.

[1315] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1316] Step 1:

[1317] The device (smart glasses) collects the user's location information and work log. Location information is obtained using a built-in GPS sensor, and the work log records the user's operations and work content. The collected data is temporarily stored in the device.

[1318] Input: Location information from the GPS sensor, user operation log data

[1319] Output: Temporarily saved location information and work log

[1320] Step 2:

[1321] The device sends the collected location information and work logs to the server via a secure communication protocol (e.g., HTTPS). The data is encrypted and transmitted securely.

[1322] Input: Temporarily saved location information and work log

[1323] Output: Location information and work log data sent to the server

[1324] Step 3:

[1325] The server uses machine learning algorithms to analyze the received data, including clustering and classification based on past behavioral patterns and preferences, to identify the user's next actions and required tasks.

[1326] Input: Location information and work log sent from the device

[1327] Output: Analysis results that identify user behavior patterns and preferences

[1328] Step 4:

[1329] Based on the identified behavioral patterns and preferences, the server generates a personalized personal and work schedule for the user, including information on upcoming maintenance tasks, routes, and required tools and manuals.

[1330] Input: Identified behavioral patterns and preferences

[1331] Output: Generated private schedule and work schedule

[1332] Step 5:

[1333] The server sends the generated schedule to the device in real time, and the device (smart glasses) presents the received schedule to the user, displaying information such as the next task to be performed, the route to be taken, and the tools to be used.

[1334] Input: Generated private schedule and work schedule

[1335] Output: Schedule sent to the device

[1336] Step 6:

[1337] The user can check the schedule displayed on the smart glasses and approve or cancel it. If approved, the information is sent from the device to the server.

[1338] Input: The schedule presented to the user

[1339] Output: User authorization information

[1340] Step 7:

[1341] The server receives approval information from the user and automatically executes the necessary online reservations, such as booking equipment maintenance or ordering parts, via the reservation API.

[1342] Input: User authorization information

[1343] Output: Details of the executed net reservation

[1344] Step 8:

[1345] The server sends information to the device to reflect the executed reservation details in the user's calendar. The device adds a new appointment to the user's calendar app based on the received reservation information.

[1346] Input: Details of the online reservation

[1347] Output: Reservation details reflected in the user's calendar

[1348] Through the above processing steps, a system is realized that maximizes the user's work efficiency and allows for efficient and stress-free work.

[1349] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1350] MODE FOR CARRYING OUT THE INVENTION

[1351] overview

[1352] This invention is a system that collects and analyzes smart device location information, social networking service (SNS) posting history, and calendar schedule information in order to optimize a user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's smart device, and if approved, online reservations are automatically made and schedule management is performed.

[1353] Program processing

[1354] 1. Data Collection

[1355] Terminal

[1356] The device uses a GPS sensor to receive the user's location information in real time. The collected location information, including time information, is sent to a server. The device also periodically retrieves the user's posting history using the API of the social media platform. It also collects schedule information via the API of the user's calendar application. All of this information is sent to the server.

[1357] Device -> Server

[1358] The device periodically uploads collected location information, social media posting history, and calendar schedule information to a server. Data is transmitted securely using a secure communication protocol (e.g., HTTPS).

[1359] 2. Data Analysis and Emotion Recognition

[1360] server

[1361] The server analyzes the collected data to identify user patterns and preferences, using machine learning algorithms to cluster users' past behavioral data and identify activities of interest and frequently visited locations.

[1362] Furthermore, the emotion engine analyzes the user's voice data, facial expression data, and social media posts to recognize their current emotional state. For example, it can recognize positive emotions (joy, excitement) and negative emotions (stress, anxiety) from the user's tone of voice and social media posts.

[1363] 3. Create a private schedule

[1364] server

[1365] The server generates a personalized schedule based on the results of behavioral pattern analysis and emotion recognition. For example, if the server detects that the user is feeling stressed, it will suggest activities that will have a relaxing effect (such as relaxing at a spa or cafe). If the user is feeling very happy, it will suggest gathering with friends or participating in fun events to share the excitement.

[1366] 4. Plan Notification and Approval

[1367] Server -> Device

[1368] The server notifies the device of the generated private schedule, which includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel the plan.

[1369] Terminal

[1370] The device will display plan notifications in a user-friendly format, using push notifications and in-app notifications to inform users of plan details.

[1371] user

[1372] The user checks the notification and either accepts or cancels the plan. If the plan is accepted, the device sends the information to the server.

[1373] 5. Automatic booking and calendar updates

[1374] server

[1375] After receiving the user's authorization information, the server automatically makes the necessary online reservations, such as using a reservation API to reserve a restaurant or event ticket.

[1376] Once the reservation is complete, the reservation information is sent to the device, and if the user does not approve the plan by the specified cancellation deadline, the reservation is automatically canceled.

[1377] Terminal

[1378] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[1379] Specific examples

[1380] 1. Data Collection

[1381] The device collects location information of cafes visited by users on Sundays, as well as photos and comments posted to social media about cafes, and sends them to the server. It also obtains the user's free time slots for the next week as part of their calendar information.

[1382] 2. Data Analysis and Emotion Recognition

[1383] The server analyzes that the user likes to go to cafes, and at the same time recognizes from social media posts that the user has been feeling stressed recently.

[1384] 3. Create a private schedule

[1385] The server generates plans for visiting new cafes for a relaxing weekend getaway, and even suggests making reservations at the cafe, reducing the stress of securing a reservation.

[1386] 4. Plan Notification and Approval

[1387] The server will send the generated plan to the user's device on Friday, where the user can review the plan and press the approve button.

[1388] 5. Automatic booking and calendar updates

[1389] The server makes a reservation for the cafe based on the approved plan and sends the reservation information to the device, which then adds a new event to its calendar.

[1390] In this way, the system can optimize users' private time and provide enriching leisure activities that correspond to their emotional state.

[1391] The processing flow will be explained below.

[1392] Step 1:

[1393] Data Collection - Location Information

[1394] The device uses a GPS sensor to obtain the user's location information in real time. The device collects the user's current location information at a specified interval (e.g., every 10 minutes) and records it along with the time information. The collected location information is temporarily stored on the device.

[1395] Step 2:

[1396] Data Collection - Social Media Post History

[1397] The device uses the API of social media platforms (e.g., Facebook, Instagram, Twitter) to obtain the user's posting history. It periodically (e.g., once a day) collects social media posting data (text, images, and posting date and time), and also collects information to understand the user's emotions from acceptable social media posts.

[1398] Step 3:

[1399] Data Collection - Calendar Schedule

[1400] The device retrieves schedule information using the API of the user's calendar application (e.g., Google Calendar). The collected schedule information includes the title, date, time, location, and details of the schedule. This information is used to adjust the current schedule and the proposed new plan.

[1401] Step 4:

[1402] Data transmission

[1403] The device sends the collected location information, SNS posting history, and calendar schedule information to a server. The data is uploaded to the server at a fixed time every day (e.g., 1:00 AM) using a secure communication protocol (e.g., HTTPS).

[1404] Step 5:

[1405] Data analysis

[1406] The server analyzes the received data and uses machine learning algorithms and data mining techniques to identify user behavior patterns and preferences. For example, it analyzes the frequency with which users visit cafes on weekends and the patterns of the places they visit to understand their interests.

[1407] Step 6:

[1408] emotion recognition

[1409] The server recognizes the user's emotions using an emotion engine. It analyzes voice data, facial expression data, and SNS posts to determine the user's current emotional state (e.g., positive, negative). The emotion engine generates data that reflects the user's psychological state.

[1410] Step 7:

[1411] Creating a private schedule

[1412] The server generates a personalized schedule based on the results of data analysis and emotion recognition. For example, if the server determines that the user is feeling stressed, it will suggest a plan for effective relaxation (e.g., relaxing at a spa or cafe).

[1413] Step 8:

[1414] Plan Notification

[1415] The server notifies the device of the created private schedule. This notification includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel. Notifications are sent via push notifications or in-app notifications.

[1416] Step 9:

[1417] Plan Approval / Cancellation

[1418] The user checks the plan notification received on the device and approves or cancels the plan. If approving, the user presses the "Approve" button. The device then sends this approval information to the server. Similarly, if the plan is canceled, the device also sends cancellation information to the server.

[1419] Step 10:

[1420] Automatic booking

[1421] The server receives the user's authorization information and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event, using a reservation API. Once the reservation is complete, the information is sent to the device.

[1422] Step 11:

[1423] Calendar updates

[1424] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[1425] Step 12:

[1426] Manage your booking

[1427] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. The cancellation information will also be notified to the device, and the corresponding schedule will be deleted from the user's calendar. This prevents unnecessary reservations from remaining.

[1428] To give a concrete example, suppose a user visits a cafe on Sunday and posts on social media that they have been feeling stressed lately. The device then sends this information along with their location and calendar schedule to the server. The server recognizes that the user is feeling stressed and generates a plan suggesting a relaxing time at a cafe for the following weekend. The generated plan is notified to the device on Friday, and if the user approves, the server automatically makes a reservation at the cafe and updates the calendar with the reservation information.

[1429] Example 2

[1430] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1431] In modern society, users lead busy lives and are expected to make efficient and optimal use of their private time. However, current schedule management systems do not take into account the user's emotional state and are unable to suggest appropriate leisure activities based on their emotions and stress levels, which prevents them from fully increasing user satisfaction. In addition, booking procedures and schedule updates are often done manually, which places a burden on users.

[1432] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1433] In this invention, the server includes means for collecting location information from the user's mobile device, means for collecting the user's posting history to social networking services, means for collecting the user's schedule information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for evaluating the user's emotional state, means for generating a private schedule suitable for the user based on the identified preferences, behavioral patterns, and emotional state, means for notifying the user's mobile device of the generated private schedule, means for automatically making necessary online reservations upon receiving approval from the user, and means for reflecting the contents of the made reservations in the user's schedule. This makes it possible to suggest optimal leisure activities according to the user's emotional state and automatically adjust and update the schedule.

[1434] "User" refers to an individual who uses this system.

[1435] "Mobile device" refers to a portable device owned by a user, such as a smartphone or tablet.

[1436] "Location information" refers to the latitude and longitude data of the user's current location obtained using a GPS sensor or other device.

[1437] "Social Networking Service (SNS)" refers to an online platform where users can post and share their information.

[1438] "Posting history" refers to data such as text, images, and videos that a user has posted in the past on social media.

[1439] "Schedule information" refers to calendar information that records the user's plans and events.

[1440] "Collected data" refers to all location information, social media posting history, and schedule information collected from mobile devices.

[1441] "Analysis" refers to the processing of collected data to identify user behavioral patterns, preferences, and emotional states.

[1442] "Behavioral patterns" refer to the tendencies and patterns of behavior that a user has exhibited in the past.

[1443] "Preferences" refers to a user's hobbies and tendencies identified from analyzed data.

[1444] "Emotional state" refers to the user's current emotional state (e.g., joy, sadness, stress).

[1445] "Private schedule" refers to individual plans and events generated based on the user's emotional state and behavioral patterns.

[1446] "Notification" refers to an alert or message sent to a user's mobile device to notify them of the generated private schedule.

[1447] "Approval" refers to the act of a user reviewing and agreeing to a proposed private schedule.

[1448] "Online reservations" refers to reservation procedures made via web services (e.g., making restaurant reservations or purchasing event tickets).

[1449] "Reflecting on schedule" refers to adding or updating the reservation details that have been approved by the user to the schedule information.

[1450] "Cancellation Deadline" means the deadline by which you must accept the Plan in order to keep your Reservation.

[1451] "Rescheduling" refers to rearranging a schedule in the event of an unexpected change or cancellation.

[1452] MODE FOR CARRYING OUT THE INVENTION

[1453] overview

[1454] This invention is a system that collects and analyzes location information, social networking service (SNS) posting history, schedule information, and other information from a user's mobile device in order to optimize the user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotional state, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's mobile device, and if approved, online reservations are automatically made and schedule management is performed.

[1455] System Configuration and Operation

[1456] 1. Hardware and Software Overview

[1457] The system consists of the following main components:

[1458] Mobile device: Equipped with a GPS sensor, internet connection function, SNS application, and calendar application.

[1459] Server: Has high-performance computing resources to run data analysis, machine learning algorithms, and emotion recognition engines.

[1460] Data collection software: Includes APIs for collecting location information, social media posting history, and schedule information.

[1461] Data analysis software: Machine learning algorithms for behavioral pattern analysis and emotion recognition.

[1462] Data collection

[1463] Mobile devices

[1464] The mobile device uses a GPS sensor to collect the user's location information in real time. For example, when a user visits a cafe, the latitude and longitude of the location and the time of the visit are obtained and sent to the server. The API of the social networking platform is used to periodically obtain the user's posting history (text, images, videos). The Google Calendar API is also used to obtain the user's schedule information. All of this data is sent to the server in a secure manner.

[1465] Data analysis and emotion recognition

[1466] server

[1467] The server uses the received location information to analyze the places the user has visited and their behavioral patterns. For example, clustering is performed based on the frequency of cafe visits and length of stay to identify the user's behavioral patterns. The SNS post data is analyzed using natural language processing (NLP) algorithms to extract keywords and perform sentiment analysis. The emotion engine recognizes the user's current emotional state based on voice data, facial expression data, and SNS post data. For example, if the keyword "tired" appears frequently, it is determined that the user is in a state of stress.

[1468] Creating a private schedule

[1469] server

[1470] Based on the analyzed data, the system generates a private schedule that is optimal for the user. For example, if the system determines that the user is feeling stressed, it will suggest activities that will help relieve stress (such as a massage or relaxing at a cafe). The proposed plan is automatically adjusted to avoid overlapping with existing schedules.

[1471] Plan Notification and Approval

[1472] Server -> Mobile device

[1473] The generated private schedule is sent from the server to the mobile device via push notification or in-app notification, and includes specific plan details (places to visit, times, and necessary reservation information).

[1474] user

[1475] The user can then review the notification and accept or cancel the proposed plan. If acceptance is made, the mobile device sends the information to the server.

[1476] Automatic booking and schedule updates

[1477] server

[1478] The server receives the user's approval information and automatically makes the online reservation. For example, a restaurant reservation API is used to make a reservation for a specified date and time. If the reservation is successful, detailed information (reservation number, date and time, location, etc.) is sent to the mobile device. If approval is not received by the specified cancellation deadline, the reservation is automatically canceled.

[1479] Mobile devices

[1480] The mobile device adds the reservation information received from the server to the user's calendar app, making it easier for the user to check the latest schedule.

[1481] Specific examples

[1482] Data collection

[1483] The mobile device collects the location information of the cafe the user visited on Sunday, as well as photos and comments of the cafe posted on social media, and sends them to the server. The Google Calendar API is used to obtain available times for the next week.

[1484] Data analysis and emotion recognition

[1485] The server analyzes the user's preference for cafe hopping and determines from social media posts that the user has been feeling stressed recently. For example, if a user's posts frequently contain keywords such as "tired" and "stressed," the server determines that the user is under stress.

[1486] Creating a private schedule

[1487] The server generates a plan to visit a new cafe for relaxation next weekend, using the cafe's reservation API to reserve some time to relax.

[1488] Plan Notification and Approval

[1489] The server will notify the user of the generated plan on Friday. A push notification will be displayed and the details of the plan can be viewed in the app. The user will review the plan and press the "Approve" button.

[1490] Automatic booking and schedule updates

[1491] The server makes a reservation based on the approved plan and sends the reservation information to the mobile device. The mobile device then uses the Google Calendar API to add the reservation information to the calendar and update the user's schedule.

[1492] Example prompts (input to generative AI models)

[1493] Please tell me how to collect the location information of the cafe you visited on Sunday, as well as the photos and comments of the cafe you posted on social media.

[1494] How do you analyze social media posts to see if a user is experiencing stress?

[1495] I would like to know the specific algorithm that suggests new cafes for users to relax in.

[1496] This allows the system to optimally manage the user's private time and provide fulfilling leisure activities according to their emotional state.

[1497] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1498] Step 1: Data collection

[1499] The device collects the user's location information in real time and periodically obtains SNS posting history and schedule information. The input is current location information from the GPS sensor, user posting data from the SNS API, and schedule data from the calendar API. The output is a set of these data, which is sent to the server using secure communication (e.g., HTTPS). Specifically, the device polls the GPS sensor, SNS, and calendar API every hour, obtains the data, and then uploads it to the server.

[1500] Step 2: Save data

[1501] The server temporarily stores the received location information, SNS posting history, and schedule information in a database. The input is the various data sent from the device. The output is the state saved in the database. The specific operation is to accurately store the received data in the corresponding table in the database.

[1502] Step 3: Data analysis and emotion recognition

[1503] The server analyzes the stored data to identify the user's behavioral patterns and preferences. The input is location information, SNS posting history, and schedule information obtained from the database. The output is a report on the user's behavioral patterns and preferences. A machine learning algorithm is used for the analysis, performing clustering and frequency analysis. For example, it can identify the locations and times of day that a user frequently visits. The emotion engine analyzes SNS posting data, voice data, and facial expression data to recognize the user's emotional state. Specifically, it uses an NLP algorithm to analyze SNS text and calculate an emotion score.

[1504] Step 4: Create a private schedule

[1505] The server generates an optimal private schedule for the user based on the results of behavioral pattern analysis and emotion recognition. The input is the behavioral pattern and emotional state report created in the previous step. The output is a specific schedule proposed to the user. The specific operation is to automatically generate a relaxation and entertainment plan based on the user's free time and preferences. For example, if the user is feeling tired, it will suggest making a reservation at a nearby spa.

[1506] Step 5: Plan Notification

[1507] The server notifies the user's device of the generated private schedule. The input is the generated schedule. The output is the notification sent to the device. The specific operation is to send the user detailed plan contents (visit locations, times, and necessary reservation information) via push notification or email.

[1508] Step 6: Plan Approval

[1509] The user checks the received notification and approves or cancels the proposed plan. The input is the plan notification sent from the server. The output is the user's intention to approve or cancel. The specific action is to press the "Approve" or "Cancel" button on the terminal.

[1510] Step 7: Automated booking

[1511] The server receives approval information from the user and automatically executes the necessary online reservation. The input is the user's approval information. The output is the completed reservation information. The specific operation is to make a reservation at the specified time using the restaurant or spa reservation API. Once the reservation is completed, the reservation information is sent to the user's device.

[1512] Step 8: Update the schedule

[1513] The device adds the reservation information received from the server to the user's calendar app. The input is the completed reservation information. The output is the updated schedule. The specific operation is to use the Google Calendar API to add new events to the calendar and keep the user's schedule up to date.

[1514] (Application example 2)

[1515] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1516] In today's busy lifestyles, it is difficult for users to make optimal use of their private time and fully relax and enjoy themselves. It is also difficult to suggest necessary products at the appropriate time while taking into account the user's emotional state. Furthermore, there is no system that automatically integrates this information to create an optimal private schedule and recommend products. Therefore, there is a need for a system that analyzes a user's location information, social media posting history, calendar schedule information, and emotional state, and generates and notifies the user of an optimal private schedule while also suggesting appropriate products.

[1517] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1518] In this invention, the server includes: means for collecting location information from the user's smart device; means for collecting the user's posting history to social networking services; means for collecting the user's calendar schedule information; means for analyzing the collected data and identifying the user's preferences and behavioral patterns; means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns; means for notifying the user's smart device of the generated private schedule; an emotion engine including an emotion engine that recognizes the user's emotional state and adjusting the private schedule based on the emotional state; means for automatically making necessary online reservations upon receiving approval from the user; means for updating the executed reservation details on the user's calendar; and means for providing product purchase links including a recommendation engine that suggests optimal products based on the user's emotional state and schedule. This allows the user to secure optimal private time according to their emotional state and purchase products that suit their preferences at the appropriate time.

[1519] "User's smart device" refers to a communication device that collects or transmits the user's personal information, including GPS sensors, social networking applications, and calendar applications.

[1520] "Location information" is data indicating the user's current location obtained using a GPS sensor or other device.

[1521] A "social networking service" is an online platform that enables users to share information and feelings with other people.

[1522] "Posting history" is a record of messages, images, etc. that a user has posted on a social networking service.

[1523] "Calendar schedule information" is data that records the date, time, and content of a user's plans and events.

[1524] The "means of analyzing data" refers to a system that includes algorithms that analyze user behavior patterns and preferences based on collected location information, posting history, and calendar schedule information.

[1525] A "Private Schedule" is a list of appointments tailored to optimize a user's personal time.

[1526] The "emotion engine" is a technology that has the ability to analyze a user's emotional state based on their posts, behavior, voice, etc.

[1527] "Online reservation" refers to the entire reservation process carried out using an online system.

[1528] A "recommendation engine" is an algorithm that suggests individually optimal products and services based on a user's behavior and emotions.

[1529] "Purchase Link" means a web link that allows users to easily purchase the suggested product.

[1530] This invention is a system that optimizes a user's private time and suggests appropriate products based on their emotional state and behavioral patterns. This system is mainly composed of three elements: a server, a terminal, and the user.

[1531] server

[1532] Hardware and Software

[1533] The server has high-performance computing resources and is responsible for data analysis and emotion recognition. Specifically, it uses the following hardware and software:

[1534] Hardware:

[1535] A server with a fast processor and sufficient memory

[1536] software:

[1537] Machine learning libraries (e.g., scikit-learn)

[1538] Emotion recognition engine (e.g., EmotionEngine)

[1539] Database management system (e.g. MySQL)

[1540] Processing content

[1541] The server operates as follows:

[1542] 1. Data collection: The server receives location information, social media posting history, and calendar schedule information collected from the user's device and stores it in a database.

[1543] 2. Emotion recognition: Analyzes social media posts and user voice data to identify emotional states.

[1544] 3. Data analysis: Analyze the collected data to identify user behavior patterns and preferences using machine learning algorithms (e.g., KMeans clustering).

[1545] 4. Generating a private schedule: Based on the analysis results and emotion recognition results, a private schedule optimal for the user is generated.

[1546] 5. Product Recommendation: Use a recommendation engine to recommend appropriate products based on the user's emotional state and schedule.

[1547] Terminal

[1548] Hardware and Software

[1549] The devices used are mainly smartphones and smart glasses that users use on a daily basis.

[1550] Hardware:

[1551] GPS sensor

[1552] Internet connection function

[1553] software:

[1554] Calendar app (e.g. iCal)

[1555] Social networking apps (e.g. Twitter API / Earwig API)

[1556] A library for emotion engines

[1557] Processing content

[1558] The device's primary role is to collect data and notify the user.

[1559] 1. Data collection: We use a GPS sensor to collect location information, use the API of social media platforms to obtain posting history, and obtain schedule information from calendar apps.

[1560] 2. Data transmission: The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[1561] 3. Notification and Approval: Notify the user of private schedules and product recommendations sent from the server and provide the option to approve or cancel.

[1562] 4. Schedule update: Sends the user's approval information to the server and adds the approved reservation to the calendar.

[1563] user

[1564] Roles and Operations

[1565] The user mainly performs the following operations:

[1566] 1. Data provision: Location information, social media posts, and schedule information are indirectly provided through everyday use of devices.

[1567] 2. Confirm notifications: Check the private schedule and product recommendations notified on your device and choose to accept or cancel.

[1568] 3. Schedule Management: Review approved schedules and booking information and coordinate daily activities.

[1569] Specific examples

[1570] For example, if a user's social media posts indicate that they have been feeling stressed recently, the system can recommend a relaxation product (e.g., an aroma diffuser). The system then notifies the user of this recommendation and, if the user agrees, provides a link to purchase the product. If the user has time to relax on the weekend, the system can add a plan to visit a new cafe to their private schedule.

[1571] Prompt Sentence Examples

[1572] "Analyze users' social media posts to see if they are in an emotional state that requires a relaxing effect."

[1573] "Use a clustering algorithm to identify products that users prefer based on their past schedules and emotional state."

[1574] "Promote purchases by suggesting the best products in a timely manner based on the user's emotional state and schedule."

[1575] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1576] Step 1:

[1577] Data collection

[1578] Input: User location information, social media posting history, calendar schedule information

[1579] Processing: The device collects location information using the GPS sensor, retrieves posting history using the SNS API, and collects schedule information from the calendar app.

[1580] Output: Real-time location data, social media posting history data, calendar schedule data

[1581] Step 2:

[1582] Data transmission

[1583] Input: Location information collected in Step 1, social media posting history, and calendar schedule information

[1584] Processing: The device sends the collected data to the server using a secure communication protocol (e.g., HTTPS).

[1585] Output: Location data stored on the server, SNS posting history data, calendar schedule data

[1586] Step 3:

[1587] emotion recognition

[1588] Input: Social media posting history stored on the server

[1589] Processing: The server's emotion engine analyzes the content of social media posts and identifies the user's emotional state. For example, it detects positive emotions (joy, anticipation) or negative emotions (stress, anxiety) from the context and expressions of the posts.

[1590] Output: User's emotional state data (e.g., positive, negative)

[1591] Step 4:

[1592] Data analysis

[1593] Input: Location data, calendar schedule data, emotional state data stored on the server

[1594] Processing: The server uses machine learning algorithms (e.g., KMeans clustering) to cluster historical behavioral data and identify user behavioral patterns and preferences.

[1595] Output: User behavior pattern data, preference data

[1596] Step 5:

[1597] Creating a private schedule

[1598] Input: behavioral pattern data, preference data, emotional state data

[1599] Processing: Based on the analysis results, the server generates an optimal private schedule for the user. For example, it suggests relaxation activities when the user is feeling stressed and adjusts the schedule to fit available time slots on the calendar.

[1600] Output: Private schedule data

[1601] Step 6:

[1602] Generating Product Recommendations

[1603] Input: behavioral pattern data, preference data, emotional state data

[1604] Processing: The server's recommendation engine selects the most suitable product based on the user's emotional state and schedule, and generates a purchase link. Specifically, if the user needs a product with a relaxing effect, it will recommend that product.

[1605] Output: Recommended product data, purchase link

[1606] Step 7:

[1607] Private schedule and product notifications

[1608] Input: Private schedule data, recommended product data, purchase link

[1609] Processing: The server sends the generated private schedule and product recommendations to the device, which then provides this information to the user via push notifications or in-app notifications.

[1610] Output: Private schedule and recommended products displayed on the user's device

[1611] Step 8:

[1612] User Acknowledgment and Feedback

[1613] Input: User's decision (approval or cancellation)

[1614] Processing: The user checks the private schedule and recommended products displayed on the device and indicates their intention to approve or cancel. The device then sends this information to the server.

[1615] Output: Approval or cancellation data

[1616] Step 9:

[1617] Online booking and calendar updates

[1618] Input: Approved private schedule data, recommended product data

[1619] Processing: The server automatically makes the necessary online reservations based on the user's approval information. After the reservation is completed, the information is sent to the device, which then updates the calendar with the reservation details.

[1620] Output: Confirmed online booking information, updated calendar data

[1621] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1622] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1623] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1624] [Fourth embodiment]

[1625] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1626] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1627] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1628] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1629] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1630] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1631] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1632] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1633] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1634] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1635] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1636] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1637] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1638] MODE FOR CARRYING OUT THE INVENTION

[1639] overview

[1640] This invention is a system that collects and analyzes information such as smart device location information, social networking service (SNS) posting history, and calendar schedules with the aim of optimizing users' private time. Based on the analysis results, it generates a private schedule suited to the user and notifies the user's smart device. If the user approves, it automatically makes online reservations and manages the schedule. This system operates primarily through interactions between the server, terminals, and users.

[1641] Program processing

[1642] 1. Data Collection

[1643] Terminal

[1644] The device collects the user's location information in real time. The location information is obtained using geographic information acquisition systems such as GPS sensors. In addition, the device also collects social media posting history and calendar schedule information. The social media posting history is obtained via the API of each social media platform used by the user, and the calendar schedule is obtained using the calendar application's API.

[1645] Device -> Server

[1646] The collected data is periodically sent to a server via a secure communication protocol (e.g., HTTPS).

[1647] 2. Data analysis and plan generation

[1648] server

[1649] The server's AI engine analyzes the received data and identifies the user's behavioral patterns and preferences. Specifically, it uses machine learning algorithms to cluster and classify the user's past behavioral data, and as a result, it finds out the places the user often visits on the weekends and the activities they are interested in.

[1650] It then generates a personalized schedule based on the identified behavioral patterns and preferences. For example, if a user enjoys cafe hopping, it generates a plan to visit newly opened cafes.

[1651] 3. Plan Notification and Approval

[1652] Server -> Device

[1653] The generated plan is sent from the server to the terminal, and the notification includes specific plan contents (e.g., visit locations, times, necessary reservation information) and an interface for approval or cancellation.

[1654] Terminal

[1655] The device will display the received plan to the user, and the user will receive a push notification or in-app notification with plan details.

[1656] user

[1657] The user checks the notification and either approves or cancels the plan. If approval is given, the approval information is sent from the device to the server.

[1658] 4. Making and managing reservations

[1659] server

[1660] The server that receives the user's approval automatically executes the online reservation. For example, if a reservation is required for a restaurant or event ticket purchase, the reservation procedure is carried out via the corresponding reservation API.

[1661] Once a reservation is completed, information is sent to the device to add the reservation to the user's calendar. If the user does not approve the reservation by the specified cancellation deadline, the reservation is automatically canceled. This prevents unnecessary reservations from remaining.

[1662] Terminal

[1663] The device will then add new events to the user's calendar app based on the received reservation information, ensuring the user always has the most up-to-date schedule.

[1664] Specific examples

[1665] 1. Data Collection

[1666] The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[1667] 2. Data analysis and plan generation

[1668] The server analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[1669] 3. Plan Notification and Approval

[1670] The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[1671] 4. Making and managing reservations

[1672] The server automatically makes a reservation for the cafe based on the approved plan and reflects the reservation details on the user's calendar.

[1673] In this way, the present invention optimizes the user's private time and provides effective and stress-free leisure activities.

[1674] The processing flow will be explained below.

[1675] Step 1:

[1676] Data Collection - Location Information

[1677] The device uses a GPS sensor to obtain the user's location information in real time. Location information is collected at regular intervals (for example, every 10 minutes) and recorded along with the date and time. This allows the device to understand where the user has moved and how long they have stayed.

[1678] Step 2:

[1679] Data Collection - Social Media Post History

[1680] The device retrieves the user's posting history from social media platforms (e.g., Facebook, Instagram, Twitter). It uses each social media platform's API to collect past posting data (text, images, posting date and time, etc.). This data is used to understand the user's interests and activity patterns.

[1681] Step 3:

[1682] Data Collection - Calendar Schedule

[1683] The device uses the API of the user's calendar application (e.g., Google Calendar) to retrieve schedule information, including the event title, date, time, location, and details, to coordinate current events and plan suggestions.

[1684] Step 4:

[1685] Data transmission

[1686] The device periodically sends the collected location information, social media posting history, and calendar schedule information to a server. The data is sent securely using a secure communication protocol (e.g., HTTPS).

[1687] Step 5:

[1688] Data analysis

[1689] The server analyzes the received data, using machine learning algorithms and data mining techniques to identify user behavioral patterns and preferences, such as the frequency of places visited in the past and the content posted on social media.

[1690] Step 6:

[1691] Creating a private schedule

[1692] The server generates an optimal private schedule for the user based on the analysis results. For example, if the server determines that the user likes to go cafe hopping on weekends, it will suggest a plan to visit a new cafe the following weekend.

[1693] Step 7:

[1694] Plan Notification

[1695] The server sends the generated schedule plan to the device. This notification includes specific plan details (visit locations, times, and necessary reservation information). Notifications are sent via push notifications or in-app notifications.

[1696] Step 8:

[1697] Plan Approval / Cancellation

[1698] The user checks the notification and approves or cancels the plan. If they approve, they press the "Approve" button on their device. The device then sends the approval information to the server.

[1699] Step 9:

[1700] Automatic booking

[1701] The server receives the plan approval information from the user and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event using a reservation API.

[1702] Step 10:

[1703] Calendar updates

[1704] The server notifies the device that the reservation has been confirmed, and the device adds the received reservation information to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule on the calendar.

[1705] Step 11:

[1706] Manage your booking

[1707] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. This information is also notified to the device, and the relevant event is deleted from the calendar. This prevents unnecessary reservations from remaining.

[1708] For example, if a user approves a plan to visit a new cafe on Sunday, the server will make a reservation for that cafe on Friday and update the calendar, allowing the user to enjoy fulfilling leisure activities based on their preferences.

[1709] Example 1

[1710] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1711] In modern society, efficiently managing and maximizing users' private time is an important issue. However, conventional methods require users to plan their own schedules and make reservations, which is time-consuming and laborious. It is also difficult to generate schedules that reflect users' preferences and behavioral patterns, making it difficult to create effective plans. Furthermore, because reservation approvals and cancellations are managed manually, there is a high risk of errors or omissions.

[1712] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1713] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to social media services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for executing necessary automatic reservations upon receiving approval from the user, means for reflecting the executed reservation details in the user's calendar, means for automatically canceling the reservation if the user does not approve by a specified cancellation deadline, and means for rescheduling based on the executed reservation details. This allows the user to receive suggestions for an optimal private schedule based on their preferences and behavioral patterns, and automates schedule planning, reservation procedures, and approval / cancellation management, reducing effort and time.

[1714] "Location information" is geographic data about where a user is currently located or where a user has previously visited.

[1715] A "social media service" is an online platform where users can post photos, comments, etc. and interact with other users.

[1716] "Posting history" refers to the history of content that a user has posted in the past on social media services.

[1717] "Calendar information" refers to digital calendar data that records a user's schedule and appointments.

[1718] "Information processing devices" are electronic devices such as smartphones, tablets, and computers that users use on a daily basis.

[1719] "Data Analysis" means the technical means of processing collected data to identify user behavior patterns and preferences.

[1720] A "private schedule" is a schedule or plan created to efficiently manage a user's personal time.

[1721] "Notification" refers to a message or alert that notifies the user of the contents of the generated private schedule.

[1722] "Automatic reservation" is a process in which the system automatically completes the reservation procedure based on the user's approval.

[1723] "Cancellation Deadline" means the final date and time by which a User can confirm or cancel a booking.

[1724] "Rescheduling" is the process of generating a new schedule when changes occur to an existing schedule.

[1725] MODE FOR CARRYING OUT THE INVENTION

[1726] overview

[1727] This invention is a system that collects and analyzes location information, social media posting history, and calendar information from information processing devices with the aim of optimizing users' private time. Based on the analysis results, a private schedule suited to the user is generated and notified to the user's information processing device. If the user approves, an automatic reservation is made and the contents are reflected in the calendar. This system operates mainly through interactions between the server, terminal, and user.

[1728] Data Collection and Transmission

[1729] The device collects the user's location information in real time using a GPS sensor. In addition, the device obtains the user's social media posting history via API and collects schedule information via the calendar application's API. The collected data is sent to the server using a secure communication protocol (e.g., HTTPS).

[1730] Data analysis and plan generation

[1731] The server uses an AI engine to analyze the received location information, social media posting history, and calendar information. Using machine learning algorithms, it performs clustering and classification based on the user's past behavioral data to identify the user's behavioral patterns and preferences. For example, it analyzes the cafes the user frequently visits on weekends and their hobby activities, and generates an optimal private schedule based on that information.

[1732] Plan Notification and Approval

[1733] The generated plan is sent from the server to the device. This notification includes specific visit locations, times, and necessary reservation information, and is sent to the user via push notification or in-app notification. The user can review the notification and choose to approve or cancel the plan. If approved, the information is sent from the device to the server.

[1734] Making and managing reservations

[1735] After receiving the user's authorization information, the server automatically executes the online reservation via the appropriate reservation API, such as making a restaurant reservation or purchasing an event ticket. Once the reservation is completed, the reservation information is sent to the device to be reflected in the user's calendar, and the device adds the information to the calendar application.

[1736] If the user does not approve the plan by the specified cancellation deadline, the reservation will be automatically canceled, which prevents unnecessary reservations from remaining.

[1737] Specific examples

[1738] 1. The device collects the location information of the cafes the user visited over the weekend and the photos of their "cafe tour" posted on social media, and sends these to the server.

[1739] 2. The server's AI engine analyzes that the user likes to visit cafes on weekends and generates a plan to visit newly opened cafes for the following weekend.

[1740] 3. The server notifies the user of this visit plan on Friday, and the user confirms the notification and approves the plan.

[1741] 4. The server automatically makes a reservation at the cafe based on the approved plan and updates the reservation details on the user's calendar.

[1742] Prompt Sentence Examples

[1743] "Can you recommend any new cafes for my weekend cafe crawl?"

[1744] "Please suggest the best leisure plan based on next week's schedule."

[1745] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1746] Step 1:

[1747] Location information collection

[1748] Input: The device uses the GPS sensor to obtain the user's location.

[1749] What it does: The device collects GPS data in real time at specific intervals and records the history of the places the user has visited.

[1750] Output: Generates the collected location data.

[1751] Step 2:

[1752] Acquiring SNS posting history

[1753] Input: The device accesses the API of the social media platform the user uses.

[1754] Specific operation: The device calls the API of each SNS and obtains the user's posting history data, for example, to obtain recently posted photos and comments about a cafe.

[1755] Output: The retrieved social media posting history data is generated.

[1756] Step 3:

[1757] Get calendar information

[1758] Input: The device accesses the API of the user's calendar application.

[1759] Specific operation: The device obtains the user's schedule data through the calendar API, such as upcoming events and reservation information.

[1760] Output: The retrieved calendar schedule data is generated.

[1761] Step 4:

[1762] Sending data

[1763] Input: The device sends the collected location information, social media posting history, and calendar schedule data to the server.

[1764] What it does: The device uses HTTPS to securely send collected data to the server.

[1765] Output: The data received by the server is generated.

[1766] Step 5:

[1767] Data analysis

[1768] Input: The server analyzes the received location data, social media posting history data, and calendar schedule data.

[1769] What it does: The server's AI engine uses machine learning algorithms to identify user behavioral patterns and preferences, such as how often a user visits a cafe on the weekend and the activities they are interested in.

[1770] Output: Generates analytical results about user behavior patterns and preferences.

[1771] Step 6:

[1772] Generate a plan

[1773] Input: The server generates an optimal private schedule for the user based on the analysis results.

[1774] Specific operation: The server uses the analysis results to create a schedule that combines appropriate places to visit and activities for the user. For example, it generates a plan to visit a newly opened cafe.

[1775] Output: The generated private schedule is generated.

[1776] Step 7:

[1777] Plan Notification

[1778] Input: The server sends the generated private schedule to the terminal.

[1779] What happens: The server notifies the user of the schedule details via push notification or in-app notification.

[1780] Output: A notification is generated that allows the user to review the plan details.

[1781] Step 8:

[1782] View Plans

[1783] Input: The device displays the received plan to the user.

[1784] Specific behavior: The device will notify the user of the plan details (location, time, reservation information, etc.).

[1785] Output: User-visible plan details are generated.

[1786] Step 9:

[1787] Accept or Cancel

[1788] Input: The user reviews the notified plan and accepts or cancels it.

[1789] Specific action: The user taps the button to accept or cancel the plan via the device.

[1790] Output: Approval or cancellation information is generated.

[1791] Step 10:

[1792] Sending approval information

[1793] Input: The device sends the user's authorization information to the server.

[1794] Specific operation: The device sends authorization information to the server using HTTPS communication.

[1795] Output: The authorization information received by the server is generated.

[1796] Step 11:

[1797] Automatic booking execution

[1798] Input: The server performs automatic booking based on the received authorization information.

[1799] Specific operation: The server automatically makes reservations, for example at a cafe, via a corresponding reservation API.

[1800] Output: Information that the reservation is completed is generated.

[1801] Step 12:

[1802] Reflection on the calendar

[1803] Input: The server sends the completed reservation information to the terminal.

[1804] What happens: The server sends the reservation details to the user's device, and the device adds the information to its calendar application.

[1805] Output: The booking information is generated and reflected in the user's calendar.

[1806] Step 13:

[1807] Automatic cancellation processing

[1808] Input: If the user does not accept the plan by the specified cancellation deadline.

[1809] What happens: The server automatically cancels any pending reservations.

[1810] Output: Cancelled reservation information is generated.

[1811] In this way, the system of the present invention enables efficient schedule management and automatic reservations to make the most of the user's private time.

[1812] (Application example 1)

[1813] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1814] In modern factories and other workplaces, maximizing worker efficiency and performing tasks efficiently is crucial. However, there is a lack of systems that provide workers with real-time information such as which equipment should be maintained next and which route is the shortest. In such situations, workers have to spend time and effort manually creating work plans, resulting in reduced efficiency. Furthermore, if workers cannot quickly obtain the tools and manuals they need, work delays and errors are more likely to occur.

[1815] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1816] In this invention, the server includes means for collecting location information from the user's information processing device, means for collecting the user's posting history to online services, means for collecting the user's calendar information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns, means for notifying the user's information processing device of the generated private schedule, means for automatically executing necessary online reservations upon receiving the user's approval, means for reflecting the executed reservation details in the user's calendar, means for presenting an optimal work schedule to the user in real time using smart glasses, means for collecting and analyzing the user's location information and work logs, and means for providing information for maximizing the user's work efficiency based on the analysis results. This makes it possible to provide optimal work schedules and necessary information to workers in work sites such as factories in real time, thereby maximizing work efficiency.

[1817] "Information processing device" refers to all electronic devices that have the function of collecting, analyzing, and displaying data.

[1818] "Location Information" refers to information collected using GPS or other geographic information systems to provide coordinate data for a specific location.

[1819] "Online Services" refers to social networking services and other digital services provided via the Internet.

[1820] "Posting history" refers to a record of past content and comments posted by a user to an online service.

[1821] "Calendar Information" refers to data stored in a calendar or schedule management application that contains a user's appointments and schedules.

[1822] "Preferences" refer to specific interests or tendencies that a user exhibits through their past behavior and posts.

[1823] "Behavioral patterns" refer to the tendencies of users, such as the actions they have taken regularly in the past and the places they have visited.

[1824] "Private Schedule" refers to a calendar or plan generated to optimize a user's personal time.

[1825] "Smart glasses" are a type of wearable device that has the shape of glasses and is equipped with a display function to display information.

[1826] "Work log" refers to the records and log data of work performed by a user.

[1827] "Real-time" refers to data collection, analysis, and display occurring immediately, without delay.

[1828] "Work efficiency" refers to minimizing the effort and time required to perform a task and maximizing the results.

[1829] The system for implementing this invention includes smart glasses worn by the user, a server for processing data, and a communication means for exchanging data between them. Software for collecting and analyzing user location information, posting history on online services, schedule information, etc. also plays an important role.

[1830] The server uses the following hardware and software:

[1831] Hardware: Server platform (e.g., Amazon Web Services (AWS), Microsoft Azure)

[1832] Software: Machine learning algorithms for data analysis (e.g., Scikit-learn, TensorFlow)

[1833] The smart glasses that serve as the terminals use the following hardware and software.

[1834] Hardware: Smart glasses (e.g., Microsoft HoloLens, Google Glass)

[1835] Software: Location information collection application, application that configures the user interface

[1836] First, the smart glasses, which are the device, collect the user's location information in real time. This location information is obtained using the GPS sensor built into the smart glasses. Work logs are also recorded and saved on the device.

[1837] Next, the device transmits the collected location information and work log data to a server via a secure communication protocol (e.g., HTTPS).

[1838] The server analyzes the received data using machine learning algorithms to identify the user's behavioral patterns and preferences, and generates a personal and work schedule tailored to the user based on the analysis results.

[1839] The generated schedule is sent in real time from the server to the device, which then displays the schedule to the user on the smart glasses, providing information such as the next best maintenance task, its location, the best route, and any necessary tools and manuals.

[1840] Once the user checks and approves the presented schedule, the server automatically makes the necessary online reservations (e.g., equipment maintenance reservations, parts orders, etc.) and reflects the reservation details in the user's calendar.

[1841] As a specific example, a factory worker wears smart glasses to perform his next maintenance task. The smart glasses identify the worker's current location and provide an optimal work schedule and route in real time. The worker can also quickly obtain the necessary tools and manuals based on the information displayed on the smart glasses, without having to search for them.

[1842] An example of a prompt to be input to a generative AI model is as follows:

[1843] User ID: user123

[1844] Location information: GPS data

[1845] Work Log: Work Log Data

[1846] Calendar Schedule: Calendar schedule data

[1847] Analyze this data and suggest the best next maintenance tasks and locations.

[1848] In this way, the present invention can maximize the user's work efficiency and realize efficient and stress-free work at work sites such as factories.

[1849] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1850] Step 1:

[1851] The device (smart glasses) collects the user's location information and work log. Location information is obtained using a built-in GPS sensor, and the work log records the user's operations and work content. The collected data is temporarily stored in the device.

[1852] Input: Location information from the GPS sensor, user operation log data

[1853] Output: Temporarily saved location information and work log

[1854] Step 2:

[1855] The device sends the collected location information and work logs to the server via a secure communication protocol (e.g., HTTPS). The data is encrypted and transmitted securely.

[1856] Input: Temporarily saved location information and work log

[1857] Output: Location information and work log data sent to the server

[1858] Step 3:

[1859] The server uses machine learning algorithms to analyze the received data, including clustering and classification based on past behavioral patterns and preferences, to identify the user's next actions and required tasks.

[1860] Input: Location information and work log sent from the device

[1861] Output: Analysis results that identify user behavior patterns and preferences

[1862] Step 4:

[1863] Based on the identified behavioral patterns and preferences, the server generates a personalized personal and work schedule for the user, including information on upcoming maintenance tasks, routes, and required tools and manuals.

[1864] Input: Identified behavioral patterns and preferences

[1865] Output: Generated private schedule and work schedule

[1866] Step 5:

[1867] The server sends the generated schedule to the device in real time, and the device (smart glasses) presents the received schedule to the user, displaying information such as the next task to be performed, the route to be taken, and the tools to be used.

[1868] Input: Generated private schedule and work schedule

[1869] Output: Schedule sent to the device

[1870] Step 6:

[1871] The user can check the schedule displayed on the smart glasses and approve or cancel it. If approved, the information is sent from the device to the server.

[1872] Input: The schedule presented to the user

[1873] Output: User authorization information

[1874] Step 7:

[1875] The server receives approval information from the user and automatically executes the necessary online reservations, such as booking equipment maintenance or ordering parts, via the reservation API.

[1876] Input: User authorization information

[1877] Output: Details of the executed net reservation

[1878] Step 8:

[1879] The server sends information to the device to reflect the executed reservation details in the user's calendar. The device adds a new appointment to the user's calendar app based on the received reservation information.

[1880] Input: Details of the online reservation

[1881] Output: Reservation details reflected in the user's calendar

[1882] Through the above processing steps, a system is realized that maximizes the user's work efficiency and allows for efficient and stress-free work.

[1883] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1884] MODE FOR CARRYING OUT THE INVENTION

[1885] overview

[1886] This invention is a system that collects and analyzes smart device location information, social networking service (SNS) posting history, and calendar schedule information in order to optimize a user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's smart device, and if approved, online reservations are automatically made and schedule management is performed.

[1887] Program processing

[1888] 1. Data Collection

[1889] Terminal

[1890] The device uses a GPS sensor to receive the user's location information in real time. The collected location information, including time information, is sent to a server. The device also periodically retrieves the user's posting history using the API of the social media platform. It also collects schedule information via the API of the user's calendar application. All of this information is sent to the server.

[1891] Device -> Server

[1892] The device periodically uploads collected location information, social media posting history, and calendar schedule information to a server. Data is transmitted securely using a secure communication protocol (e.g., HTTPS).

[1893] 2. Data Analysis and Emotion Recognition

[1894] server

[1895] The server analyzes the collected data to identify user patterns and preferences, using machine learning algorithms to cluster users' past behavioral data and identify activities of interest and frequently visited locations.

[1896] Furthermore, the emotion engine analyzes the user's voice data, facial expression data, and social media posts to recognize their current emotional state. For example, it can recognize positive emotions (joy, excitement) and negative emotions (stress, anxiety) from the user's tone of voice and social media posts.

[1897] 3. Create a private schedule

[1898] server

[1899] The server generates a personalized schedule based on the results of behavioral pattern analysis and emotion recognition. For example, if the server detects that the user is feeling stressed, it will suggest activities that will have a relaxing effect (such as relaxing at a spa or cafe). If the user is feeling very happy, it will suggest gathering with friends or participating in fun events to share the excitement.

[1900] 4. Plan Notification and Approval

[1901] Server -> Device

[1902] The server notifies the device of the generated private schedule, which includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel the plan.

[1903] Terminal

[1904] The device will display plan notifications in a user-friendly format, using push notifications and in-app notifications to inform users of plan details.

[1905] user

[1906] The user checks the notification and either accepts or cancels the plan. If the plan is accepted, the device sends the information to the server.

[1907] 5. Automatic booking and calendar updates

[1908] server

[1909] After receiving the user's authorization information, the server automatically makes the necessary online reservations, such as using a reservation API to reserve a restaurant or event ticket.

[1910] Once the reservation is complete, the reservation information is sent to the device, and if the user does not approve the plan by the specified cancellation deadline, the reservation is automatically canceled.

[1911] Terminal

[1912] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[1913] Specific examples

[1914] 1. Data Collection

[1915] The device collects location information of cafes visited by users on Sundays, as well as photos and comments posted to social media about cafes, and sends them to the server. It also obtains the user's free time slots for the next week as part of their calendar information.

[1916] 2. Data Analysis and Emotion Recognition

[1917] The server analyzes that the user likes to go to cafes, and at the same time recognizes from social media posts that the user has been feeling stressed recently.

[1918] 3. Create a private schedule

[1919] The server generates plans for visiting new cafes for a relaxing weekend getaway, and even suggests making reservations at the cafe, reducing the stress of securing a reservation.

[1920] 4. Plan Notification and Approval

[1921] The server will send the generated plan to the user's device on Friday, where the user can review the plan and press the approve button.

[1922] 5. Automatic booking and calendar updates

[1923] The server makes a reservation for the cafe based on the approved plan and sends the reservation information to the device, which then adds a new event to its calendar.

[1924] In this way, the system can optimize users' private time and provide enriching leisure activities that correspond to their emotional state.

[1925] The processing flow will be explained below.

[1926] Step 1:

[1927] Data Collection - Location Information

[1928] The device uses a GPS sensor to obtain the user's location information in real time. The device collects the user's current location information at a specified interval (e.g., every 10 minutes) and records it along with the time information. The collected location information is temporarily stored on the device.

[1929] Step 2:

[1930] Data Collection - Social Media Post History

[1931] The device uses the API of social media platforms (e.g., Facebook, Instagram, Twitter) to obtain the user's posting history. It periodically (e.g., once a day) collects social media posting data (text, images, and posting date and time), and also collects information to understand the user's emotions from acceptable social media posts.

[1932] Step 3:

[1933] Data Collection - Calendar Schedule

[1934] The device retrieves schedule information using the API of the user's calendar application (e.g., Google Calendar). The collected schedule information includes the title, date, time, location, and details of the schedule. This information is used to adjust the current schedule and the proposed new plan.

[1935] Step 4:

[1936] Data transmission

[1937] The device sends the collected location information, SNS posting history, and calendar schedule information to a server. The data is uploaded to the server at a fixed time every day (e.g., 1:00 AM) using a secure communication protocol (e.g., HTTPS).

[1938] Step 5:

[1939] Data analysis

[1940] The server analyzes the received data and uses machine learning algorithms and data mining techniques to identify user behavior patterns and preferences. For example, it analyzes the frequency with which users visit cafes on weekends and the patterns of the places they visit to understand their interests.

[1941] Step 6:

[1942] emotion recognition

[1943] The server recognizes the user's emotions using an emotion engine. It analyzes voice data, facial expression data, and SNS posts to determine the user's current emotional state (e.g., positive, negative). The emotion engine generates data that reflects the user's psychological state.

[1944] Step 7:

[1945] Creating a private schedule

[1946] The server generates a personalized schedule based on the results of data analysis and emotion recognition. For example, if the server determines that the user is feeling stressed, it will suggest a plan for effective relaxation (e.g., relaxing at a spa or cafe).

[1947] Step 8:

[1948] Plan Notification

[1949] The server notifies the device of the created private schedule. This notification includes specific plan details (visit locations, times, necessary reservation information) and the option to approve or cancel. Notifications are sent via push notifications or in-app notifications.

[1950] Step 9:

[1951] Plan Approval / Cancellation

[1952] The user checks the plan notification received on the device and approves or cancels the plan. If approving, the user presses the "Approve" button. The device then sends this approval information to the server. Similarly, if the plan is canceled, the device also sends cancellation information to the server.

[1953] Step 10:

[1954] Automatic booking

[1955] The server receives the user's authorization information and automatically makes the necessary online reservations, such as reserving a table at a restaurant or purchasing tickets for an event, using a reservation API. Once the reservation is complete, the information is sent to the device.

[1956] Step 11:

[1957] Calendar updates

[1958] The device adds the reservation information received from the server to the calendar app and updates the user's schedule, allowing the user to always check the latest schedule.

[1959] Step 12:

[1960] Manage your booking

[1961] If the user does not approve the plan by the specified cancellation deadline, the server will automatically cancel the reservation. The cancellation information will also be notified to the device, and the corresponding schedule will be deleted from the user's calendar. This prevents unnecessary reservations from remaining.

[1962] To give a concrete example, suppose a user visits a cafe on Sunday and posts on social media that they have been feeling stressed lately. The device then sends this information along with their location and calendar schedule to the server. The server recognizes that the user is feeling stressed and generates a plan suggesting a relaxing time at a cafe for the following weekend. The generated plan is notified to the device on Friday, and if the user approves, the server automatically makes a reservation at the cafe and updates the calendar with the reservation information.

[1963] Example 2

[1964] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1965] In modern society, users lead busy lives and are expected to make efficient and optimal use of their private time. However, current schedule management systems do not take into account the user's emotional state and are unable to suggest appropriate leisure activities based on their emotions and stress levels, which prevents them from fully increasing user satisfaction. In addition, booking procedures and schedule updates are often done manually, which places a burden on users.

[1966] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1967] In this invention, the server includes means for collecting location information from the user's mobile device, means for collecting the user's posting history to social networking services, means for collecting the user's schedule information, means for analyzing the collected data and identifying the user's preferences and behavioral patterns, means for evaluating the user's emotional state, means for generating a private schedule suitable for the user based on the identified preferences, behavioral patterns, and emotional state, means for notifying the user's mobile device of the generated private schedule, means for automatically making necessary online reservations upon receiving approval from the user, and means for reflecting the contents of the made reservations in the user's schedule. This makes it possible to suggest optimal leisure activities according to the user's emotional state and automatically adjust and update the schedule.

[1968] "User" refers to an individual who uses this system.

[1969] "Mobile device" refers to a portable device owned by a user, such as a smartphone or tablet.

[1970] "Location information" refers to the latitude and longitude data of the user's current location obtained using a GPS sensor or other device.

[1971] "Social Networking Service (SNS)" refers to an online platform where users can post and share their information.

[1972] "Posting history" refers to data such as text, images, and videos that a user has posted in the past on social media.

[1973] "Schedule information" refers to calendar information that records the user's plans and events.

[1974] "Collected data" refers to all location information, social media posting history, and schedule information collected from mobile devices.

[1975] "Analysis" refers to the processing of collected data to identify user behavioral patterns, preferences, and emotional states.

[1976] "Behavioral patterns" refer to the tendencies and patterns of behavior that a user has exhibited in the past.

[1977] "Preferences" refers to a user's hobbies and tendencies identified from analyzed data.

[1978] "Emotional state" refers to the user's current emotional state (e.g., joy, sadness, stress).

[1979] "Private schedule" refers to individual plans and events generated based on the user's emotional state and behavioral patterns.

[1980] "Notification" refers to an alert or message sent to a user's mobile device to notify them of the generated private schedule.

[1981] "Approval" refers to the act of a user reviewing and agreeing to a proposed private schedule.

[1982] "Online reservations" refers to reservation procedures made via web services (e.g., making restaurant reservations or purchasing event tickets).

[1983] "Reflecting on schedule" refers to adding or updating the reservation details that have been approved by the user to the schedule information.

[1984] "Cancellation Deadline" means the deadline by which you must accept the Plan in order to keep your Reservation.

[1985] "Rescheduling" refers to rearranging a schedule in the event of an unexpected change or cancellation.

[1986] MODE FOR CARRYING OUT THE INVENTION

[1987] overview

[1988] This invention is a system that collects and analyzes location information, social networking service (SNS) posting history, schedule information, and other information from a user's mobile device in order to optimize the user's private time. Furthermore, by combining it with an emotion engine that recognizes the user's emotional state, it is possible to propose a private schedule based on the user's emotional state. The schedule generated based on the analysis results is notified to the user's mobile device, and if approved, online reservations are automatically made and schedule management is performed.

[1989] System Configuration and Operation

[1990] 1. Hardware and Software Overview

[1991] The system consists of the following main components:

[1992] Mobile device: Equipped with a GPS sensor, internet connection function, SNS application, and calendar application.

[1993] Server: Has high-performance computing resources to run data analysis, machine learning algorithms, and emotion recognition engines.

[1994] Data collection software: Includes APIs for collecting location information, social media posting history, and schedule information.

[1995] Data analysis software: Machine learning algorithms for behavioral pattern analysis and emotion recognition.

[1996] Data collection

[1997] Mobile devices

[1998] The mobile device uses a GPS sensor to collect the user's location information in real time. For example, when a user visits a cafe, the latitude and longitude of the location and the time of the visit are obtained and sent to the server. The API of the social networking platform is used to periodically obtain the user's posting history (text, images, videos). The Google Calendar API is also used to obtain the user's schedule information. All of this data is sent to the server in a secure manner.

[1999] Data analysis and emotion recognition

[2000] server

[2001] The server uses the received location information to analyze the places the user has visited and their behavioral patterns. For example, clustering is performed based on the frequency of cafe visits and length of stay to identify the user's behavioral patterns. The SNS post data is analyzed using natural language processing (NLP) algorithms to extract keywords and perform sentiment analysis. The emotion engine recognizes the user's current emotional state based on voice data, facial expression data, and SNS post data. For example, if the keyword "tired" appears frequently, it is determined that the user is in a state of stress.

[2002] Creating a private schedule

[2003] server

[2004] Based on the analyzed data, the system generates a private schedule that is optimal for the user. For example, if the system determines that the user is feeling stressed, it will suggest activities that will help relieve stress (such as a massage or relaxing at a cafe). The proposed plan is automatically adjusted to avoid overlapping with existing schedules.

[2005] Plan Notification and Approval

[2006] Server -> Mobile device

[2007] The generated private schedule is sent from the server to the mobile device via push notification or in-app notification, and includes specific plan details (places to visit, times, and necessary reservation information).

[2008] user

[2009] The user can then review the notification and accept or cancel the proposed plan. If acceptance is made, the mobile device sends the information to the server.

[2010] Automatic booking and schedule updates

[2011] server

[2012] The server receives the user's approval information and automatically makes the online reservation. For example, a restaurant reservation API is used to make a reservation for a specified date and time. If the reservation is successful, detailed information (reservation number, date and time, location, etc.) is sent to the mobile device. If approval is not received by the specified cancellation deadline, the reservation is automatically canceled.

[2013] Mobile devices

[2014] The mobile device adds the reservation information received from the server to the user's calendar app, making it easier for the user to check the latest schedule.

[2015] Specific examples

[2016] Data collection

[2017] The mobile device collects the location information of the cafe the user visited on Sunday, as well as photos and comments of the cafe posted on social media, and sends them to the server. The Google Calendar API is used to obtain available times for the next week.

[2018] Data analysis and emotion recognition

[2019] The server analyzes the user's preference for cafe hopping and determines from social media posts that the user has been feeling stressed recently. For example, if a user's posts frequently contain keywords such as "tired" and "stressed," the server determines that the user is under stress.

[2020] Creating a private schedule

[2021] The server generates a plan to visit a new cafe for relaxation next weekend, using the cafe's reservation API to reserve some time to relax.

[2022] Plan Notification and Approval

[2023] The server will notify the user of the generated plan on Friday. A push notification will be displayed and the details of the plan can be viewed in the app. The user will review the plan and press the "Approve" button.

[2024] Automatic booking and schedule updates

[2025] The server makes a reservation based on the approved plan and sends the reservation information to the mobile device. The mobile device then uses the Google Calendar API to add the reservation information to the calendar and update the user's schedule.

[2026] Example prompts (input to generative AI models)

[2027] Please tell me how to collect the location information of the cafe you visited on Sunday, as well as the photos and comments of the cafe you posted on social media.

[2028] How do you analyze social media posts to see if a user is experiencing stress?

[2029] I would like to know the specific algorithm that suggests new cafes for users to relax in.

[2030] This allows the system to optimally manage the user's private time and provide fulfilling leisure activities according to their emotional state.

[2031] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2032] Step 1: Data collection

[2033] The device collects the user's location information in real time and periodically obtains SNS posting history and schedule information. The input is current location information from the GPS sensor, user posting data from the SNS API, and schedule data from the calendar API. The output is a set of these data, which is sent to the server using secure communication (e.g., HTTPS). Specifically, the device polls the GPS sensor, SNS, and calendar API every hour, obtains the data, and then uploads it to the server.

[2034] Step 2: Save data

[2035] The server temporarily stores the received location information, SNS posting history, and schedule information in a database. The input is the various data sent from the device. The output is the state saved in the database. The specific operation is to accurately store the received data in the corresponding table in the database.

[2036] Step 3: Data analysis and emotion recognition

[2037] The server analyzes the stored data to identify the user's behavioral patterns and preferences. The input is location information, SNS posting history, and schedule information obtained from the database. The output is a report on the user's behavioral patterns and preferences. A machine learning algorithm is used for the analysis, performing clustering and frequency analysis. For example, it can identify the locations and times of day that a user frequently visits. The emotion engine analyzes SNS posting data, voice data, and facial expression data to recognize the user's emotional state. Specifically, it uses an NLP algorithm to analyze SNS text and calculate an emotion score.

[2038] Step 4: Create a private schedule

[2039] The server generates an optimal private schedule for the user based on the results of behavioral pattern analysis and emotion recognition. The input is the behavioral pattern and emotional state report created in the previous step. The output is a specific schedule proposed to the user. The specific operation is to automatically generate a relaxation and entertainment plan based on the user's free time and preferences. For example, if the user is feeling tired, it will suggest making a reservation at a nearby spa.

[2040] Step 5: Plan Notification

[2041] The server notifies the user's device of the generated private schedule. The input is the generated schedule. The output is the notification sent to the device. The specific operation is to send the user detailed plan contents (visit locations, times, and necessary reservation information) via push notification or email.

[2042] Step 6: Plan Approval

[2043] The user checks the received notification and approves or cancels the proposed plan. The input is the plan notification sent from the server. The output is the user's intention to approve or cancel. The specific action is to press the "Approve" or "Cancel" button on the terminal.

[2044] Step 7: Automated booking

[2045] The server receives approval information from the user and automatically executes the necessary online reservation. The input is the user's approval information. The output is the completed reservation information. The specific operation is to make a reservation at the specified time using the restaurant or spa reservation API. Once the reservation is completed, the reservation information is sent to the user's device.

[2046] Step 8: Update the schedule

[2047] The device adds the reservation information received from the server to the user's calendar app. The input is the completed reservation information. The output is the updated schedule. The specific operation is to use the Google Calendar API to add new events to the calendar and keep the user's schedule up to date.

[2048] (Application example 2)

[2049] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2050] In today's busy lifestyles, it is difficult for users to make optimal use of their private time and fully relax and enjoy themselves. It is also difficult to suggest necessary products at the appropriate time while taking into account the user's emotional state. Furthermore, there is no system that automatically integrates this information to create an optimal private schedule and recommend products. Therefore, there is a need for a system that analyzes a user's location information, social media posting history, calendar schedule information, and emotional state, and generates and notifies the user of an optimal private schedule while also suggesting appropriate products.

[2051] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2052] In this invention, the server includes: means for collecting location information from the user's smart device; means for collecting the user's posting history to social networking services; means for collecting the user's calendar schedule information; means for analyzing the collected data and identifying the user's preferences and behavioral patterns; means for generating a private schedule suitable for the user based on the identified preferences and behavioral patterns; means for notifying the user's smart device of the generated private schedule; an emotion engine including an emotion engine that recognizes the user's emotional state and adjusting the private schedule based on the emotional state; means for automatically making necessary online reservations upon receiving approval from the user; means for updating the executed reservation details on the user's calendar; and means for providing product purchase links including a recommendation engine that suggests optimal products based on the user's emotional state and schedule. This allows the user to secure optimal private time according to their emotional state and purchase products that suit their preferences at the appropriate time.

[2053] "User's smart device" refers to a communication device that collects or transmits the user's personal information, including GPS sensors, social networking applications, and calendar applications.

[2054] "Location information" is data indicating the user's current location obtained using a GPS sensor or other device.

[2055] A "social networking service" is an online platform that enables users to share information and feelings with other people.

[2056] "Posting history" is a record of messages, images, etc. that a user has posted on a social networking service.

[2057] "Calendar schedule information" is data that records the date, time, and content of a user's plans and events.

[2058] The "means of analyzing data" refers to a system that includes algorithms that analyze user behavior patterns and preferences based on collected location information, posting history, and calendar schedule information.

[2059] A "Private Schedule" is a list of appointments tailored to optimize a user's personal time.

[2060] The "emotion engine" is a technology that has the ability to analyze a user's emotional state based on their posts, behavior, voice, etc.

[2061] "Online reservation" refers to the entire reservation process carried out using an online system.

[2062] A "recommendation engine" is an algorithm that suggests individually optimal products and services based on a user's behavior and emotions.

[2063] "Purchase Link" means a web link that allows users to easily purchase the suggested product.

[2064] This invention is a system that optimizes a user's private time and suggests appropriate products based on their emotional state and behavioral patterns. This system is mainly composed of three elements: a server, a terminal, and the user.

[2065] server

[2066] Hardware and Software

[2067] The server has high-performance computing resources and is responsible for data analysis and emotion recognition. Specifically, it uses the following hardware and software:

[2068] Hardware:

[2069] A server with a fast processor and sufficient memory

[2070] software:

[2071] Machine learning libraries (e.g., scikit-learn)

[2072] Emotion recognition engine (e.g., EmotionEngine)

[2073] Database management system (e.g. MySQL)

[2074] Processing content

[2075] The server operates as follows:

[2076] 1. Data collection: The server receives location information, social media posting history, and calendar schedule information collected from the user's device and stores it in a database.

[2077] 2. Emotion recognition: Analyzes social media posts and user voice data to identify emotional states.

[2078] 3. Data analysis: Analyze the collected data to identify user behavior patterns and preferences using machine learning algorithms (e.g., KMeans clustering).

[2079] 4. Generating a private schedule: Based on the analysis results and emotion recognition results, a private schedule optimal for the user is generated. ...

Claims

1. a means of collecting location information from a user's smart device; A means for collecting a user's posting history to a social networking service; a means for collecting user calendar schedule information; The means by which collected data is analysed to identify user preferences and patterns of behaviour; A means for generating a private schedule suited to the user based on the identified preferences and behavioral patterns; a means for notifying the user of the generated private schedule on the user's smart device; A means to automatically execute the necessary online reservations upon receiving approval from the user, and The system includes a means for updating the user's calendar with the completed reservation.

2. 2. The system according to claim 1, further comprising means for automatically cancelling an online reservation if the user does not approve the reservation by a designated cancellation deadline.

3. 2. The system of claim 1, further comprising means for rescheduling based on appointments reflected in the user's calendar.

Images