system

Abstract

We provide a system that can centrally manage everything from schedule adjustments to reporting. [Solution] A system including: means for acquiring calendar information of a manager and listing available time slots; means for providing an interface for the user to input their desired date and time; means for comparing the user's desired date and time with the manager's available time to match the most suitable candidate date and time; means for displaying the candidate dates and times to the user; means for confirming the date and time selected by the user and reflecting it on the calendar; means for centrally managing contact information of the person to be coordinated in a database and automatically selecting the most suitable means of communication; means for contacting the person to be coordinated using the most suitable means of communication, confirming the schedule and obtaining a reply; means for notifying the user of valid replies; means for automatically generating a report after the meeting or visit is completed; means for automatically distributing the report to relevant parties; and means for saving the generated report in a database.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Coordinating schedules in business is fraught with difficulties, particularly with those in senior positions, which takes a great deal of time and effort. Furthermore, with so many people to coordinate with and various means of communication, efficient coordination is difficult. In addition, the internal post-coordination process is complicated, and creating reports and notifying relevant parties is time-consuming. To solve these problems, a system that can centrally manage everything from schedule coordination to reporting is needed. [Means for solving the problem]

[0005] The present invention is a system that includes a means for acquiring calendar information of a manager and listing available time slots, a means for providing an interface for the user to input a desired date and time, a means for matching the user's desired date and time with the manager's available time to find the most suitable candidate date and time, a means for displaying the candidate date and time to the user, and a means for confirming the date and time selected by the user and reflecting it in the calendar. Additionally, the system solves the above problems by providing a means for centrally managing contact information of the person in charge of coordination in a database, automatically selecting the most suitable means of communication, a means for contacting the person in charge of coordination using the most suitable means of communication, confirming the schedule and obtaining a reply, a means for notifying the user of the received reply, a means for automatically generating a report after the meeting or visit, a means for automatically distributing the report to the relevant parties, and a means for saving the generated report in a database.

[0006] "Calendar information" refers to data regarding the schedules and free time of officials and users.

[0007] "Available time slots" refer to times when no appointments are already scheduled according to the calendar information.

[0008] "Interface" refers to the operating screen that allows users to input data into the system and obtain information from the system.

[0009] "Matching" refers to the process of identifying the most suitable date and time by comparing the user's desired date and time with the availability of the person in charge.

[0010] A "database" refers to a system that centrally manages and stores a large amount of data, making it easy to search and retrieve.

[0011] "Contact methods" refers to communication methods such as email, telephone, messaging services, etc.

[0012] A "report" refers to a document that records the contents of a meeting or visit and is shared with relevant parties.

[0013] "Feedback" refers to the process of providing evaluation and feedback on a meeting or visit.

[0014] "Server" refers to the back-end system that stores and processes data.

[0015] "Terminal" refers to the front-end computer or mobile device operated by the user. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] This invention relates to a system that handles everything from scheduling with managers to post-processing within the company. The system is composed of a server, terminals, and users.

[0038] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0039] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[0040] Next, the user selects an appropriate date and time from the displayed list of suggested dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate scheduling with the executive.

[0041] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. The information about the parties includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then sends a schedule adjustment request to the parties involved using the selected means of contact. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[0042] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0043] Specific examples

[0044] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that the manager is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the device, which then presents the user with candidate dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0045] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0046] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[0047] The above is an embodiment of the present invention. By using this system, the complexity of schedule adjustment can be reduced and work efficiency can be improved.

[0048] The processing flow will be explained below.

[0049] Step 1:

[0050] The user inputs the desired date and time through the device interface. The user can enter a specific date and time, and can also specify the type of meeting and the required participants.

[0051] Step 2:

[0052] The terminal sends the input information to the server, which generates a request to acquire the calendar information of the manager based on the received information.

[0053] Step 3:

[0054] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots, thereby confirming whether the manager is available at the set date and time.

[0055] Step 4:

[0056] The server compares the user's desired date and time with the manager's available time. If the desired date and time is not available, it lists the next best possible date and time.

[0057] Step 5:

[0058] The server sends the candidate dates and times to the terminal, which displays the candidate dates and times to the user on its interface, and the user selects the most suitable date and time from the displayed candidate dates and times.

[0059] Step 6:

[0060] The user selects a candidate date and time and sends the confirmation information from the terminal to the server, which then updates the manager's calendar with the selected date and time and officially reserves the meeting.

[0061] Step 7:

[0062] When a user coordinates schedules with multiple contacts, the terminal inputs the contact information of the contacts, and the server stores the received contact information in a database.

[0063] Step 8:

[0064] The server automatically selects the optimal means of contact based on the contact information of each coordination target. For example, if an email address is registered, it will select email, and if a messaging service ID is registered, it will select that service.

[0065] Step 9:

[0066] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[0067] Step 10:

[0068] The server receives replies from each coordination destination and manages them in a unified manner. Based on the received information, the server performs a final confirmation of the schedule and notifies the user.

[0069] Step 11:

[0070] After the meeting or visit to the client is completed, the terminal provides a form in which the user can enter feedback or report details. The user enters the necessary information in the form and submits it.

[0071] Step 12:

[0072] The server automatically generates a report based on the received feedback information, and the generated report is sent from the server so that it can be automatically distributed to the relevant parties.

[0073] Step 13:

[0074] The server stores the generated reports in a database for future reference and analysis.

[0075] Example 1

[0076] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0077] Conventional scheduling methods are cumbersome and time-consuming, so there is a need for more efficient work. Furthermore, because multiple contacts and communication methods with senior executives are managed separately, there is also the issue of difficulty in integrated communication management. Preparing reports after meetings and visits also takes time and effort, resulting in delays in work and the loss of information. To solve these issues, the present invention calls for a system that can automate a series of business processes and efficiently manage them.

[0078] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0079] In this invention, the server includes means for acquiring calendar information of the manager and listing available time slots, means for providing an interface for the user to input a desired date and time, means for matching the user's desired date and time with the manager's available time slots to find the most suitable candidate date and time, means for displaying the candidate date and time to the user, means for confirming the date and time selected by the user and updating the calendar, means for centrally managing contact information of the person in charge of coordination in a database and automatically selecting the most suitable means of communication, means for contacting the person in charge of coordination using the most suitable means of communication, confirming the schedule and receiving a reply, means for notifying the user of a valid reply, means for automatically generating a report after the meeting or visit, means for automatically distributing the report to relevant parties, means for saving the generated report in a database, and means for providing a form for the user to easily input feedback and report content. This enables efficient schedule coordination, centralized contact management, and rapid report generation after meetings.

[0080] "Calendar information of managerial personnel" is data of an electronic calendar in which the schedule and free time of managerial personnel are recorded.

[0081] The "means of listing available time slots" is a function that analyzes calendar information and extracts and lists available time slots in the schedules of managers.

[0082] The "interface for inputting the user's desired date and time" refers to an input screen or form that allows the user to intuitively and easily input the desired date and time.

[0083] The "means for matching optimal candidate dates and times" is an algorithm or function that compares the user's desired date and time with the manager's available time, and selects the date and time that best meets both conditions.

[0084] The "means for displaying candidate dates and times to the user" is a function for displaying the best matched candidate dates and times on the terminal screen and allowing the user to select one.

[0085] "Means to confirm the date and time selected by the user and reflect it on the calendar" is a function that finalizes the date and time selected by the user and adds / updates that information to the manager's calendar.

[0086] "Means for centrally managing contact information of coordination parties in a database" refers to a function that aggregates and manages contact information of coordination parties (email addresses, telephone numbers, messaging service IDs, etc.) in a database.

[0087] "Means for automatically selecting the most appropriate means of communication" is a function that automatically selects the most appropriate means of communication (email, telephone, messaging service, etc.) depending on the situation and the other party's contact information.

[0088] "Means of contacting the person to be coordinated using the most appropriate means of communication, confirming the schedule, and receiving a reply" is a function of contacting the person to be coordinated using the selected means of communication, confirming the schedule, and receiving a reply.

[0089] The "means for notifying the user of a valid reply" is a function for notifying the user of valid reply information from the adjustment destination.

[0090] "Means for automatically generating reports after a meeting or visit" is a function that automatically creates a report after a meeting or visit has ended.

[0091] "Means for automatically distributing reports to interested parties" refers to a function for automatically distributing generated reports to interested parties via email or other appropriate means.

[0092] "Means for saving generated reports in a database" is a function that saves the created reports in a database so that they can be referenced and analyzed at a later date.

[0093] The "means for providing a form that allows users to easily input feedback and report content" is a function that provides an input form that allows users to easily input feedback and report content after a visit.

[0094] This invention relates to a system that handles everything from scheduling with executives to post-processing within the company. Specifically, it is composed of a server, terminals, and users as its main elements. Each element of the system and its specific processing method are described below.

[0095] System Configuration

[0096] First, a terminal is a device operated by a user, and includes hardware such as a PC, tablet, or smartphone. The terminal is provided with an intuitive graphical user interface (GUI) that allows users to easily select and enter the desired date and time. It also has a form for users to enter feedback and reports.

[0097] The server functions as a central management system and is responsible for large-scale data processing and storage management. It includes a database system that stores various data such as calendar information for executives, contact information for coordination partners, and generated reports. The server also has programs that run schedule adjustment algorithms and communication method selection algorithms.

[0098] System Operation

[0099] When a user wishes to meet with a senior executive, they input the desired date and time into the system using their terminal. At this time, a calendar-style interface is displayed on the terminal, allowing the user to operate it intuitively.

[0100] The server retrieves the manager's calendar information from the database. This calendar information includes the manager's existing reservations and free time. The server then analyzes the retrieved calendar information and lists the manager's free time slots. As a result, the user's desired date and time are optimally matched with the manager's free time. The matching results are sent from the server to the terminal and displayed to the user.

[0101] Next, the user selects the appropriate date and time from the displayed list of options. Once the selection is confirmed, the information is sent to the server and reflected in the executive's calendar, officially booking the meeting.

[0102] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. This information includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then uses the selected means of contact to send a schedule adjustment request to the party involved. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[0103] After a meeting or client visit, the terminal provides a form that allows users to easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and is also saved in a database for later reference and analysis.

[0104] Specific examples

[0105] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their terminal. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal and presents the user with candidate dates and times for 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0106] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0107] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[0108] Prompt Sentence Examples

[0109] "If a user wants to schedule a meeting with an executive next Wednesday at 2 PM, how does the system handle this? Please provide specific steps."

[0110] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0111] Step 1:

[0112] The user inputs the desired date and time.

[0113] Input: The specific date and time the user would like to meet (e.g., next Wednesday at 2pm).

[0114] Specific operations: Operate the device's calendar interface, select the desired date and time, and press the OK button.

[0115] Output: The user's desired date and time data is sent to the server.

[0116] Step 2:

[0117] The server obtains the calendar information of the manager.

[0118] Input: The role ID that the server uses to retrieve the role's calendar information from the database.

[0119] Specific operation: The server executes an SQL query to retrieve the executive's schedule and free time from the database.

[0120] Output: Calendar information data of the executives is imported to the server.

[0121] Step 3:

[0122] The server analyzes the calendar information of the executives and lists their available time slots.

[0123] Input: Calendar information of the retrieved executive.

[0124] Specific operation: An analysis algorithm in the server analyzes calendar information and lists the free time of executives.

[0125] Output: A list of available time slots for executives is generated.

[0126] Step 4:

[0127] The server compares the user's desired date and time with the manager's free time and matches the most suitable candidate date and time.

[0128] Input: A list of the user's preferred date and time and the manager's available time slots.

[0129] Specific operation: The server uses a matching algorithm to compare the user's desired date and time with the manager's available time, and determines the best possible date and time that do not overlap.

[0130] Output: A list of optimal candidate dates and times is generated.

[0131] Step 5:

[0132] The server transmits the optimal candidate dates and times to the terminal and displays them to the user.

[0133] Input: A list of best candidate dates and times.

[0134] Specific operation: The server sends a list of candidate dates and times to the device via API. The device receives it and displays it to the user.

[0135] Output: A list of candidate dates and times will be displayed on the device screen.

[0136] Step 6:

[0137] The user selects an appropriate date and time from the displayed candidate dates and times.

[0138] Input: A user-selected date and time (e.g., 2 PM).

[0139] Specific operation: The user selects the desired date and time from the list of candidate dates and times on the screen and presses the confirm button.

[0140] Output: The date and time data selected by the user is sent to the server.

[0141] Step 7:

[0142] The server reflects the selected date and time on the manager's calendar.

[0143] Input: User selected date and time data and the officer's calendar information.

[0144] Specific operation: The server calls the calendar update API and adds the selected date and time to the executive's calendar.

[0145] Output: Updated calendar information for the executive.

[0146] Step 8:

[0147] The server obtains contact information for each coordination party and automatically selects the most appropriate means of contact.

[0148] Input: ID of each adjustment target.

[0149] Specific operation: The server retrieves contact information for each coordination target from the database and runs the contact method selection algorithm.

[0150] Output: A list of optimal contact methods is generated.

[0151] Step 9:

[0152] The server contacts the coordination destination using the selected optimal contact means, confirms the schedule, and obtains a reply.

[0153] Input: A list of best contact methods and contact information for coordination.

[0154] Specific operation: The server uses an email sending API or messaging service API to send a schedule confirmation request to the coordination destination.

[0155] Output: The request message sent to the reconciliation destination.

[0156] Step 10:

[0157] The server receives a valid reply from the adjuster and notifies the user.

[0158] Input: Reply data from the adjustment destination.

[0159] Specific operation: The server saves the reply content in the database and calls the notification API to notify the user.

[0160] Output: A notification message that will be displayed on the user's terminal.

[0161] Step 11:

[0162] The terminal provides a feedback input form after the meeting or visit.

[0163] Input: Feedback after meetings and visits.

[0164] What happens: The device displays a form and the user submits the input.

[0165] Output: The feedback is sent to the server.

[0166] Step 12:

[0167] The server automatically generates a report based on the feedback and distributes it to relevant parties.

[0168] Input: Feedback data.

[0169] What happens: The server runs the report generation algorithm and emails the generated report to the relevant parties.

[0170] Output: Generated report and report email sent to stakeholders.

[0171] Step 13:

[0172] The server stores the generated reports in a database.

[0173] Input: Generated report data.

[0174] Specific behavior: The server saves the report data to the database.

[0175] Output: Report data stored in a database.

[0176] (Application example 1)

[0177] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0178] In conventional virtual stores, scheduling appointments between users and sales staff is often done manually, requiring a lot of time and effort. Feedback and report creation after the shopping experience are also often done manually, creating issues with operational efficiency. For this reason, there was a need for a system that could automate scheduling between users and sales staff and streamline the creation of reports after the shopping experience.

[0179] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0180] In this invention, the server includes a means for acquiring calendar information from managers and listing available time slots, a means for providing an interface for users to input their desired date and time, and a means for matching the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. This makes it possible to automatically arrange appointments between users and sales staff in a virtual store. Furthermore, by including a means for generating and saving feedback and reports after the shopping experience is completed, work efficiency can be improved.

[0181] A "manager" is someone who holds a specific position within a company and has decision-making power and responsibility.

[0182] "Calendar information" is information that records data on the schedules and free time of managers.

[0183] "Interface" is a general term for software or hardware that provides a screen or operating means for users to interact with a system.

[0184] "Matching" is the process of comparing the user's desired date and time with the available time of the manager and selecting the most suitable date and time.

[0185] A "database" is an integrated data storage device or system that centrally manages and stores large amounts of data and allows for quick search and reference as needed.

[0186] A "virtual store" is a virtual store operated on the Internet where users can purchase goods and services online.

[0187] "Sales staff" refers to people or AI assistants who are responsible for introducing and selling products and services in the virtual store.

[0188] An "appointment" is a scheduled interview or meeting between a user and a sales staff member or a person in a higher position.

[0189] A "report" is a document that summarizes feedback and reports from a meeting or shopping experience.

[0190] "Feedback" refers to the ratings, opinions, and impressions that users provide after a meeting or shopping experience.

[0191] The present invention is a system that performs all processes from scheduling with managers to post-processing within the company, and a specific embodiment thereof is described below. The system is composed of a server, terminals, and users.

[0192] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0193] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[0194] Next, the user selects an appropriate date and time from the displayed candidate dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate schedule coordination with executives. Furthermore, even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database. The information for each party includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of communication. The server then sends a schedule coordination request to the party using the selected means of communication. Responses from the parties are also centrally managed by the server, and the user is notified of these.

[0195] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0196] When this system is applied to a virtual store, it functions as a virtual shopping assistant that automatically arranges appointments with virtual store staff based on the user's desired date and time, and automatically generates feedback and reports after the appointment is completed. The user inputs the desired date and time using a terminal, and the server compares the staff's available times to suggest the optimal slot. Once the suggestion is confirmed, the appointment is smoothly arranged. After the appointment is completed, the terminal provides a feedback form, and the server automatically generates a report based on the user's input and distributes it to the relevant parties.

[0197] As a specific example, if a user wishes to have a shopping experience in a virtual store and wants to set an appointment for next Wednesday at 2:00 PM, they enter that information into their terminal. The server retrieves the staff member's calendar information and confirms that they are free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal, which then presents the user with possible dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the staff member's calendar is updated, completing the appointment setting. After the shopping experience is over, feedback and other information can be entered into a form on the terminal, and the server automatically generates and distributes a report and stores it in a database.

[0198] The following types of hardware and software are used in implementing this system:

[0199] Hardware: Personal computers, smartphones, tablets, and other devices that can connect to the internet

[0200] Software: Calendar management software, database software, interface design software

[0201] Examples of prompts that provide specific examples to generative AI models include:

[0202] "Compare the user's desired date and time (e.g., next Wednesday at 2 PM) with the staff's available time and confirm the optimal date and time. Notify them of the confirmed date and time and generate a report."

[0203] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0204] Step 1:

[0205] The user inputs the desired date and time using the terminal. The terminal interface is designed to be intuitive, allowing for easy selection of date and time. The input desired date and time is sent to the server. Input data: User's desired date and time. Output data: Desired date and time sent to the server.

[0206] Step 2:

[0207] The server obtains the manager's calendar information. The obtained calendar information includes the manager's existing schedules and free time. The server uses calendar management software to list the manager's free time slots. Input data: Manager's calendar information. Output data: List of free time slots for the manager.

[0208] Step 3:

[0209] The server compares the user's desired date and time with the manager's available time slots and performs data calculations to match the optimal candidate date and time. Calendar management software is used to select the available slot closest to the desired date and time. Input data: User's desired date and time and a list of available time slots for the manager. Output data: A list of optimal candidate dates and times.

[0210] Step 4:

[0211] The server sends the optimal candidate dates and times to the user's device. The device displays the received list of candidate dates and times to the user. Input data: List of optimal candidate dates and times. Output data: Candidate dates and times displayed to the user.

[0212] Step 5:

[0213] The user selects the appropriate date and time from the displayed candidate dates and times and sends it to the server via the terminal. Input data: The date and time selected by the user. Output data: The confirmed date and time sent to the server.

[0214] Step 6:

[0215] The server reflects the selected date and time on the executive's calendar. Furthermore, the server centrally manages the contact information of the person in charge in a database and automatically selects the most appropriate means of contact. The means of contact used may include email, telephone, messaging services, etc. Input data: The confirmed date and time selected by the user. Output data: The date and time reflected on the executive's calendar and the contact request sent.

[0216] Step 7:

[0217] The server uses the most appropriate communication method to send a schedule adjustment request to the coordination partner and obtains a reply. The obtained reply is centrally managed within the system and notified to the user. Input data: The sent schedule adjustment request. Output data: The obtained reply and notification to the user.

[0218] Step 8:

[0219] After a meeting or client visit is completed, the user enters feedback or reports into a form on the terminal. The entered information is sent to the server. Input data: Feedback or reports. Output data: Feedback or reports sent to the server.

[0220] Step 9:

[0221] The server automatically generates reports based on the input feedback and report content. The generated reports are automatically distributed to the relevant parties and saved in the database. Input data: Feedback and report content. Output data: Generated reports and reports saved in the database.

[0222] Step 10:

[0223] The same steps as above are applied in virtual stores, where appointments between users and sales staff are automatically arranged, and feedback and reports are automatically generated, distributed, and saved after the shopping experience. Specifically, the desired date and time is entered using a terminal, and the server compares this with the staff's available times to suggest the optimal slot. Input data: User's desired date and time and staff calendar information. Output data: Confirmed appointment and generated report.

[0224] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0225] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company, allowing it to recognize the user's emotions and provide optimal scheduling.

[0226] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0227] The device sends the entered information to the server. Based on the received information, the server generates a request to obtain the manager's calendar information. The server obtains the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. The server then compares the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. The matching results are sent from the server to the device and displayed to the user.

[0228] Furthermore, this invention incorporates an emotion engine that analyzes the user's emotions in real time. The emotion engine analyzes the user's facial expressions, voice, input content, etc., and calculates emotion data such as stress level and fatigue level. Based on this emotion data, the server preferentially presents the most appropriate date and time for the user.

[0229] The user selects a candidate date and time and sends the confirmation information from the terminal to the server. The server then updates the executive's calendar with the date and time and officially reserves the meeting. Even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database and automatically selects the most appropriate means of communication. The server then sends a schedule adjustment request to the parties involved using the selected means of communication. Responses from the parties involved are also centrally managed by the server and are notified to the user.

[0230] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0231] Specific examples

[0232] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server then sends that information to the device, which then presents the user with candidate dates and times for 2:00 PM and 3:00 PM. If the emotion engine then analyzes the user's stress level and determines that the user is in a high-stress state, the device will prioritize displaying a time slot that the user can use to relax. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0233] Furthermore, when a user adjusts schedules with multiple parties, the server automatically retrieves the contact information for each party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0234] After the meeting, users enter a summary of the meeting and their feedback into a form on their device, and the emotion engine analyzes the user's emotional data. Based on this, the server automatically generates a report and distributes it to the relevant parties. The generated report is also saved in a database for future reference and analysis.

[0235] The above is an embodiment of the present invention that combines an emotion engine. By using this system, optimal schedule adjustments can be made taking into account the user's emotions, contributing to improved work efficiency.

[0236] The processing flow will be explained below.

[0237] Step 1:

[0238] The user inputs the desired date and time and the meeting details through the terminal interface. For example, the user inputs that they want to set up a meeting for next Wednesday at 2:00 PM.

[0239] Step 2:

[0240] The terminal sends the input information to the server, which generates a request to obtain the manager's calendar information based on the desired date and time and meeting details received.

[0241] Step 3:

[0242] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. For example, it analyzes that the manager is available at 2:00 PM and 3:00 PM next Wednesday.

[0243] Step 4:

[0244] The server compares the user's desired date and time with the manager's available time, and lists the most suitable candidate dates and times. If the user's desired date and time is not available, the next most suitable candidate date and time will also be included in the list.

[0245] Step 5:

[0246] The server sends the list of candidate dates to the terminal, which displays the candidate dates to the user on the interface.

[0247] Step 6:

[0248] The user selects an appropriate date and time from the displayed candidate dates and times. For example, the user selects 2:00 PM and enters it into the terminal.

[0249] Step 7:

[0250] The terminal sends the selected date and time information to the server. The server updates the executive's calendar with the selected date and time, officially reserving the meeting, and sends a reservation completion notification to the terminal.

[0251] Step 8:

[0252] The server uses an emotion engine to analyze the user's input, voice, and facial expressions, and calculates the user's emotion data. For example, the emotion engine may detect that the user's stress level is high.

[0253] Step 9:

[0254] Based on the emotion data calculated by the emotion engine, the server will suggest the optimal schedule for the user. For example, if the user's stress level is high, it will suggest a time when they can relax.

[0255] Step 10:

[0256] When a user coordinates schedules with multiple parties, the terminal inputs the contact information of the parties, for example, the email address of business partner A and the messaging service ID of business partner B.

[0257] Step 11:

[0258] The server stores the received contact information in a database. Based on the stored contact information, the server automatically selects the most appropriate means of communication. For example, it selects email for client A and a messaging service for client B.

[0259] Step 12:

[0260] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[0261] Step 13:

[0262] The server receives replies from each coordination destination and manages them in a unified manner. The server performs a final confirmation of the schedule based on the received information and notifies the user.

[0263] Step 14:

[0264] After a meeting or a client visit is completed, the terminal provides a form in which the user can enter feedback or a report. The user inputs the required information into the form.

[0265] Step 15:

[0266] The device sends the input feedback information to the server, which then automatically generates a report based on the received feedback information.

[0267] Step 16:

[0268] The server automatically distributes the generated reports to the relevant parties and stores them in a database for future reference and analysis.

[0269] These are the specific processing steps of the system that combines the emotion engine. By taking the user's emotions into consideration, more flexible and effective schedule adjustment becomes possible.

[0270] Example 2

[0271] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0272] Conventional schedule adjustment systems can match users with managers' free time and finalize schedules, but it is difficult to present an optimal schedule that takes into account the user's emotions and state. Furthermore, they lack the functionality to optimize communication methods after schedule adjustments or to automatically provide feedback and reports after meetings, which can lead to problems with reduced work efficiency. This can lead to users continuing to work under high stress, which can result in a decline in work performance.

[0273] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring the time management information of the manager and listing available time slots; means for providing an interface for the user to input a desired date and time; means for matching the user's desired date and time with the manager's available time to find optimal candidate dates and times; means for displaying the candidate dates and times to the user; means for confirming the user's selected date and time and reflecting it in the schedule management tool; means for centrally managing the contact information of the person to be coordinated in a central database and automatically selecting the optimal contact method; means for contacting the person to be coordinated using the optimal contact method, confirming the schedule and receiving a reply; means for notifying the user of a valid reply; means for automatically generating a report after the meeting or visit; means for automatically distributing the report to relevant parties; means for saving the generated report in a database; and means for including an emotion engine that analyzes the user's emotions in real time and presenting optimal candidate dates and times to the user based on the emotion data. This enables optimal schedule adjustments that take the user's emotions and state into consideration, significantly improving work efficiency.

[0274] "Managerial personnel time management information" is data from calendars and schedule management tools that includes managerial personnel schedules and available time slots.

[0275] An "interface" is a screen or operating means that makes it easy for the user to input the desired date and time.

[0276] The "matching means" refers to an algorithm or program that compares the user's desired date and time with the manager's available time and selects the most suitable candidate date and time.

[0277] "Candidate dates and times" refers to multiple dates and times selected by comparing the user's desired dates and times with the manager's available time.

[0278] A "schedule management tool" is software or a system for managing the schedules of executives and users.

[0279] The "central database" is a database for centrally managing contact information and schedule information for coordination parties.

[0280] An "emotion engine" is an algorithm or program that analyzes emotional data from a user's facial expressions, voice, input content, etc., and evaluates the state of the parasympathetic nervous system, etc.

[0281] A "report" is a document automatically generated after a meeting or visit, also known as a report.

[0282] "Automatic selection method" refers to an algorithm or program that automatically selects the most appropriate means of contacting the coordination party.

[0283] "Means of communication" refers to methods and devices for contacting the person being coordinated, such as email, telephone equipment, or messaging services.

[0284] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company. This system recognizes the user's emotions and provides optimal schedule adjustments.

[0285] First, when a user wishes to adjust their schedule, they input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time using a calendar or time picker. The terminal then sends the input information to the server.

[0286] The server generates a request to retrieve the manager's time management information based on the received information. This includes a software module to retrieve the latest calendar information from the manager's calendar API. The server analyzes the data retrieved from the calendar API and extracts the manager's free time slots.

[0287] The server then compares the user's desired date and time with the manager's available time to find the most suitable candidate date and time. The server incorporates an emotion engine that analyzes emotional data in real time based on the user's facial expressions, voice, and input. The server evaluates the user's stress level and fatigue level based on the emotional data, and prioritizes presenting the most suitable candidate date and time for the user.

[0288] The proposed candidate dates and times are sent from the server to the terminal, which displays them to the user. When the user selects a candidate date and time, the information is sent back to the server. The server then updates the selected date and time in the executive's schedule management tool, officially reserving the meeting.

[0289] Furthermore, the server manages the contact information of the recipient in a central database and automatically selects the most appropriate means of communication (e.g., email, telephone device, or messaging service). The server then sends a schedule adjustment request to the recipient using the selected means of communication. Responses from the recipient are managed centrally by the server, and the user is notified of the response.

[0290] After a meeting or visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and saved in a database, making it available for future reference and analysis.

[0291] Specific examples

[0292] For example, if a user wants to schedule a meeting with an executive next Wednesday at 2pm, the following will work:

[0293] 1. The user types into the terminal, "I'd like to schedule a meeting next Wednesday at 2:00 PM."

[0294] 2. The device sends the information to the server.

[0295] 3. The server retrieves calendar information from the manager's calendar API and analyzes available time slots.

[0296] 4. The server compares the user's desired date and time with the manager's available time, generates a list of candidate dates and times, and sends it to the terminal.

[0297] 5. The emotion engine analyzes the user's stress level, and if the user is in a high stress state, the server prioritizes relaxing time periods.

[0298] 6. When the user selects 2:00 PM, the information is sent to the server and the meeting is set up by updating the executive's calendar.

[0299] 7. A message will be automatically sent to the person making the adjustment, and if there is a reply, the user will be notified via the server.

[0300] 8. After the meeting, the user enters the necessary information into the feedback form on the terminal, and the server automatically generates a report and distributes it to the relevant parties.

[0301] Prompt Sentence Examples

[0302] "A user wants to meet at 2 PM next Wednesday. Please retrieve the calendar information of the person in charge, check their availability, and provide possible dates and times."

[0303] The above is an embodiment of the present invention that combines an emotion engine. This system enables optimal schedule adjustment that takes into account the user's emotions, contributing to improved work efficiency.

[0304] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0305] Step 1:

[0306] The user performs an operation to input a desired date and time.

[0307] Input: The user inputs the desired schedule date and time (e.g., 2:00 p.m. next Wednesday) into the terminal.

[0308] Specific operation: Using the device's calendar or time picker, the user selects "Next Wednesday at 2:00 PM" and presses the "Adjust Schedule" button.

[0309] Output: The selected date and time data is saved to the terminal and sent to the next processing step.

[0310] Step 2:

[0311] The terminal transmits the desired date and time to the server.

[0312] Input: The date and time data selected in step 1.

[0313] Specific operation: The terminal sends the selected date and time data to the server as a POST request.

[0314] Output: The server receives the desired date and time data.

[0315] Step 3:

[0316] The server acquires the time management information of the manager.

[0317] Input: User's desired date and time data.

[0318] Specific operation: The server sends a request such as "GET / calendar?date=YYYYMMDD" to the manager's calendar API and obtains the manager's calendar information as a response.

[0319] Output: The calendar information of the manager is retrieved to the server.

[0320] Step 4:

[0321] The server analyzes the free time of the manager.

[0322] Input: Calendar information of the retrieved manager.

[0323] Specific operation: The server extracts the time periods with a "Free" status from the acquired calendar information and converts them into a format such as "2:00 PM to 3:00 PM."

[0324] Output: Free / busy data of executives.

[0325] Step 5:

[0326] The server compares the user's desired date and time with the free time of the manager and generates candidate dates and times.

[0327] Input: User's desired date and time data and manager's free time data.

[0328] Specific operation: The server uses a matching algorithm to select candidate dates and times that are available close to the user's desired date and time (e.g., 2:00 PM or 3:00 PM).

[0329] Output: A list of candidate dates and times.

[0330] Step 6:

[0331] The server analyzes the user's emotion data using an emotion engine.

[0332] Input: candidate date and time list, user facial expression data, voice data, input content.

[0333] Specific operation: Using the emotion engine, the user's stress level and fatigue level are analyzed, and emotional data such as "high stress" and "relaxed" is calculated.

[0334] Output: Analysis results and a list of optimal candidate dates and times, including sentiment data.

[0335] Step 7:

[0336] The server sends a list of optimal candidate dates and times to the terminal.

[0337] Input: Analysis results and a list of optimal candidate dates and times including sentiment data.

[0338] Specific operation: The server serializes the list of optimal candidate dates and times into JSON format and sends it to the device as a response.

[0339] Output: The terminal displays the received candidate date and time list.

[0340] Step 8:

[0341] The user selects and confirms a candidate date and time.

[0342] Input: A list of best candidate dates and times.

[0343] Specific operation: The user selects the desired date and time (e.g., 2:00 PM) from the list of candidate dates and times and presses the "Confirm" button.

[0344] Output: The selected date and time data.

[0345] Step 9:

[0346] The terminal transmits the selected date and time data to the server.

[0347] Input: Date and time data selected by the user.

[0348] Specific operation: The terminal sends the selected data to the server as a POST request.

[0349] Output: The server receives the selection data.

[0350] Step 10:

[0351] The server reflects the date and time in the schedule management tool of the executive.

[0352] Input: Selected date and time data.

[0353] Specific operation: The server sends a request to the executive's calendar API to add a schedule using "POST / calendar / events".

[0354] Output: The executive's calendar is updated and the meeting is confirmed.

[0355] Step 11:

[0356] The server contacts the coordinating party to adjust the schedule.

[0357] Input: Selected date and time data and contact information for the person you want to adjust.

[0358] Specific operation: The server retrieves the contact information of the person being coordinated from a central database, automatically selects the most appropriate means of communication (email, phone, messaging service, etc.), and sends the notification.

[0359] Output: A schedule confirmation request is sent to the coordinator.

[0360] Step 12:

[0361] The server centralizes the replies and notifies the user.

[0362] Input: Reply data from the adjustment destination.

[0363] Specific operation: When the server receives the reply data, it notifies the user via push notification or email.

[0364] Output: The user is notified of the reply from the adjustment destination.

[0365] Step 13:

[0366] After the meeting, the device provides a feedback form.

[0367] Input: State after meeting ends.

[0368] Specific behavior: The device displays a form for the user to enter feedback or report details.

[0369] Output: The user enters the required information into the form.

[0370] Step 14:

[0371] The terminal transmits the input feedback data to the server.

[0372] Input: Feedback data entered by the user.

[0373] Specific operation: The terminal sends the input data to the server as a POST request.

[0374] Output: The server receives the feedback data.

[0375] Step 15:

[0376] The server generates and distributes reports based on the feedback data.

[0377] Input: Feedback data entered by the user.

[0378] Specific operation: The server embeds the feedback data into the template, automatically generates a report, and distributes it to relevant parties by email.

[0379] Output: The generated report is distributed to the email addresses of the relevant parties and stored in a database.

[0380] The above is the flow of specific processing steps of this system, which allows users to adjust their schedules optimally while taking their emotions into consideration, thereby improving work efficiency.

[0381] (Application example 2)

[0382] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0383] Conventional schedule adjustment systems propose schedules without taking the user's emotional state into consideration, which can lead to stress and fatigue. Furthermore, there is a lack of means to grasp the driver's emotional state while driving and suggest appropriate rest stops or schedule changes, leaving issues in terms of safety and operational efficiency. The present invention aims to solve these issues by analyzing the user's emotions and suggesting optimal schedule adjustments and driving routes based on that analysis.

[0384] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0385] In this invention, the server includes means for analyzing the user's emotional data in real time and calculating emotional data such as stress level and fatigue level, means for preferentially presenting optimal candidate dates and times for the user based on the calculated emotional data, and means for acquiring actual driving route information and suggesting rest points based on the emotional data. This makes it possible to adjust the schedule and suggest rest points optimally taking the user's emotional state into consideration, and is expected to improve the user's work efficiency and safety.

[0386] "Position holder" refers to a person who holds a managerial or high-ranking position in a company or organization.

[0387] "Calendar Information" means electronic or physical time management data that records schedules and appointments.

[0388] "Interface" refers to the part that provides the input and output means for a user to interact with a system or application.

[0389] "Matching" refers to the process of matching the user's desired date and time with the availability of officials to find the best option.

[0390] A "database" refers to an organized collection of data for efficiently storing, managing, and retrieving information.

[0391] "Contact Methods" refers to methods and tools for communication, such as email, telephone, messaging services, etc.

[0392] "Emotional data" refers to information that indicates the user's emotional state, such as stress level or fatigue level, analyzed from facial expressions, voice, input content, etc.

[0393] "Rest points" are places where drivers can take a break while driving, including service areas and rest areas.

[0394] This invention is a system that acquires calendar information from managers, adjusts schedules optimally, analyzes the emotional state of drivers in real time while they are driving, and suggests appropriate rest stops. Specific embodiments of this system will be described in detail below.

[0395] Overview of the emotion analysis and schedule adjustment system

[0396] When a user uses the system interface to input a desired date and time, the terminal sends this information to the server. The server obtains the manager's calendar information and lists available time slots. Using a matching means, the server compares the user's desired date and time with the manager's available time slots and presents the user with the most suitable candidate date and time. At this point, the emotion engine analyzes the user's emotion data in real time and calculates stress levels and fatigue levels. Based on the emotion data, the most suitable candidate date and time for the user is displayed with priority. When the user confirms the selected date and time, the information is sent to the server and the manager's calendar is updated.

[0397] Overview of Autonomous Driving Assistance System

[0398] While a user is traveling in an autonomous vehicle, the device uses sensors such as a camera and microphone to acquire emotional data from the user's facial expressions and voice. The emotion engine analyzes this data and calculates stress levels and fatigue levels. The server combines the analyzed emotional data with driving route information to suggest optimal rest stops. The suggested rest stops are displayed on the device's display in real time, allowing the user to take a break while continuing to drive.

[0399] Hardware and Software Used

[0400] Emotion analysis engine: Affectiva, Microsoft (registered trademark) Azure (registered trademark) Face API, etc. are used.

[0401] Sensors: camera, microphone.

[0402] Server: The center of data analysis and information transmission and reception.

[0403] Terminal: A device that provides an interface for users to operate (e.g., a smartphone or an in-vehicle display).

[0404] Network communication: Data communication between the terminal and the server.

[0405] Operation example

[0406] For example, when a driver of an autonomous truck is driving from a starting point to a destination, the EAS (Emotion-Aware Auto Scheduler) analyzes the driver's emotional data in real time. If the driver's stress level or fatigue level is high, the EAS will display the nearest service area or rest stop on the display. The following prompt sentence is used:

[0407] "If the current stress level is high, a break is required within the next two hours. Please suggest the best time to rest for a driver with a stress level of 70 and fatigue level of 80."

[0408] Output format

[0409] The system can link users' emotional data with schedule information in real time and suggest appropriate measures. In this way, a system can be built that improves users' work efficiency and safety.

[0410] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0411] Step 1:

[0412] The user adjusts the schedule and inputs driving route information using the terminal interface, including the desired date and time, departure point, and destination.

[0413] Input: desired date and time, departure point, destination

[0414] Output: Sending input information to the server

[0415] Step 2:

[0416] The server retrieves the calendar information of the manager based on the received information, lists the available time slots, and queries the latest calendar information using the calendar API.

[0417] Input: desired date and time, calendar API request

[0418] Output: A list of available time slots

[0419] Step 3:

[0420] A matching means checks the user's desired date and time against the available time of the manager, and selects the most suitable candidate date and time.

[0421] Input: Desired date and time, list of available time slots

[0422] Output: A list of best candidate dates and times

[0423] Step 4:

[0424] The server sends a list of candidate dates and times to the terminal, which displays it to the user.

[0425] Input: A list of best candidate dates and times

[0426] Output: Display of candidate dates and times

[0427] Step 5:

[0428] The user selects from the candidate dates and times, and transmits information from the terminal to the server to confirm the selected date and time.

[0429] Input: Selected date and time

[0430] Output: Confirmation date and time sent to the server

[0431] Step 6:

[0432] The server reflects the confirmed date and time on the manager's calendar and updates the calendar information using the calendar API.

[0433] Input: Confirmed date and time

[0434] Output: Calendar updates

[0435] Step 7:

[0436] The device captures the user's facial expressions and voice through a camera and microphone to obtain emotional data.

[0437] Input: facial expressions, voice data

[0438] Output: Emotion data

[0439] Step 8:

[0440] The server's emotion engine analyzes the captured data and calculates the user's stress level and fatigue level.

[0441] Input: Emotion data

[0442] Output: Stress level, fatigue level

[0443] Step 9:

[0444] Based on the calculated emotion data, the server prioritizes and presents optimal candidate dates, times, and rest points.

[0445] Input: Stress level, fatigue level

[0446] Output: Best candidate date and time, rest point

[0447] Step 10:

[0448] The optimal candidate dates, times and rest points are displayed on the user's device, and the user makes a selection.

[0449] Input: Best candidate date and time, rest point

[0450] Output: Selected date and time, break point confirmation

[0451] Step 11:

[0452] After the meeting or driving is over, the terminal provides the user with a form for inputting feedback or reports, and transmits the input data to the server.

[0453] Input: Feedback, report content

[0454] Output: Sending feedback data to the server

[0455] Step 12:

[0456] The server automatically generates reports based on the feedback and reports, distributes them to the relevant parties, and stores the generated reports in a database.

[0457] Input: Feedback, report content

[0458] Output: Report generation, report distribution, saving to database

[0459] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0460] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0461] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0462] [Second embodiment]

[0463] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0464] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0465] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0466] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0467] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0468] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0469] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0470] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0471] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0472] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0473] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0474] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0475] This invention relates to a system that handles everything from scheduling with managers to post-processing within the company. The system is composed of a server, terminals, and users.

[0476] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0477] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[0478] Next, the user selects an appropriate date and time from the displayed list of suggested dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate scheduling with the executive.

[0479] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. The information about the parties includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then sends a schedule adjustment request to the parties involved using the selected means of contact. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[0480] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0481] Specific examples

[0482] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that the manager is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the device, which then presents the user with candidate dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0483] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0484] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[0485] The above is an embodiment of the present invention. By using this system, the complexity of schedule adjustment can be reduced and work efficiency can be improved.

[0486] The processing flow will be explained below.

[0487] Step 1:

[0488] The user inputs the desired date and time through the device interface. The user can enter a specific date and time, and can also specify the type of meeting and the required participants.

[0489] Step 2:

[0490] The terminal sends the input information to the server, which generates a request to acquire the calendar information of the manager based on the received information.

[0491] Step 3:

[0492] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots, thereby confirming whether the manager is available at the set date and time.

[0493] Step 4:

[0494] The server compares the user's desired date and time with the manager's available time. If the desired date and time is not available, it lists the next best possible date and time.

[0495] Step 5:

[0496] The server sends the candidate dates and times to the terminal, which displays the candidate dates and times to the user on its interface, and the user selects the most suitable date and time from the displayed candidate dates and times.

[0497] Step 6:

[0498] The user selects a candidate date and time and sends the confirmation information from the terminal to the server, which then updates the manager's calendar with the selected date and time and officially reserves the meeting.

[0499] Step 7:

[0500] When a user coordinates schedules with multiple contacts, the terminal inputs the contact information of the contacts, and the server stores the received contact information in a database.

[0501] Step 8:

[0502] The server automatically selects the optimal means of contact based on the contact information of each coordination target. For example, if an email address is registered, it will select email, and if a messaging service ID is registered, it will select that service.

[0503] Step 9:

[0504] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[0505] Step 10:

[0506] The server receives replies from each coordination destination and manages them in a unified manner. Based on the received information, the server performs a final confirmation of the schedule and notifies the user.

[0507] Step 11:

[0508] After the meeting or visit to the client is completed, the terminal provides a form in which the user can enter feedback or report details. The user enters the necessary information in the form and submits it.

[0509] Step 12:

[0510] The server automatically generates a report based on the received feedback information, and the generated report is sent from the server so that it can be automatically distributed to the relevant parties.

[0511] Step 13:

[0512] The server stores the generated reports in a database for future reference and analysis.

[0513] Example 1

[0514] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0515] Conventional scheduling methods are cumbersome and time-consuming, so there is a need for more efficient work. Furthermore, because multiple contacts and communication methods with senior executives are managed separately, there is also the issue of difficulty in integrated communication management. Preparing reports after meetings and visits also takes time and effort, resulting in delays in work and the loss of information. To solve these issues, the present invention calls for a system that can automate a series of business processes and efficiently manage them.

[0516] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0517] In this invention, the server includes means for acquiring calendar information of the manager and listing available time slots, means for providing an interface for the user to input a desired date and time, means for matching the user's desired date and time with the manager's available time slots to find the most suitable candidate date and time, means for displaying the candidate date and time to the user, means for confirming the date and time selected by the user and updating the calendar, means for centrally managing contact information of the person in charge of coordination in a database and automatically selecting the most suitable means of communication, means for contacting the person in charge of coordination using the most suitable means of communication, confirming the schedule and receiving a reply, means for notifying the user of a valid reply, means for automatically generating a report after the meeting or visit, means for automatically distributing the report to relevant parties, means for saving the generated report in a database, and means for providing a form for the user to easily input feedback and report content. This enables efficient schedule coordination, centralized contact management, and rapid report generation after meetings.

[0518] "Calendar information of managerial personnel" is data of an electronic calendar in which the schedule and free time of managerial personnel are recorded.

[0519] The "means of listing available time slots" is a function that analyzes calendar information and extracts and lists available time slots in the schedules of managers.

[0520] The "interface for inputting the user's desired date and time" refers to an input screen or form that allows the user to intuitively and easily input the desired date and time.

[0521] The "means for matching optimal candidate dates and times" is an algorithm or function that compares the user's desired date and time with the manager's available time, and selects the date and time that best meets both conditions.

[0522] The "means for displaying candidate dates and times to the user" is a function for displaying the best matched candidate dates and times on the terminal screen and allowing the user to select one.

[0523] "Means to confirm the date and time selected by the user and reflect it on the calendar" is a function that finalizes the date and time selected by the user and adds / updates that information to the manager's calendar.

[0524] "Means for centrally managing contact information of coordination parties in a database" refers to a function that aggregates and manages contact information of coordination parties (email addresses, telephone numbers, messaging service IDs, etc.) in a database.

[0525] "Means for automatically selecting the most appropriate means of communication" is a function that automatically selects the most appropriate means of communication (email, telephone, messaging service, etc.) depending on the situation and the other party's contact information.

[0526] "Means of contacting the person to be coordinated using the most appropriate means of communication, confirming the schedule, and receiving a reply" is a function of contacting the person to be coordinated using the selected means of communication, confirming the schedule, and receiving a reply.

[0527] The "means for notifying the user of a valid reply" is a function for notifying the user of valid reply information from the adjustment destination.

[0528] "Means for automatically generating reports after a meeting or visit" is a function that automatically creates a report after a meeting or visit has ended.

[0529] "Means for automatically distributing reports to interested parties" refers to a function for automatically distributing generated reports to interested parties via email or other appropriate means.

[0530] "Means for saving generated reports in a database" is a function that saves the created reports in a database so that they can be referenced and analyzed at a later date.

[0531] The "means for providing a form that allows users to easily input feedback and report content" is a function that provides an input form that allows users to easily input feedback and report content after a visit.

[0532] This invention relates to a system that handles everything from scheduling with executives to post-processing within the company. Specifically, it is composed of a server, terminals, and users as its main elements. Each element of the system and its specific processing method are described below.

[0533] System Configuration

[0534] First, a terminal is a device operated by a user, and includes hardware such as a PC, tablet, or smartphone. The terminal is provided with an intuitive graphical user interface (GUI) that allows users to easily select and enter the desired date and time. It also has a form for users to enter feedback and reports.

[0535] The server functions as a central management system and is responsible for large-scale data processing and storage management. It includes a database system that stores various data such as calendar information for executives, contact information for coordination partners, and generated reports. The server also has programs that run schedule adjustment algorithms and communication method selection algorithms.

[0536] System Operation

[0537] When a user wishes to meet with a senior executive, they input the desired date and time into the system using their terminal. At this time, a calendar-style interface is displayed on the terminal, allowing the user to operate it intuitively.

[0538] The server retrieves the manager's calendar information from the database. This calendar information includes the manager's existing reservations and free time. The server then analyzes the retrieved calendar information and lists the manager's free time slots. As a result, the user's desired date and time are optimally matched with the manager's free time. The matching results are sent from the server to the terminal and displayed to the user.

[0539] Next, the user selects the appropriate date and time from the displayed list of options. Once the selection is confirmed, the information is sent to the server and reflected in the executive's calendar, officially booking the meeting.

[0540] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. This information includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then uses the selected means of contact to send a schedule adjustment request to the party involved. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[0541] After a meeting or client visit, the terminal provides a form that allows users to easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and is also saved in a database for later reference and analysis.

[0542] Specific examples

[0543] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their terminal. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal and presents the user with candidate dates and times for 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0544] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0545] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[0546] Prompt Sentence Examples

[0547] "If a user wants to schedule a meeting with an executive next Wednesday at 2 PM, how does the system handle this? Please provide specific steps."

[0548] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0549] Step 1:

[0550] The user inputs the desired date and time.

[0551] Input: The specific date and time the user would like to meet (e.g., next Wednesday at 2pm).

[0552] Specific operations: Operate the device's calendar interface, select the desired date and time, and press the OK button.

[0553] Output: The user's desired date and time data is sent to the server.

[0554] Step 2:

[0555] The server obtains the calendar information of the manager.

[0556] Input: The role ID that the server uses to retrieve the role's calendar information from the database.

[0557] Specific operation: The server executes an SQL query to retrieve the executive's schedule and free time from the database.

[0558] Output: Calendar information data of the executives is imported to the server.

[0559] Step 3:

[0560] The server analyzes the calendar information of the executives and lists their available time slots.

[0561] Input: Calendar information of the retrieved executive.

[0562] Specific operation: An analysis algorithm in the server analyzes calendar information and lists the free time of executives.

[0563] Output: A list of available time slots for executives is generated.

[0564] Step 4:

[0565] The server compares the user's desired date and time with the manager's free time and matches the most suitable candidate date and time.

[0566] Input: A list of the user's preferred date and time and the manager's available time slots.

[0567] Specific operation: The server uses a matching algorithm to compare the user's desired date and time with the manager's available time, and determines the best possible date and time that do not overlap.

[0568] Output: A list of optimal candidate dates and times is generated.

[0569] Step 5:

[0570] The server transmits the optimal candidate dates and times to the terminal and displays them to the user.

[0571] Input: A list of best candidate dates and times.

[0572] Specific operation: The server sends a list of candidate dates and times to the device via API. The device receives it and displays it to the user.

[0573] Output: A list of candidate dates and times will be displayed on the device screen.

[0574] Step 6:

[0575] The user selects an appropriate date and time from the displayed candidate dates and times.

[0576] Input: A user-selected date and time (e.g., 2 PM).

[0577] Specific operation: The user selects the desired date and time from the list of candidate dates and times on the screen and presses the confirm button.

[0578] Output: The date and time data selected by the user is sent to the server.

[0579] Step 7:

[0580] The server reflects the selected date and time on the manager's calendar.

[0581] Input: User selected date and time data and the officer's calendar information.

[0582] Specific operation: The server calls the calendar update API and adds the selected date and time to the executive's calendar.

[0583] Output: Updated calendar information for the executive.

[0584] Step 8:

[0585] The server obtains contact information for each coordination party and automatically selects the most appropriate means of contact.

[0586] Input: ID of each adjustment target.

[0587] Specific operation: The server retrieves contact information for each coordination target from the database and runs the contact method selection algorithm.

[0588] Output: A list of optimal contact methods is generated.

[0589] Step 9:

[0590] The server contacts the coordination destination using the selected optimal contact means, confirms the schedule, and obtains a reply.

[0591] Input: A list of best contact methods and contact information for coordination.

[0592] Specific operation: The server uses an email sending API or messaging service API to send a schedule confirmation request to the coordination destination.

[0593] Output: The request message sent to the reconciliation destination.

[0594] Step 10:

[0595] The server receives a valid reply from the adjuster and notifies the user.

[0596] Input: Reply data from the adjustment destination.

[0597] Specific operation: The server saves the reply content in the database and calls the notification API to notify the user.

[0598] Output: A notification message that will be displayed on the user's terminal.

[0599] Step 11:

[0600] The terminal provides a feedback input form after the meeting or visit.

[0601] Input: Feedback after meetings and visits.

[0602] What happens: The device displays a form and the user submits the input.

[0603] Output: The feedback is sent to the server.

[0604] Step 12:

[0605] The server automatically generates a report based on the feedback and distributes it to relevant parties.

[0606] Input: Feedback data.

[0607] What happens: The server runs the report generation algorithm and emails the generated report to the relevant parties.

[0608] Output: Generated report and report email sent to stakeholders.

[0609] Step 13:

[0610] The server stores the generated reports in a database.

[0611] Input: Generated report data.

[0612] Specific behavior: The server saves the report data to the database.

[0613] Output: Report data stored in a database.

[0614] (Application example 1)

[0615] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0616] In conventional virtual stores, scheduling appointments between users and sales staff is often done manually, requiring a lot of time and effort. Feedback and report creation after the shopping experience are also often done manually, creating issues with operational efficiency. For this reason, there was a need for a system that could automate scheduling between users and sales staff and streamline the creation of reports after the shopping experience.

[0617] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0618] In this invention, the server includes a means for acquiring calendar information from managers and listing available time slots, a means for providing an interface for users to input their desired date and time, and a means for matching the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. This makes it possible to automatically arrange appointments between users and sales staff in a virtual store. Furthermore, by including a means for generating and saving feedback and reports after the shopping experience is completed, work efficiency can be improved.

[0619] A "manager" is someone who holds a specific position within a company and has decision-making power and responsibility.

[0620] "Calendar information" is information that records data on the schedules and free time of managers.

[0621] "Interface" is a general term for software or hardware that provides a screen or operating means for users to interact with a system.

[0622] "Matching" is the process of comparing the user's desired date and time with the available time of the manager and selecting the most suitable date and time.

[0623] A "database" is an integrated data storage device or system that centrally manages and stores large amounts of data and allows for quick search and reference as needed.

[0624] A "virtual store" is a virtual store operated on the Internet where users can purchase goods and services online.

[0625] "Sales staff" refers to people or AI assistants who are responsible for introducing and selling products and services in the virtual store.

[0626] An "appointment" is a scheduled interview or meeting between a user and a sales staff member or a person in a higher position.

[0627] A "report" is a document that summarizes feedback and reports from a meeting or shopping experience.

[0628] "Feedback" refers to the ratings, opinions, and impressions that users provide after a meeting or shopping experience.

[0629] The present invention is a system that performs all processes from scheduling with managers to post-processing within the company, and a specific embodiment thereof is described below. The system is composed of a server, terminals, and users.

[0630] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0631] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[0632] Next, the user selects an appropriate date and time from the displayed candidate dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate schedule coordination with executives. Furthermore, even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database. The information for each party includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of communication. The server then sends a schedule coordination request to the party using the selected means of communication. Responses from the parties are also centrally managed by the server, and the user is notified of these.

[0633] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0634] When this system is applied to a virtual store, it functions as a virtual shopping assistant that automatically arranges appointments with virtual store staff based on the user's desired date and time, and automatically generates feedback and reports after the appointment is completed. The user inputs the desired date and time using a terminal, and the server compares the staff's available times to suggest the optimal slot. Once the suggestion is confirmed, the appointment is smoothly arranged. After the appointment is completed, the terminal provides a feedback form, and the server automatically generates a report based on the user's input and distributes it to the relevant parties.

[0635] As a specific example, if a user wishes to have a shopping experience in a virtual store and wants to set an appointment for next Wednesday at 2:00 PM, they enter that information into their terminal. The server retrieves the staff member's calendar information and confirms that they are free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal, which then presents the user with possible dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the staff member's calendar is updated, completing the appointment setting. After the shopping experience is over, feedback and other information can be entered into a form on the terminal, and the server automatically generates and distributes a report and stores it in a database.

[0636] The following types of hardware and software are used in implementing this system:

[0637] Hardware: Personal computers, smartphones, tablets, and other devices that can connect to the internet

[0638] Software: Calendar management software, database software, interface design software

[0639] Examples of prompts that provide specific examples to generative AI models include:

[0640] "Compare the user's desired date and time (e.g., next Wednesday at 2 PM) with the staff's available time and confirm the optimal date and time. Notify them of the confirmed date and time and generate a report."

[0641] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0642] Step 1:

[0643] The user inputs the desired date and time using the terminal. The terminal interface is designed to be intuitive, allowing for easy selection of date and time. The input desired date and time is sent to the server. Input data: User's desired date and time. Output data: Desired date and time sent to the server.

[0644] Step 2:

[0645] The server obtains the manager's calendar information. The obtained calendar information includes the manager's existing schedules and free time. The server uses calendar management software to list the manager's free time slots. Input data: Manager's calendar information. Output data: List of free time slots for the manager.

[0646] Step 3:

[0647] The server compares the user's desired date and time with the manager's available time slots and performs data calculations to match the optimal candidate date and time. Calendar management software is used to select the available slot closest to the desired date and time. Input data: User's desired date and time and a list of available time slots for the manager. Output data: A list of optimal candidate dates and times.

[0648] Step 4:

[0649] The server sends the optimal candidate dates and times to the user's device. The device displays the received list of candidate dates and times to the user. Input data: List of optimal candidate dates and times. Output data: Candidate dates and times displayed to the user.

[0650] Step 5:

[0651] The user selects the appropriate date and time from the displayed candidate dates and times and sends it to the server via the terminal. Input data: The date and time selected by the user. Output data: The confirmed date and time sent to the server.

[0652] Step 6:

[0653] The server reflects the selected date and time on the executive's calendar. Furthermore, the server centrally manages the contact information of the person in charge in a database and automatically selects the most appropriate means of contact. The means of contact used may include email, telephone, messaging services, etc. Input data: The confirmed date and time selected by the user. Output data: The date and time reflected on the executive's calendar and the contact request sent.

[0654] Step 7:

[0655] The server uses the most appropriate communication method to send a schedule adjustment request to the coordination partner and obtains a reply. The obtained reply is centrally managed within the system and notified to the user. Input data: The sent schedule adjustment request. Output data: The obtained reply and notification to the user.

[0656] Step 8:

[0657] After a meeting or client visit is completed, the user enters feedback or reports into a form on the terminal. The entered information is sent to the server. Input data: Feedback or reports. Output data: Feedback or reports sent to the server.

[0658] Step 9:

[0659] The server automatically generates reports based on the input feedback and report content. The generated reports are automatically distributed to the relevant parties and saved in the database. Input data: Feedback and report content. Output data: Generated reports and reports saved in the database.

[0660] Step 10:

[0661] The same steps as above are applied in virtual stores, where appointments between users and sales staff are automatically arranged, and feedback and reports are automatically generated, distributed, and saved after the shopping experience. Specifically, the desired date and time is entered using a terminal, and the server compares this with the staff's available times to suggest the optimal slot. Input data: User's desired date and time and staff calendar information. Output data: Confirmed appointment and generated report.

[0662] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0663] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company, allowing it to recognize the user's emotions and provide optimal scheduling.

[0664] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0665] The device sends the entered information to the server. Based on the received information, the server generates a request to obtain the manager's calendar information. The server obtains the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. The server then compares the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. The matching results are sent from the server to the device and displayed to the user.

[0666] Furthermore, this invention incorporates an emotion engine that analyzes the user's emotions in real time. The emotion engine analyzes the user's facial expressions, voice, input content, etc., and calculates emotion data such as stress level and fatigue level. Based on this emotion data, the server preferentially presents the most appropriate date and time for the user.

[0667] The user selects a candidate date and time and sends the confirmation information from the terminal to the server. The server then updates the executive's calendar with the date and time and officially reserves the meeting. Even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database and automatically selects the most appropriate means of communication. The server then sends a schedule adjustment request to the parties involved using the selected means of communication. Responses from the parties involved are also centrally managed by the server and are notified to the user.

[0668] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0669] Specific examples

[0670] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server then sends that information to the device, which then presents the user with candidate dates and times for 2:00 PM and 3:00 PM. If the emotion engine then analyzes the user's stress level and determines that the user is in a high-stress state, the device will prioritize displaying a time slot that the user can use to relax. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0671] Furthermore, when a user adjusts schedules with multiple parties, the server automatically retrieves the contact information for each party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0672] After the meeting, users enter a summary of the meeting and their feedback into a form on their device, and the emotion engine analyzes the user's emotional data. Based on this, the server automatically generates a report and distributes it to the relevant parties. The generated report is also saved in a database for future reference and analysis.

[0673] The above is an embodiment of the present invention that combines an emotion engine. By using this system, optimal schedule adjustments can be made taking into account the user's emotions, contributing to improved work efficiency.

[0674] The processing flow will be explained below.

[0675] Step 1:

[0676] The user inputs the desired date and time and the meeting details through the terminal interface. For example, the user inputs that they want to set up a meeting for next Wednesday at 2:00 PM.

[0677] Step 2:

[0678] The terminal sends the input information to the server, which generates a request to obtain the manager's calendar information based on the desired date and time and meeting details received.

[0679] Step 3:

[0680] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. For example, it analyzes that the manager is available at 2:00 PM and 3:00 PM next Wednesday.

[0681] Step 4:

[0682] The server compares the user's desired date and time with the manager's available time, and lists the most suitable candidate dates and times. If the user's desired date and time is not available, the next most suitable candidate date and time will also be included in the list.

[0683] Step 5:

[0684] The server sends the list of candidate dates to the terminal, which displays the candidate dates to the user on the interface.

[0685] Step 6:

[0686] The user selects an appropriate date and time from the displayed candidate dates and times. For example, the user selects 2:00 PM and enters it into the terminal.

[0687] Step 7:

[0688] The terminal sends the selected date and time information to the server. The server updates the executive's calendar with the selected date and time, officially reserving the meeting, and sends a reservation completion notification to the terminal.

[0689] Step 8:

[0690] The server uses an emotion engine to analyze the user's input, voice, and facial expressions, and calculates the user's emotion data. For example, the emotion engine may detect that the user's stress level is high.

[0691] Step 9:

[0692] Based on the emotion data calculated by the emotion engine, the server will suggest the optimal schedule for the user. For example, if the user's stress level is high, it will suggest a time when they can relax.

[0693] Step 10:

[0694] When a user coordinates schedules with multiple parties, the terminal inputs the contact information of the parties, for example, the email address of business partner A and the messaging service ID of business partner B.

[0695] Step 11:

[0696] The server stores the received contact information in a database. Based on the stored contact information, the server automatically selects the most appropriate means of communication. For example, it selects email for client A and a messaging service for client B.

[0697] Step 12:

[0698] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[0699] Step 13:

[0700] The server receives replies from each coordination destination and manages them in a unified manner. The server performs a final confirmation of the schedule based on the received information and notifies the user.

[0701] Step 14:

[0702] After a meeting or a client visit is completed, the terminal provides a form in which the user can enter feedback or a report. The user inputs the required information into the form.

[0703] Step 15:

[0704] The device sends the input feedback information to the server, which then automatically generates a report based on the received feedback information.

[0705] Step 16:

[0706] The server automatically distributes the generated reports to the relevant parties and stores them in a database for future reference and analysis.

[0707] These are the specific processing steps of the system that combines the emotion engine. By taking the user's emotions into consideration, more flexible and effective schedule adjustment becomes possible.

[0708] Example 2

[0709] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0710] Conventional schedule adjustment systems can match users with managers' free time and finalize schedules, but it is difficult to present an optimal schedule that takes into account the user's emotions and state. Furthermore, they lack the functionality to optimize communication methods after schedule adjustments or to automatically provide feedback and reports after meetings, which can lead to problems with reduced work efficiency. This can lead to users continuing to work under high stress, which can result in a decline in work performance.

[0711] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring the time management information of the manager and listing available time slots; means for providing an interface for the user to input a desired date and time; means for matching the user's desired date and time with the manager's available time to find optimal candidate dates and times; means for displaying the candidate dates and times to the user; means for confirming the user's selected date and time and reflecting it in the schedule management tool; means for centrally managing the contact information of the person to be coordinated in a central database and automatically selecting the optimal contact method; means for contacting the person to be coordinated using the optimal contact method, confirming the schedule and receiving a reply; means for notifying the user of a valid reply; means for automatically generating a report after the meeting or visit; means for automatically distributing the report to relevant parties; means for saving the generated report in a database; and means for including an emotion engine that analyzes the user's emotions in real time and presenting optimal candidate dates and times to the user based on the emotion data. This enables optimal schedule adjustments that take the user's emotions and state into consideration, significantly improving work efficiency.

[0712] "Managerial personnel time management information" is data from calendars and schedule management tools that includes managerial personnel schedules and available time slots.

[0713] An "interface" is a screen or operating means that makes it easy for the user to input the desired date and time.

[0714] The "matching means" refers to an algorithm or program that compares the user's desired date and time with the manager's available time and selects the most suitable candidate date and time.

[0715] "Candidate dates and times" refers to multiple dates and times selected by comparing the user's desired dates and times with the manager's available time.

[0716] A "schedule management tool" is software or a system for managing the schedules of executives and users.

[0717] The "central database" is a database for centrally managing contact information and schedule information for coordination parties.

[0718] An "emotion engine" is an algorithm or program that analyzes emotional data from a user's facial expressions, voice, input content, etc., and evaluates the state of the parasympathetic nervous system, etc.

[0719] A "report" is a document automatically generated after a meeting or visit, also known as a report.

[0720] "Automatic selection method" refers to an algorithm or program that automatically selects the most appropriate means of contacting the coordination party.

[0721] "Means of communication" refers to methods and devices for contacting the person being coordinated, such as email, telephone equipment, or messaging services.

[0722] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company. This system recognizes the user's emotions and provides optimal schedule adjustments.

[0723] First, when a user wishes to adjust their schedule, they input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time using a calendar or time picker. The terminal then sends the input information to the server.

[0724] The server generates a request to retrieve the manager's time management information based on the received information. This includes a software module to retrieve the latest calendar information from the manager's calendar API. The server analyzes the data retrieved from the calendar API and extracts the manager's free time slots.

[0725] The server then compares the user's desired date and time with the manager's available time to find the most suitable candidate date and time. The server incorporates an emotion engine that analyzes emotional data in real time based on the user's facial expressions, voice, and input. The server evaluates the user's stress level and fatigue level based on the emotional data, and prioritizes presenting the most suitable candidate date and time for the user.

[0726] The proposed candidate dates and times are sent from the server to the terminal, which displays them to the user. When the user selects a candidate date and time, the information is sent back to the server. The server then updates the selected date and time in the executive's schedule management tool, officially reserving the meeting.

[0727] Furthermore, the server manages the contact information of the recipient in a central database and automatically selects the most appropriate means of communication (e.g., email, telephone device, or messaging service). The server then sends a schedule adjustment request to the recipient using the selected means of communication. Responses from the recipient are managed centrally by the server, and the user is notified of the response.

[0728] After a meeting or visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and saved in a database, making it available for future reference and analysis.

[0729] Specific examples

[0730] For example, if a user wants to schedule a meeting with an executive next Wednesday at 2pm, the following will work:

[0731] 1. The user types into the terminal, "I'd like to schedule a meeting next Wednesday at 2:00 PM."

[0732] 2. The device sends the information to the server.

[0733] 3. The server retrieves calendar information from the manager's calendar API and analyzes available time slots.

[0734] 4. The server compares the user's desired date and time with the manager's available time, generates a list of candidate dates and times, and sends it to the terminal.

[0735] 5. The emotion engine analyzes the user's stress level, and if the user is in a high stress state, the server prioritizes relaxing time periods.

[0736] 6. When the user selects 2:00 PM, the information is sent to the server and the meeting is set up by updating the executive's calendar.

[0737] 7. A message will be automatically sent to the person making the adjustment, and if there is a reply, the user will be notified via the server.

[0738] 8. After the meeting, the user enters the necessary information into the feedback form on the terminal, and the server automatically generates a report and distributes it to the relevant parties.

[0739] Prompt Sentence Examples

[0740] "A user wants to meet at 2 PM next Wednesday. Please retrieve the calendar information of the person in charge, check their availability, and provide possible dates and times."

[0741] The above is an embodiment of the present invention that combines an emotion engine. This system enables optimal schedule adjustment that takes into account the user's emotions, contributing to improved work efficiency.

[0742] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0743] Step 1:

[0744] The user performs an operation to input a desired date and time.

[0745] Input: The user inputs the desired schedule date and time (e.g., 2:00 p.m. next Wednesday) into the terminal.

[0746] Specific operation: Using the device's calendar or time picker, the user selects "Next Wednesday at 2:00 PM" and presses the "Adjust Schedule" button.

[0747] Output: The selected date and time data is saved to the terminal and sent to the next processing step.

[0748] Step 2:

[0749] The terminal transmits the desired date and time to the server.

[0750] Input: The date and time data selected in step 1.

[0751] Specific operation: The terminal sends the selected date and time data to the server as a POST request.

[0752] Output: The server receives the desired date and time data.

[0753] Step 3:

[0754] The server acquires the time management information of the manager.

[0755] Input: User's desired date and time data.

[0756] Specific operation: The server sends a request such as "GET / calendar?date=YYYYMMDD" to the manager's calendar API and obtains the manager's calendar information as a response.

[0757] Output: The calendar information of the manager is retrieved to the server.

[0758] Step 4:

[0759] The server analyzes the free time of the manager.

[0760] Input: Calendar information of the retrieved manager.

[0761] Specific operation: The server extracts the time periods with a "Free" status from the acquired calendar information and converts them into a format such as "2:00 PM to 3:00 PM."

[0762] Output: Free / busy data of executives.

[0763] Step 5:

[0764] The server compares the user's desired date and time with the free time of the manager and generates candidate dates and times.

[0765] Input: User's desired date and time data and manager's free time data.

[0766] Specific operation: The server uses a matching algorithm to select candidate dates and times that are available close to the user's desired date and time (e.g., 2:00 PM or 3:00 PM).

[0767] Output: A list of candidate dates and times.

[0768] Step 6:

[0769] The server analyzes the user's emotion data using an emotion engine.

[0770] Input: candidate date and time list, user facial expression data, voice data, input content.

[0771] Specific operation: Using the emotion engine, the user's stress level and fatigue level are analyzed, and emotional data such as "high stress" and "relaxed" is calculated.

[0772] Output: Analysis results and a list of optimal candidate dates and times, including sentiment data.

[0773] Step 7:

[0774] The server sends a list of optimal candidate dates and times to the terminal.

[0775] Input: Analysis results and a list of optimal candidate dates and times including sentiment data.

[0776] Specific operation: The server serializes the list of optimal candidate dates and times into JSON format and sends it to the device as a response.

[0777] Output: The terminal displays the received candidate date and time list.

[0778] Step 8:

[0779] The user selects and confirms a candidate date and time.

[0780] Input: A list of best candidate dates and times.

[0781] Specific operation: The user selects the desired date and time (e.g., 2:00 PM) from the list of candidate dates and times and presses the "Confirm" button.

[0782] Output: The selected date and time data.

[0783] Step 9:

[0784] The terminal transmits the selected date and time data to the server.

[0785] Input: Date and time data selected by the user.

[0786] Specific operation: The terminal sends the selected data to the server as a POST request.

[0787] Output: The server receives the selection data.

[0788] Step 10:

[0789] The server reflects the date and time in the schedule management tool of the executive.

[0790] Input: Selected date and time data.

[0791] Specific operation: The server sends a request to the executive's calendar API to add a schedule using "POST / calendar / events".

[0792] Output: The executive's calendar is updated and the meeting is confirmed.

[0793] Step 11:

[0794] The server contacts the coordinating party to adjust the schedule.

[0795] Input: Selected date and time data and contact information for the person you want to adjust.

[0796] Specific operation: The server retrieves the contact information of the person being coordinated from a central database, automatically selects the most appropriate means of communication (email, phone, messaging service, etc.), and sends the notification.

[0797] Output: A schedule confirmation request is sent to the coordinator.

[0798] Step 12:

[0799] The server centralizes the replies and notifies the user.

[0800] Input: Reply data from the adjustment destination.

[0801] Specific operation: When the server receives the reply data, it notifies the user via push notification or email.

[0802] Output: The user is notified of the reply from the adjustment destination.

[0803] Step 13:

[0804] After the meeting, the device provides a feedback form.

[0805] Input: State after meeting ends.

[0806] Specific behavior: The device displays a form for the user to enter feedback or report details.

[0807] Output: The user enters the required information into the form.

[0808] Step 14:

[0809] The terminal transmits the input feedback data to the server.

[0810] Input: Feedback data entered by the user.

[0811] Specific operation: The terminal sends the input data to the server as a POST request.

[0812] Output: The server receives the feedback data.

[0813] Step 15:

[0814] The server generates and distributes reports based on the feedback data.

[0815] Input: Feedback data entered by the user.

[0816] Specific operation: The server embeds the feedback data into the template, automatically generates a report, and distributes it to relevant parties by email.

[0817] Output: The generated report is distributed to the email addresses of the relevant parties and stored in a database.

[0818] The above is the flow of specific processing steps of this system, which allows users to adjust their schedules optimally while taking their emotions into consideration, thereby improving work efficiency.

[0819] (Application example 2)

[0820] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0821] Conventional schedule adjustment systems propose schedules without taking the user's emotional state into consideration, which can lead to stress and fatigue. Furthermore, there is a lack of means to grasp the driver's emotional state while driving and suggest appropriate rest stops or schedule changes, leaving issues in terms of safety and operational efficiency. The present invention aims to solve these issues by analyzing the user's emotions and suggesting optimal schedule adjustments and driving routes based on that analysis.

[0822] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0823] In this invention, the server includes means for analyzing the user's emotional data in real time and calculating emotional data such as stress level and fatigue level, means for preferentially presenting optimal candidate dates and times for the user based on the calculated emotional data, and means for acquiring actual driving route information and suggesting rest points based on the emotional data. This makes it possible to adjust the schedule and suggest rest points optimally taking the user's emotional state into consideration, and is expected to improve the user's work efficiency and safety.

[0824] "Position holder" refers to a person who holds a managerial or high-ranking position in a company or organization.

[0825] "Calendar Information" means electronic or physical time management data that records schedules and appointments.

[0826] "Interface" refers to the part that provides the input and output means for a user to interact with a system or application.

[0827] "Matching" refers to the process of matching the user's desired date and time with the availability of officials to find the best option.

[0828] A "database" refers to an organized collection of data for efficiently storing, managing, and retrieving information.

[0829] "Contact Methods" refers to methods and tools for communication, such as email, telephone, messaging services, etc.

[0830] "Emotional data" refers to information that indicates the user's emotional state, such as stress level or fatigue level, analyzed from facial expressions, voice, input content, etc.

[0831] "Rest points" are places where drivers can take a break while driving, including service areas and rest areas.

[0832] This invention is a system that acquires calendar information from managers, adjusts schedules optimally, analyzes the emotional state of drivers in real time while they are driving, and suggests appropriate rest stops. Specific embodiments of this system will be described in detail below.

[0833] Overview of the emotion analysis and schedule adjustment system

[0834] When a user uses the system interface to input a desired date and time, the terminal sends this information to the server. The server obtains the manager's calendar information and lists available time slots. Using a matching means, the server compares the user's desired date and time with the manager's available time slots and presents the user with the most suitable candidate date and time. At this point, the emotion engine analyzes the user's emotion data in real time and calculates stress levels and fatigue levels. Based on the emotion data, the most suitable candidate date and time for the user is displayed with priority. When the user confirms the selected date and time, the information is sent to the server and the manager's calendar is updated.

[0835] Overview of Autonomous Driving Assistance System

[0836] While a user is traveling in an autonomous vehicle, the device uses sensors such as a camera and microphone to acquire emotional data from the user's facial expressions and voice. The emotion engine analyzes this data and calculates stress levels and fatigue levels. The server combines the analyzed emotional data with driving route information to suggest optimal rest stops. The suggested rest stops are displayed on the device's display in real time, allowing the user to take a break while continuing to drive.

[0837] Hardware and Software Used

[0838] Emotion analysis engine: Uses Affectiva, Microsoft Azure Face API, etc.

[0839] Sensors: camera, microphone.

[0840] Server: The center of data analysis and information transmission and reception.

[0841] Terminal: A device that provides an interface for users to operate (e.g., a smartphone or an in-vehicle display).

[0842] Network communication: Data communication between the terminal and the server.

[0843] Operation example

[0844] For example, when a driver of an autonomous truck is driving from a starting point to a destination, the EAS (Emotion-Aware Auto Scheduler) analyzes the driver's emotional data in real time. If the driver's stress level or fatigue level is high, the EAS will display the nearest service area or rest stop on the display. The following prompt sentence is used:

[0845] "If the current stress level is high, a break is required within the next two hours. Please suggest the best time to rest for a driver with a stress level of 70 and fatigue level of 80."

[0846] Output format

[0847] The system can link users' emotional data with schedule information in real time and suggest appropriate measures. In this way, a system can be built that improves users' work efficiency and safety.

[0848] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0849] Step 1:

[0850] The user adjusts the schedule and inputs driving route information using the terminal interface, including the desired date and time, departure point, and destination.

[0851] Input: desired date and time, departure point, destination

[0852] Output: Sending input information to the server

[0853] Step 2:

[0854] The server retrieves the calendar information of the manager based on the received information, lists the available time slots, and queries the latest calendar information using the calendar API.

[0855] Input: desired date and time, calendar API request

[0856] Output: A list of available time slots

[0857] Step 3:

[0858] A matching means checks the user's desired date and time against the available time of the manager, and selects the most suitable candidate date and time.

[0859] Input: Desired date and time, list of available time slots

[0860] Output: A list of best candidate dates and times

[0861] Step 4:

[0862] The server sends a list of candidate dates and times to the terminal, which displays it to the user.

[0863] Input: A list of best candidate dates and times

[0864] Output: Display of candidate dates and times

[0865] Step 5:

[0866] The user selects from the candidate dates and times, and transmits information from the terminal to the server to confirm the selected date and time.

[0867] Input: Selected date and time

[0868] Output: Confirmation date and time sent to the server

[0869] Step 6:

[0870] The server reflects the confirmed date and time on the manager's calendar and updates the calendar information using the calendar API.

[0871] Input: Confirmed date and time

[0872] Output: Calendar updates

[0873] Step 7:

[0874] The device captures the user's facial expressions and voice through a camera and microphone to obtain emotional data.

[0875] Input: facial expressions, voice data

[0876] Output: Emotion data

[0877] Step 8:

[0878] The server's emotion engine analyzes the captured data and calculates the user's stress level and fatigue level.

[0879] Input: Emotion data

[0880] Output: Stress level, fatigue level

[0881] Step 9:

[0882] Based on the calculated emotion data, the server prioritizes and presents optimal candidate dates, times, and rest points.

[0883] Input: Stress level, fatigue level

[0884] Output: Best candidate date and time, rest point

[0885] Step 10:

[0886] The optimal candidate dates, times and rest points are displayed on the user's device, and the user makes a selection.

[0887] Input: Best candidate date and time, rest point

[0888] Output: Selected date and time, break point confirmation

[0889] Step 11:

[0890] After the meeting or driving is over, the terminal provides the user with a form for inputting feedback or reports, and transmits the input data to the server.

[0891] Input: Feedback, report content

[0892] Output: Sending feedback data to the server

[0893] Step 12:

[0894] The server automatically generates reports based on the feedback and reports, distributes them to the relevant parties, and stores the generated reports in a database.

[0895] Input: Feedback, report content

[0896] Output: Report generation, report distribution, saving to database

[0897] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0898] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0899] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0900] [Third embodiment]

[0901] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0902] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0903] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0904] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0905] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0906] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0907] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0908] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0909] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0910] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0911] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0912] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0913] This invention relates to a system that handles everything from scheduling with managers to post-processing within the company. The system is composed of a server, terminals, and users.

[0914] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[0915] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[0916] Next, the user selects an appropriate date and time from the displayed list of suggested dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate scheduling with the executive.

[0917] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. The information about the parties includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then sends a schedule adjustment request to the parties involved using the selected means of contact. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[0918] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[0919] Specific examples

[0920] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that the manager is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the device, which then presents the user with candidate dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0921] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0922] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[0923] The above is an embodiment of the present invention. By using this system, the complexity of schedule adjustment can be reduced and work efficiency can be improved.

[0924] The processing flow will be explained below.

[0925] Step 1:

[0926] The user inputs the desired date and time through the device interface. The user can enter a specific date and time, and can also specify the type of meeting and the required participants.

[0927] Step 2:

[0928] The terminal sends the input information to the server, which generates a request to acquire the calendar information of the manager based on the received information.

[0929] Step 3:

[0930] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots, thereby confirming whether the manager is available at the set date and time.

[0931] Step 4:

[0932] The server compares the user's desired date and time with the manager's available time. If the desired date and time is not available, it lists the next best possible date and time.

[0933] Step 5:

[0934] The server sends the candidate dates and times to the terminal, which displays the candidate dates and times to the user on its interface, and the user selects the most suitable date and time from the displayed candidate dates and times.

[0935] Step 6:

[0936] The user selects a candidate date and time and sends the confirmation information from the terminal to the server, which then updates the manager's calendar with the selected date and time and officially reserves the meeting.

[0937] Step 7:

[0938] When a user coordinates schedules with multiple contacts, the terminal inputs the contact information of the contacts, and the server stores the received contact information in a database.

[0939] Step 8:

[0940] The server automatically selects the optimal means of contact based on the contact information of each coordination target. For example, if an email address is registered, it will select email, and if a messaging service ID is registered, it will select that service.

[0941] Step 9:

[0942] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[0943] Step 10:

[0944] The server receives replies from each coordination destination and manages them in a unified manner. Based on the received information, the server performs a final confirmation of the schedule and notifies the user.

[0945] Step 11:

[0946] After the meeting or visit to the client is completed, the terminal provides a form in which the user can enter feedback or report details. The user enters the necessary information in the form and submits it.

[0947] Step 12:

[0948] The server automatically generates a report based on the received feedback information, and the generated report is sent from the server so that it can be automatically distributed to the relevant parties.

[0949] Step 13:

[0950] The server stores the generated reports in a database for future reference and analysis.

[0951] Example 1

[0952] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0953] Conventional scheduling methods are cumbersome and time-consuming, so there is a need for more efficient work. Furthermore, because multiple contacts and communication methods with senior executives are managed separately, there is also the issue of difficulty in integrated communication management. Preparing reports after meetings and visits also takes time and effort, resulting in delays in work and the loss of information. To solve these issues, the present invention calls for a system that can automate a series of business processes and efficiently manage them.

[0954] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0955] In this invention, the server includes means for acquiring calendar information of the manager and listing available time slots, means for providing an interface for the user to input a desired date and time, means for matching the user's desired date and time with the manager's available time slots to find the most suitable candidate date and time, means for displaying the candidate date and time to the user, means for confirming the date and time selected by the user and updating the calendar, means for centrally managing contact information of the person in charge of coordination in a database and automatically selecting the most suitable means of communication, means for contacting the person in charge of coordination using the most suitable means of communication, confirming the schedule and receiving a reply, means for notifying the user of a valid reply, means for automatically generating a report after the meeting or visit, means for automatically distributing the report to relevant parties, means for saving the generated report in a database, and means for providing a form for the user to easily input feedback and report content. This enables efficient schedule coordination, centralized contact management, and rapid report generation after meetings.

[0956] "Calendar information of managerial personnel" is data of an electronic calendar in which the schedule and free time of managerial personnel are recorded.

[0957] The "means of listing available time slots" is a function that analyzes calendar information and extracts and lists available time slots in the schedules of managers.

[0958] The "interface for inputting the user's desired date and time" refers to an input screen or form that allows the user to intuitively and easily input the desired date and time.

[0959] The "means for matching optimal candidate dates and times" is an algorithm or function that compares the user's desired date and time with the manager's available time, and selects the date and time that best meets both conditions.

[0960] The "means for displaying candidate dates and times to the user" is a function for displaying the best matched candidate dates and times on the terminal screen and allowing the user to select one.

[0961] "Means to confirm the date and time selected by the user and reflect it on the calendar" is a function that finalizes the date and time selected by the user and adds / updates that information to the manager's calendar.

[0962] "Means for centrally managing contact information of coordination parties in a database" refers to a function that aggregates and manages contact information of coordination parties (email addresses, telephone numbers, messaging service IDs, etc.) in a database.

[0963] "Means for automatically selecting the most appropriate means of communication" is a function that automatically selects the most appropriate means of communication (email, telephone, messaging service, etc.) depending on the situation and the other party's contact information.

[0964] "Means of contacting the person to be coordinated using the most appropriate means of communication, confirming the schedule, and receiving a reply" is a function of contacting the person to be coordinated using the selected means of communication, confirming the schedule, and receiving a reply.

[0965] The "means for notifying the user of a valid reply" is a function for notifying the user of valid reply information from the adjustment destination.

[0966] "Means for automatically generating reports after a meeting or visit" is a function that automatically creates a report after a meeting or visit has ended.

[0967] "Means for automatically distributing reports to interested parties" refers to a function for automatically distributing generated reports to interested parties via email or other appropriate means.

[0968] "Means for saving generated reports in a database" is a function that saves the created reports in a database so that they can be referenced and analyzed at a later date.

[0969] The "means for providing a form that allows users to easily input feedback and report content" is a function that provides an input form that allows users to easily input feedback and report content after a visit.

[0970] This invention relates to a system that handles everything from scheduling with executives to post-processing within the company. Specifically, it is composed of a server, terminals, and users as its main elements. Each element of the system and its specific processing method are described below.

[0971] System Configuration

[0972] First, a terminal is a device operated by a user, and includes hardware such as a PC, tablet, or smartphone. The terminal is provided with an intuitive graphical user interface (GUI) that allows users to easily select and enter the desired date and time. It also has a form for users to enter feedback and reports.

[0973] The server functions as a central management system and is responsible for large-scale data processing and storage management. It includes a database system that stores various data such as calendar information for executives, contact information for coordination partners, and generated reports. The server also has programs that run schedule adjustment algorithms and communication method selection algorithms.

[0974] System Operation

[0975] When a user wishes to meet with a senior executive, they input the desired date and time into the system using their terminal. At this time, a calendar-style interface is displayed on the terminal, allowing the user to operate it intuitively.

[0976] The server retrieves the manager's calendar information from the database. This calendar information includes the manager's existing reservations and free time. The server then analyzes the retrieved calendar information and lists the manager's free time slots. As a result, the user's desired date and time are optimally matched with the manager's free time. The matching results are sent from the server to the terminal and displayed to the user.

[0977] Next, the user selects the appropriate date and time from the displayed list of options. Once the selection is confirmed, the information is sent to the server and reflected in the executive's calendar, officially booking the meeting.

[0978] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. This information includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then uses the selected means of contact to send a schedule adjustment request to the party involved. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[0979] After a meeting or client visit, the terminal provides a form that allows users to easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and is also saved in a database for later reference and analysis.

[0980] Specific examples

[0981] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their terminal. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal and presents the user with candidate dates and times for 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[0982] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[0983] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[0984] Prompt Sentence Examples

[0985] "If a user wants to schedule a meeting with an executive next Wednesday at 2 PM, how does the system handle this? Please provide specific steps."

[0986] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0987] Step 1:

[0988] The user inputs the desired date and time.

[0989] Input: The specific date and time the user would like to meet (e.g., next Wednesday at 2pm).

[0990] Specific operations: Operate the device's calendar interface, select the desired date and time, and press the OK button.

[0991] Output: The user's desired date and time data is sent to the server.

[0992] Step 2:

[0993] The server obtains the calendar information of the manager.

[0994] Input: The role ID that the server uses to retrieve the role's calendar information from the database.

[0995] Specific operation: The server executes an SQL query to retrieve the executive's schedule and free time from the database.

[0996] Output: Calendar information data of the executives is imported to the server.

[0997] Step 3:

[0998] The server analyzes the calendar information of the executives and lists their available time slots.

[0999] Input: Calendar information of the retrieved executive.

[1000] Specific operation: An analysis algorithm in the server analyzes calendar information and lists the free time of executives.

[1001] Output: A list of available time slots for executives is generated.

[1002] Step 4:

[1003] The server compares the user's desired date and time with the manager's free time and matches the most suitable candidate date and time.

[1004] Input: A list of the user's preferred date and time and the manager's available time slots.

[1005] Specific operation: The server uses a matching algorithm to compare the user's desired date and time with the manager's available time, and determines the best possible date and time that do not overlap.

[1006] Output: A list of optimal candidate dates and times is generated.

[1007] Step 5:

[1008] The server transmits the optimal candidate dates and times to the terminal and displays them to the user.

[1009] Input: A list of best candidate dates and times.

[1010] Specific operation: The server sends a list of candidate dates and times to the device via API. The device receives it and displays it to the user.

[1011] Output: A list of candidate dates and times will be displayed on the device screen.

[1012] Step 6:

[1013] The user selects an appropriate date and time from the displayed candidate dates and times.

[1014] Input: A user-selected date and time (e.g., 2 PM).

[1015] Specific operation: The user selects the desired date and time from the list of candidate dates and times on the screen and presses the confirm button.

[1016] Output: The date and time data selected by the user is sent to the server.

[1017] Step 7:

[1018] The server reflects the selected date and time on the manager's calendar.

[1019] Input: User selected date and time data and the officer's calendar information.

[1020] Specific operation: The server calls the calendar update API and adds the selected date and time to the executive's calendar.

[1021] Output: Updated calendar information for the executive.

[1022] Step 8:

[1023] The server obtains contact information for each coordination party and automatically selects the most appropriate means of contact.

[1024] Input: ID of each adjustment target.

[1025] Specific operation: The server retrieves contact information for each coordination target from the database and runs the contact method selection algorithm.

[1026] Output: A list of optimal contact methods is generated.

[1027] Step 9:

[1028] The server contacts the coordination destination using the selected optimal contact means, confirms the schedule, and obtains a reply.

[1029] Input: A list of best contact methods and contact information for coordination.

[1030] Specific operation: The server uses an email sending API or messaging service API to send a schedule confirmation request to the coordination destination.

[1031] Output: The request message sent to the reconciliation destination.

[1032] Step 10:

[1033] The server receives a valid reply from the adjuster and notifies the user.

[1034] Input: Reply data from the adjustment destination.

[1035] Specific operation: The server saves the reply content in the database and calls the notification API to notify the user.

[1036] Output: A notification message that will be displayed on the user's terminal.

[1037] Step 11:

[1038] The terminal provides a feedback input form after the meeting or visit.

[1039] Input: Feedback after meetings and visits.

[1040] What happens: The device displays a form and the user submits the input.

[1041] Output: The feedback is sent to the server.

[1042] Step 12:

[1043] The server automatically generates a report based on the feedback and distributes it to relevant parties.

[1044] Input: Feedback data.

[1045] What happens: The server runs the report generation algorithm and emails the generated report to the relevant parties.

[1046] Output: Generated report and report email sent to stakeholders.

[1047] Step 13:

[1048] The server stores the generated reports in a database.

[1049] Input: Generated report data.

[1050] Specific behavior: The server saves the report data to the database.

[1051] Output: Report data stored in a database.

[1052] (Application example 1)

[1053] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1054] In conventional virtual stores, scheduling appointments between users and sales staff is often done manually, requiring a lot of time and effort. Feedback and report creation after the shopping experience are also often done manually, creating issues with operational efficiency. For this reason, there was a need for a system that could automate scheduling between users and sales staff and streamline the creation of reports after the shopping experience.

[1055] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1056] In this invention, the server includes a means for acquiring calendar information from managers and listing available time slots, a means for providing an interface for users to input their desired date and time, and a means for matching the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. This makes it possible to automatically arrange appointments between users and sales staff in a virtual store. Furthermore, by including a means for generating and saving feedback and reports after the shopping experience is completed, work efficiency can be improved.

[1057] A "manager" is someone who holds a specific position within a company and has decision-making power and responsibility.

[1058] "Calendar information" is information that records data on the schedules and free time of managers.

[1059] "Interface" is a general term for software or hardware that provides a screen or operating means for users to interact with a system.

[1060] "Matching" is the process of comparing the user's desired date and time with the available time of the manager and selecting the most suitable date and time.

[1061] A "database" is an integrated data storage device or system that centrally manages and stores large amounts of data and allows for quick search and reference as needed.

[1062] A "virtual store" is a virtual store operated on the Internet where users can purchase goods and services online.

[1063] "Sales staff" refers to people or AI assistants who are responsible for introducing and selling products and services in the virtual store.

[1064] An "appointment" is a scheduled interview or meeting between a user and a sales staff member or a person in a higher position.

[1065] A "report" is a document that summarizes feedback and reports from a meeting or shopping experience.

[1066] "Feedback" refers to the ratings, opinions, and impressions that users provide after a meeting or shopping experience.

[1067] The present invention is a system that performs all processes from scheduling with managers to post-processing within the company, and a specific embodiment thereof is described below. The system is composed of a server, terminals, and users.

[1068] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[1069] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[1070] Next, the user selects an appropriate date and time from the displayed candidate dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate schedule coordination with executives. Furthermore, even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database. The information for each party includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of communication. The server then sends a schedule coordination request to the party using the selected means of communication. Responses from the parties are also centrally managed by the server, and the user is notified of these.

[1071] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[1072] When this system is applied to a virtual store, it functions as a virtual shopping assistant that automatically arranges appointments with virtual store staff based on the user's desired date and time, and automatically generates feedback and reports after the appointment is completed. The user inputs the desired date and time using a terminal, and the server compares the staff's available times to suggest the optimal slot. Once the suggestion is confirmed, the appointment is smoothly arranged. After the appointment is completed, the terminal provides a feedback form, and the server automatically generates a report based on the user's input and distributes it to the relevant parties.

[1073] As a specific example, if a user wishes to have a shopping experience in a virtual store and wants to set an appointment for next Wednesday at 2:00 PM, they enter that information into their terminal. The server retrieves the staff member's calendar information and confirms that they are free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal, which then presents the user with possible dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the staff member's calendar is updated, completing the appointment setting. After the shopping experience is over, feedback and other information can be entered into a form on the terminal, and the server automatically generates and distributes a report and stores it in a database.

[1074] The following types of hardware and software are used in implementing this system:

[1075] Hardware: Personal computers, smartphones, tablets, and other devices that can connect to the internet

[1076] Software: Calendar management software, database software, interface design software

[1077] Examples of prompts that provide specific examples to generative AI models include:

[1078] "Compare the user's desired date and time (e.g., next Wednesday at 2 PM) with the staff's available time and confirm the optimal date and time. Notify them of the confirmed date and time and generate a report."

[1079] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1080] Step 1:

[1081] The user inputs the desired date and time using the terminal. The terminal interface is designed to be intuitive, allowing for easy selection of date and time. The input desired date and time is sent to the server. Input data: User's desired date and time. Output data: Desired date and time sent to the server.

[1082] Step 2:

[1083] The server obtains the manager's calendar information. The obtained calendar information includes the manager's existing schedules and free time. The server uses calendar management software to list the manager's free time slots. Input data: Manager's calendar information. Output data: List of free time slots for the manager.

[1084] Step 3:

[1085] The server compares the user's desired date and time with the manager's available time slots and performs data calculations to match the optimal candidate date and time. Calendar management software is used to select the available slot closest to the desired date and time. Input data: User's desired date and time and a list of available time slots for the manager. Output data: A list of optimal candidate dates and times.

[1086] Step 4:

[1087] The server sends the optimal candidate dates and times to the user's device. The device displays the received list of candidate dates and times to the user. Input data: List of optimal candidate dates and times. Output data: Candidate dates and times displayed to the user.

[1088] Step 5:

[1089] The user selects the appropriate date and time from the displayed candidate dates and times and sends it to the server via the terminal. Input data: The date and time selected by the user. Output data: The confirmed date and time sent to the server.

[1090] Step 6:

[1091] The server reflects the selected date and time on the executive's calendar. Furthermore, the server centrally manages the contact information of the person in charge in a database and automatically selects the most appropriate means of contact. The means of contact used may include email, telephone, messaging services, etc. Input data: The confirmed date and time selected by the user. Output data: The date and time reflected on the executive's calendar and the contact request sent.

[1092] Step 7:

[1093] The server uses the most appropriate communication method to send a schedule adjustment request to the coordination partner and obtains a reply. The obtained reply is centrally managed within the system and notified to the user. Input data: The sent schedule adjustment request. Output data: The obtained reply and notification to the user.

[1094] Step 8:

[1095] After a meeting or client visit is completed, the user enters feedback or reports into a form on the terminal. The entered information is sent to the server. Input data: Feedback or reports. Output data: Feedback or reports sent to the server.

[1096] Step 9:

[1097] The server automatically generates reports based on the input feedback and report content. The generated reports are automatically distributed to the relevant parties and saved in the database. Input data: Feedback and report content. Output data: Generated reports and reports saved in the database.

[1098] Step 10:

[1099] The same steps as above are applied in virtual stores, where appointments between users and sales staff are automatically arranged, and feedback and reports are automatically generated, distributed, and saved after the shopping experience. Specifically, the desired date and time is entered using a terminal, and the server compares this with the staff's available times to suggest the optimal slot. Input data: User's desired date and time and staff calendar information. Output data: Confirmed appointment and generated report.

[1100] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1101] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company, allowing it to recognize the user's emotions and provide optimal scheduling.

[1102] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[1103] The device sends the entered information to the server. Based on the received information, the server generates a request to obtain the manager's calendar information. The server obtains the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. The server then compares the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. The matching results are sent from the server to the device and displayed to the user.

[1104] Furthermore, this invention incorporates an emotion engine that analyzes the user's emotions in real time. The emotion engine analyzes the user's facial expressions, voice, input content, etc., and calculates emotion data such as stress level and fatigue level. Based on this emotion data, the server preferentially presents the most appropriate date and time for the user.

[1105] The user selects a candidate date and time and sends the confirmation information from the terminal to the server. The server then updates the executive's calendar with the date and time and officially reserves the meeting. Even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database and automatically selects the most appropriate means of communication. The server then sends a schedule adjustment request to the parties involved using the selected means of communication. Responses from the parties involved are also centrally managed by the server and are notified to the user.

[1106] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[1107] Specific examples

[1108] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server then sends that information to the device, which then presents the user with candidate dates and times for 2:00 PM and 3:00 PM. If the emotion engine then analyzes the user's stress level and determines that the user is in a high-stress state, the device will prioritize displaying a time slot that the user can use to relax. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[1109] Furthermore, when a user adjusts schedules with multiple parties, the server automatically retrieves the contact information for each party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[1110] After the meeting, users enter a summary of the meeting and their feedback into a form on their device, and the emotion engine analyzes the user's emotional data. Based on this, the server automatically generates a report and distributes it to the relevant parties. The generated report is also saved in a database for future reference and analysis.

[1111] The above is an embodiment of the present invention that combines an emotion engine. By using this system, optimal schedule adjustments can be made taking into account the user's emotions, contributing to improved work efficiency.

[1112] The processing flow will be explained below.

[1113] Step 1:

[1114] The user inputs the desired date and time and the meeting details through the terminal interface. For example, the user inputs that they want to set up a meeting for next Wednesday at 2:00 PM.

[1115] Step 2:

[1116] The terminal sends the input information to the server, which generates a request to obtain the manager's calendar information based on the desired date and time and meeting details received.

[1117] Step 3:

[1118] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. For example, it analyzes that the manager is available at 2:00 PM and 3:00 PM next Wednesday.

[1119] Step 4:

[1120] The server compares the user's desired date and time with the manager's available time, and lists the most suitable candidate dates and times. If the user's desired date and time is not available, the next most suitable candidate date and time will also be included in the list.

[1121] Step 5:

[1122] The server sends the list of candidate dates to the terminal, which displays the candidate dates to the user on the interface.

[1123] Step 6:

[1124] The user selects an appropriate date and time from the displayed candidate dates and times. For example, the user selects 2:00 PM and enters it into the terminal.

[1125] Step 7:

[1126] The terminal sends the selected date and time information to the server. The server updates the executive's calendar with the selected date and time, officially reserving the meeting, and sends a reservation completion notification to the terminal.

[1127] Step 8:

[1128] The server uses an emotion engine to analyze the user's input, voice, and facial expressions, and calculates the user's emotion data. For example, the emotion engine may detect that the user's stress level is high.

[1129] Step 9:

[1130] Based on the emotion data calculated by the emotion engine, the server will suggest the optimal schedule for the user. For example, if the user's stress level is high, it will suggest a time when they can relax.

[1131] Step 10:

[1132] When a user coordinates schedules with multiple parties, the terminal inputs the contact information of the parties, for example, the email address of business partner A and the messaging service ID of business partner B.

[1133] Step 11:

[1134] The server stores the received contact information in a database. Based on the stored contact information, the server automatically selects the most appropriate means of communication. For example, it selects email for client A and a messaging service for client B.

[1135] Step 12:

[1136] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[1137] Step 13:

[1138] The server receives replies from each coordination destination and manages them in a unified manner. The server performs a final confirmation of the schedule based on the received information and notifies the user.

[1139] Step 14:

[1140] After a meeting or a client visit is completed, the terminal provides a form in which the user can enter feedback or a report. The user inputs the required information into the form.

[1141] Step 15:

[1142] The device sends the input feedback information to the server, which then automatically generates a report based on the received feedback information.

[1143] Step 16:

[1144] The server automatically distributes the generated reports to the relevant parties and stores them in a database for future reference and analysis.

[1145] These are the specific processing steps of the system that combines the emotion engine. By taking the user's emotions into consideration, more flexible and effective schedule adjustment becomes possible.

[1146] Example 2

[1147] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1148] Conventional schedule adjustment systems can match users with managers' free time and finalize schedules, but it is difficult to present an optimal schedule that takes into account the user's emotions and state. Furthermore, they lack the functionality to optimize communication methods after schedule adjustments or to automatically provide feedback and reports after meetings, which can lead to problems with reduced work efficiency. This can lead to users continuing to work under high stress, which can result in a decline in work performance.

[1149] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring the time management information of the manager and listing available time slots; means for providing an interface for the user to input a desired date and time; means for matching the user's desired date and time with the manager's available time to find optimal candidate dates and times; means for displaying the candidate dates and times to the user; means for confirming the user's selected date and time and reflecting it in the schedule management tool; means for centrally managing the contact information of the person to be coordinated in a central database and automatically selecting the optimal contact method; means for contacting the person to be coordinated using the optimal contact method, confirming the schedule and receiving a reply; means for notifying the user of a valid reply; means for automatically generating a report after the meeting or visit; means for automatically distributing the report to relevant parties; means for saving the generated report in a database; and means for including an emotion engine that analyzes the user's emotions in real time and presenting optimal candidate dates and times to the user based on the emotion data. This enables optimal schedule adjustments that take the user's emotions and state into consideration, significantly improving work efficiency.

[1150] "Managerial personnel time management information" is data from calendars and schedule management tools that includes managerial personnel schedules and available time slots.

[1151] An "interface" is a screen or operating means that makes it easy for the user to input the desired date and time.

[1152] The "matching means" refers to an algorithm or program that compares the user's desired date and time with the manager's available time and selects the most suitable candidate date and time.

[1153] "Candidate dates and times" refers to multiple dates and times selected by comparing the user's desired dates and times with the manager's available time.

[1154] A "schedule management tool" is software or a system for managing the schedules of executives and users.

[1155] The "central database" is a database for centrally managing contact information and schedule information for coordination parties.

[1156] An "emotion engine" is an algorithm or program that analyzes emotional data from a user's facial expressions, voice, input content, etc., and evaluates the state of the parasympathetic nervous system, etc.

[1157] A "report" is a document automatically generated after a meeting or visit, also known as a report.

[1158] "Automatic selection method" refers to an algorithm or program that automatically selects the most appropriate means of contacting the coordination party.

[1159] "Means of communication" refers to methods and devices for contacting the person being coordinated, such as email, telephone equipment, or messaging services.

[1160] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company. This system recognizes the user's emotions and provides optimal schedule adjustments.

[1161] First, when a user wishes to adjust their schedule, they input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time using a calendar or time picker. The terminal then sends the input information to the server.

[1162] The server generates a request to retrieve the manager's time management information based on the received information. This includes a software module to retrieve the latest calendar information from the manager's calendar API. The server analyzes the data retrieved from the calendar API and extracts the manager's free time slots.

[1163] The server then compares the user's desired date and time with the manager's available time to find the most suitable candidate date and time. The server incorporates an emotion engine that analyzes emotional data in real time based on the user's facial expressions, voice, and input. The server evaluates the user's stress level and fatigue level based on the emotional data, and prioritizes presenting the most suitable candidate date and time for the user.

[1164] The proposed candidate dates and times are sent from the server to the terminal, which displays them to the user. When the user selects a candidate date and time, the information is sent back to the server. The server then updates the selected date and time in the executive's schedule management tool, officially reserving the meeting.

[1165] Furthermore, the server manages the contact information of the recipient in a central database and automatically selects the most appropriate means of communication (e.g., email, telephone device, or messaging service). The server then sends a schedule adjustment request to the recipient using the selected means of communication. Responses from the recipient are managed centrally by the server, and the user is notified of the response.

[1166] After a meeting or visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and saved in a database, making it available for future reference and analysis.

[1167] Specific examples

[1168] For example, if a user wants to schedule a meeting with an executive next Wednesday at 2pm, the following will work:

[1169] 1. The user types into the terminal, "I'd like to schedule a meeting next Wednesday at 2:00 PM."

[1170] 2. The device sends the information to the server.

[1171] 3. The server retrieves calendar information from the manager's calendar API and analyzes available time slots.

[1172] 4. The server compares the user's desired date and time with the manager's available time, generates a list of candidate dates and times, and sends it to the terminal.

[1173] 5. The emotion engine analyzes the user's stress level, and if the user is in a high stress state, the server prioritizes relaxing time periods.

[1174] 6. When the user selects 2:00 PM, the information is sent to the server and the meeting is set up by updating the executive's calendar.

[1175] 7. A message will be automatically sent to the person making the adjustment, and if there is a reply, the user will be notified via the server.

[1176] 8. After the meeting, the user enters the necessary information into the feedback form on the terminal, and the server automatically generates a report and distributes it to the relevant parties.

[1177] Prompt Sentence Examples

[1178] "A user wants to meet at 2 PM next Wednesday. Please retrieve the calendar information of the person in charge, check their availability, and provide possible dates and times."

[1179] The above is an embodiment of the present invention that combines an emotion engine. This system enables optimal schedule adjustment that takes into account the user's emotions, contributing to improved work efficiency.

[1180] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1181] Step 1:

[1182] The user performs an operation to input a desired date and time.

[1183] Input: The user inputs the desired schedule date and time (e.g., 2:00 p.m. next Wednesday) into the terminal.

[1184] Specific operation: Using the device's calendar or time picker, the user selects "Next Wednesday at 2:00 PM" and presses the "Adjust Schedule" button.

[1185] Output: The selected date and time data is saved to the terminal and sent to the next processing step.

[1186] Step 2:

[1187] The terminal transmits the desired date and time to the server.

[1188] Input: The date and time data selected in step 1.

[1189] Specific operation: The terminal sends the selected date and time data to the server as a POST request.

[1190] Output: The server receives the desired date and time data.

[1191] Step 3:

[1192] The server acquires the time management information of the manager.

[1193] Input: User's desired date and time data.

[1194] Specific operation: The server sends a request such as "GET / calendar?date=YYYYMMDD" to the manager's calendar API and obtains the manager's calendar information as a response.

[1195] Output: The calendar information of the manager is retrieved to the server.

[1196] Step 4:

[1197] The server analyzes the free time of the manager.

[1198] Input: Calendar information of the retrieved manager.

[1199] Specific operation: The server extracts the time periods with a "Free" status from the acquired calendar information and converts them into a format such as "2:00 PM to 3:00 PM."

[1200] Output: Free / busy data of executives.

[1201] Step 5:

[1202] The server compares the user's desired date and time with the free time of the manager and generates candidate dates and times.

[1203] Input: User's desired date and time data and manager's free time data.

[1204] Specific operation: The server uses a matching algorithm to select candidate dates and times that are available close to the user's desired date and time (e.g., 2:00 PM or 3:00 PM).

[1205] Output: A list of candidate dates and times.

[1206] Step 6:

[1207] The server analyzes the user's emotion data using an emotion engine.

[1208] Input: candidate date and time list, user facial expression data, voice data, input content.

[1209] Specific operation: Using the emotion engine, the user's stress level and fatigue level are analyzed, and emotional data such as "high stress" and "relaxed" is calculated.

[1210] Output: Analysis results and a list of optimal candidate dates and times, including sentiment data.

[1211] Step 7:

[1212] The server sends a list of optimal candidate dates and times to the terminal.

[1213] Input: Analysis results and a list of optimal candidate dates and times including sentiment data.

[1214] Specific operation: The server serializes the list of optimal candidate dates and times into JSON format and sends it to the device as a response.

[1215] Output: The terminal displays the received candidate date and time list.

[1216] Step 8:

[1217] The user selects and confirms a candidate date and time.

[1218] Input: A list of best candidate dates and times.

[1219] Specific operation: The user selects the desired date and time (e.g., 2:00 PM) from the list of candidate dates and times and presses the "Confirm" button.

[1220] Output: The selected date and time data.

[1221] Step 9:

[1222] The terminal transmits the selected date and time data to the server.

[1223] Input: Date and time data selected by the user.

[1224] Specific operation: The terminal sends the selected data to the server as a POST request.

[1225] Output: The server receives the selection data.

[1226] Step 10:

[1227] The server reflects the date and time in the schedule management tool of the executive.

[1228] Input: Selected date and time data.

[1229] Specific operation: The server sends a request to the executive's calendar API to add a schedule using "POST / calendar / events".

[1230] Output: The executive's calendar is updated and the meeting is confirmed.

[1231] Step 11:

[1232] The server contacts the coordinating party to adjust the schedule.

[1233] Input: Selected date and time data and contact information for the person you want to adjust.

[1234] Specific operation: The server retrieves the contact information of the person being coordinated from a central database, automatically selects the most appropriate means of communication (email, phone, messaging service, etc.), and sends the notification.

[1235] Output: A schedule confirmation request is sent to the coordinator.

[1236] Step 12:

[1237] The server centralizes the replies and notifies the user.

[1238] Input: Reply data from the adjustment destination.

[1239] Specific operation: When the server receives the reply data, it notifies the user via push notification or email.

[1240] Output: The user is notified of the reply from the adjustment destination.

[1241] Step 13:

[1242] After the meeting, the device provides a feedback form.

[1243] Input: State after meeting ends.

[1244] Specific behavior: The device displays a form for the user to enter feedback or report details.

[1245] Output: The user enters the required information into the form.

[1246] Step 14:

[1247] The terminal transmits the input feedback data to the server.

[1248] Input: Feedback data entered by the user.

[1249] Specific operation: The terminal sends the input data to the server as a POST request.

[1250] Output: The server receives the feedback data.

[1251] Step 15:

[1252] The server generates and distributes reports based on the feedback data.

[1253] Input: Feedback data entered by the user.

[1254] Specific operation: The server embeds the feedback data into the template, automatically generates a report, and distributes it to relevant parties by email.

[1255] Output: The generated report is distributed to the email addresses of the relevant parties and stored in a database.

[1256] The above is the flow of specific processing steps of this system, which allows users to adjust their schedules optimally while taking their emotions into consideration, thereby improving work efficiency.

[1257] (Application example 2)

[1258] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1259] Conventional schedule adjustment systems propose schedules without taking the user's emotional state into consideration, which can lead to stress and fatigue. Furthermore, there is a lack of means to grasp the driver's emotional state while driving and suggest appropriate rest stops or schedule changes, leaving issues in terms of safety and operational efficiency. The present invention aims to solve these issues by analyzing the user's emotions and suggesting optimal schedule adjustments and driving routes based on that analysis.

[1260] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1261] In this invention, the server includes means for analyzing the user's emotional data in real time and calculating emotional data such as stress level and fatigue level, means for preferentially presenting optimal candidate dates and times for the user based on the calculated emotional data, and means for acquiring actual driving route information and suggesting rest points based on the emotional data. This makes it possible to adjust the schedule and suggest rest points optimally taking the user's emotional state into consideration, and is expected to improve the user's work efficiency and safety.

[1262] "Position holder" refers to a person who holds a managerial or high-ranking position in a company or organization.

[1263] "Calendar Information" means electronic or physical time management data that records schedules and appointments.

[1264] "Interface" refers to the part that provides the input and output means for a user to interact with a system or application.

[1265] "Matching" refers to the process of matching the user's desired date and time with the availability of officials to find the best option.

[1266] A "database" refers to an organized collection of data for efficiently storing, managing, and retrieving information.

[1267] "Contact Methods" refers to methods and tools for communication, such as email, telephone, messaging services, etc.

[1268] "Emotional data" refers to information that indicates the user's emotional state, such as stress level or fatigue level, analyzed from facial expressions, voice, input content, etc.

[1269] "Rest points" are places where drivers can take a break while driving, including service areas and rest areas.

[1270] This invention is a system that acquires calendar information from managers, adjusts schedules optimally, analyzes the emotional state of drivers in real time while they are driving, and suggests appropriate rest stops. Specific embodiments of this system will be described in detail below.

[1271] Overview of the emotion analysis and schedule adjustment system

[1272] When a user uses the system interface to input a desired date and time, the terminal sends this information to the server. The server obtains the manager's calendar information and lists available time slots. Using a matching means, the server compares the user's desired date and time with the manager's available time slots and presents the user with the most suitable candidate date and time. At this point, the emotion engine analyzes the user's emotion data in real time and calculates stress levels and fatigue levels. Based on the emotion data, the most suitable candidate date and time for the user is displayed with priority. When the user confirms the selected date and time, the information is sent to the server and the manager's calendar is updated.

[1273] Overview of Autonomous Driving Assistance System

[1274] While a user is traveling in an autonomous vehicle, the device uses sensors such as a camera and microphone to acquire emotional data from the user's facial expressions and voice. The emotion engine analyzes this data and calculates stress levels and fatigue levels. The server combines the analyzed emotional data with driving route information to suggest optimal rest stops. The suggested rest stops are displayed on the device's display in real time, allowing the user to take a break while continuing to drive.

[1275] Hardware and Software Used

[1276] Emotion analysis engine: Uses Affectiva, Microsoft Azure Face API, etc.

[1277] Sensors: camera, microphone.

[1278] Server: The center of data analysis and information transmission and reception.

[1279] Terminal: A device that provides an interface for users to operate (e.g., a smartphone or an in-vehicle display).

[1280] Network communication: Data communication between the terminal and the server.

[1281] Operation example

[1282] For example, when a driver of an autonomous truck is driving from a starting point to a destination, the EAS (Emotion-Aware Auto Scheduler) analyzes the driver's emotional data in real time. If the driver's stress level or fatigue level is high, the EAS will display the nearest service area or rest stop on the display. The following prompt sentence is used:

[1283] "If the current stress level is high, a break is required within the next two hours. Please suggest the best time to rest for a driver with a stress level of 70 and fatigue level of 80."

[1284] Output format

[1285] The system can link users' emotional data with schedule information in real time and suggest appropriate measures. In this way, a system can be built that improves users' work efficiency and safety.

[1286] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1287] Step 1:

[1288] The user adjusts the schedule and inputs driving route information using the terminal interface, including the desired date and time, departure point, and destination.

[1289] Input: desired date and time, departure point, destination

[1290] Output: Sending input information to the server

[1291] Step 2:

[1292] The server retrieves the calendar information of the manager based on the received information, lists the available time slots, and queries the latest calendar information using the calendar API.

[1293] Input: desired date and time, calendar API request

[1294] Output: A list of available time slots

[1295] Step 3:

[1296] A matching means checks the user's desired date and time against the available time of the manager, and selects the most suitable candidate date and time.

[1297] Input: Desired date and time, list of available time slots

[1298] Output: A list of best candidate dates and times

[1299] Step 4:

[1300] The server sends a list of candidate dates and times to the terminal, which displays it to the user.

[1301] Input: A list of best candidate dates and times

[1302] Output: Display of candidate dates and times

[1303] Step 5:

[1304] The user selects from the candidate dates and times, and transmits information from the terminal to the server to confirm the selected date and time.

[1305] Input: Selected date and time

[1306] Output: Confirmation date and time sent to the server

[1307] Step 6:

[1308] The server reflects the confirmed date and time on the manager's calendar and updates the calendar information using the calendar API.

[1309] Input: Confirmed date and time

[1310] Output: Calendar updates

[1311] Step 7:

[1312] The device captures the user's facial expressions and voice through a camera and microphone to obtain emotional data.

[1313] Input: facial expressions, voice data

[1314] Output: Emotion data

[1315] Step 8:

[1316] The server's emotion engine analyzes the captured data and calculates the user's stress level and fatigue level.

[1317] Input: Emotion data

[1318] Output: Stress level, fatigue level

[1319] Step 9:

[1320] Based on the calculated emotion data, the server prioritizes and presents optimal candidate dates, times, and rest points.

[1321] Input: Stress level, fatigue level

[1322] Output: Best candidate date and time, rest point

[1323] Step 10:

[1324] The optimal candidate dates, times and rest points are displayed on the user's device, and the user makes a selection.

[1325] Input: Best candidate date and time, rest point

[1326] Output: Selected date and time, break point confirmation

[1327] Step 11:

[1328] After the meeting or driving is over, the terminal provides the user with a form for inputting feedback or reports, and transmits the input data to the server.

[1329] Input: Feedback, report content

[1330] Output: Sending feedback data to the server

[1331] Step 12:

[1332] The server automatically generates reports based on the feedback and reports, distributes them to the relevant parties, and stores the generated reports in a database.

[1333] Input: Feedback, report content

[1334] Output: Report generation, report distribution, saving to database

[1335] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1336] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1337] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1338] [Fourth embodiment]

[1339] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1340] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1341] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1342] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1343] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1344] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1345] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1346] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1347] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1348] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1349] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1350] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1351] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1352] This invention relates to a system that handles everything from scheduling with managers to post-processing within the company. The system is composed of a server, terminals, and users.

[1353] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[1354] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[1355] Next, the user selects an appropriate date and time from the displayed list of suggested dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate scheduling with the executive.

[1356] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. The information about the parties includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then sends a schedule adjustment request to the parties involved using the selected means of contact. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[1357] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[1358] Specific examples

[1359] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that the manager is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the device, which then presents the user with candidate dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[1360] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[1361] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[1362] The above is an embodiment of the present invention. By using this system, the complexity of schedule adjustment can be reduced and work efficiency can be improved.

[1363] The processing flow will be explained below.

[1364] Step 1:

[1365] The user inputs the desired date and time through the device interface. The user can enter a specific date and time, and can also specify the type of meeting and the required participants.

[1366] Step 2:

[1367] The terminal sends the input information to the server, which generates a request to acquire the calendar information of the manager based on the received information.

[1368] Step 3:

[1369] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots, thereby confirming whether the manager is available at the set date and time.

[1370] Step 4:

[1371] The server compares the user's desired date and time with the manager's available time. If the desired date and time is not available, it lists the next best possible date and time.

[1372] Step 5:

[1373] The server sends the candidate dates and times to the terminal, which displays the candidate dates and times to the user on its interface, and the user selects the most suitable date and time from the displayed candidate dates and times.

[1374] Step 6:

[1375] The user selects a candidate date and time and sends the confirmation information from the terminal to the server, which then updates the manager's calendar with the selected date and time and officially reserves the meeting.

[1376] Step 7:

[1377] When a user coordinates schedules with multiple contacts, the terminal inputs the contact information of the contacts, and the server stores the received contact information in a database.

[1378] Step 8:

[1379] The server automatically selects the optimal means of contact based on the contact information of each coordination target. For example, if an email address is registered, it will select email, and if a messaging service ID is registered, it will select that service.

[1380] Step 9:

[1381] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[1382] Step 10:

[1383] The server receives replies from each coordination destination and manages them in a unified manner. Based on the received information, the server performs a final confirmation of the schedule and notifies the user.

[1384] Step 11:

[1385] After the meeting or visit to the client is completed, the terminal provides a form in which the user can enter feedback or report details. The user enters the necessary information in the form and submits it.

[1386] Step 12:

[1387] The server automatically generates a report based on the received feedback information, and the generated report is sent from the server so that it can be automatically distributed to the relevant parties.

[1388] Step 13:

[1389] The server stores the generated reports in a database for future reference and analysis.

[1390] Example 1

[1391] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1392] Conventional scheduling methods are cumbersome and time-consuming, so there is a need for more efficient work. Furthermore, because multiple contacts and communication methods with senior executives are managed separately, there is also the issue of difficulty in integrated communication management. Preparing reports after meetings and visits also takes time and effort, resulting in delays in work and the loss of information. To solve these issues, the present invention calls for a system that can automate a series of business processes and efficiently manage them.

[1393] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1394] In this invention, the server includes means for acquiring calendar information of the manager and listing available time slots, means for providing an interface for the user to input a desired date and time, means for matching the user's desired date and time with the manager's available time slots to find the most suitable candidate date and time, means for displaying the candidate date and time to the user, means for confirming the date and time selected by the user and updating the calendar, means for centrally managing contact information of the person in charge of coordination in a database and automatically selecting the most suitable means of communication, means for contacting the person in charge of coordination using the most suitable means of communication, confirming the schedule and receiving a reply, means for notifying the user of a valid reply, means for automatically generating a report after the meeting or visit, means for automatically distributing the report to relevant parties, means for saving the generated report in a database, and means for providing a form for the user to easily input feedback and report content. This enables efficient schedule coordination, centralized contact management, and rapid report generation after meetings.

[1395] "Calendar information of managerial personnel" is data of an electronic calendar in which the schedule and free time of managerial personnel are recorded.

[1396] The "means of listing available time slots" is a function that analyzes calendar information and extracts and lists available time slots in the schedules of managers.

[1397] The "interface for inputting the user's desired date and time" refers to an input screen or form that allows the user to intuitively and easily input the desired date and time.

[1398] The "means for matching optimal candidate dates and times" is an algorithm or function that compares the user's desired date and time with the manager's available time, and selects the date and time that best meets both conditions.

[1399] The "means for displaying candidate dates and times to the user" is a function for displaying the best matched candidate dates and times on the terminal screen and allowing the user to select one.

[1400] "Means to confirm the date and time selected by the user and reflect it on the calendar" is a function that finalizes the date and time selected by the user and adds / updates that information to the manager's calendar.

[1401] "Means for centrally managing contact information of coordination parties in a database" refers to a function that aggregates and manages contact information of coordination parties (email addresses, telephone numbers, messaging service IDs, etc.) in a database.

[1402] "Means for automatically selecting the most appropriate means of communication" is a function that automatically selects the most appropriate means of communication (email, telephone, messaging service, etc.) depending on the situation and the other party's contact information.

[1403] "Means of contacting the person to be coordinated using the most appropriate means of communication, confirming the schedule, and receiving a reply" is a function of contacting the person to be coordinated using the selected means of communication, confirming the schedule, and receiving a reply.

[1404] The "means for notifying the user of a valid reply" is a function for notifying the user of valid reply information from the adjustment destination.

[1405] "Means for automatically generating reports after a meeting or visit" is a function that automatically creates a report after a meeting or visit has ended.

[1406] "Means for automatically distributing reports to interested parties" refers to a function for automatically distributing generated reports to interested parties via email or other appropriate means.

[1407] "Means for saving generated reports in a database" is a function that saves the created reports in a database so that they can be referenced and analyzed at a later date.

[1408] The "means for providing a form that allows users to easily input feedback and report content" is a function that provides an input form that allows users to easily input feedback and report content after a visit.

[1409] This invention relates to a system that handles everything from scheduling with executives to post-processing within the company. Specifically, it is composed of a server, terminals, and users as its main elements. Each element of the system and its specific processing method are described below.

[1410] System Configuration

[1411] First, a terminal is a device operated by a user, and includes hardware such as a PC, tablet, or smartphone. The terminal is provided with an intuitive graphical user interface (GUI) that allows users to easily select and enter the desired date and time. It also has a form for users to enter feedback and reports.

[1412] The server functions as a central management system and is responsible for large-scale data processing and storage management. It includes a database system that stores various data such as calendar information for executives, contact information for coordination partners, and generated reports. The server also has programs that run schedule adjustment algorithms and communication method selection algorithms.

[1413] System Operation

[1414] When a user wishes to meet with a senior executive, they input the desired date and time into the system using their terminal. At this time, a calendar-style interface is displayed on the terminal, allowing the user to operate it intuitively.

[1415] The server retrieves the manager's calendar information from the database. This calendar information includes the manager's existing reservations and free time. The server then analyzes the retrieved calendar information and lists the manager's free time slots. As a result, the user's desired date and time are optimally matched with the manager's free time. The matching results are sent from the server to the terminal and displayed to the user.

[1416] Next, the user selects the appropriate date and time from the displayed list of options. Once the selection is confirmed, the information is sent to the server and reflected in the executive's calendar, officially booking the meeting.

[1417] Furthermore, even if there are many parties involved in the coordination or different means of contact, the server centrally manages the contact information for each party in a database. This information includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of contact. The server then uses the selected means of contact to send a schedule adjustment request to the party involved. Responses from the parties involved are also centrally managed on the server, and are notified to the user.

[1418] After a meeting or client visit, the terminal provides a form that allows users to easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and is also saved in a database for later reference and analysis.

[1419] Specific examples

[1420] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their terminal. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal and presents the user with candidate dates and times for 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[1421] Similarly, when a user adjusts schedules with multiple coordinating parties, the server automatically retrieves the contact information for each coordinating party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[1422] After the meeting, participants can enter a summary of the meeting and feedback into a form on their device, and a report is automatically generated on the server and distributed to the relevant parties. This report is also saved in the database for future reference and analysis.

[1423] Prompt Sentence Examples

[1424] "If a user wants to schedule a meeting with an executive next Wednesday at 2 PM, how does the system handle this? Please provide specific steps."

[1425] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1426] Step 1:

[1427] The user inputs the desired date and time.

[1428] Input: The specific date and time the user would like to meet (e.g., next Wednesday at 2pm).

[1429] Specific operations: Operate the device's calendar interface, select the desired date and time, and press the OK button.

[1430] Output: The user's desired date and time data is sent to the server.

[1431] Step 2:

[1432] The server obtains the calendar information of the manager.

[1433] Input: The role ID that the server uses to retrieve the role's calendar information from the database.

[1434] Specific operation: The server executes an SQL query to retrieve the executive's schedule and free time from the database.

[1435] Output: Calendar information data of the executives is imported to the server.

[1436] Step 3:

[1437] The server analyzes the calendar information of the executives and lists their available time slots.

[1438] Input: Calendar information of the retrieved executive.

[1439] Specific operation: An analysis algorithm in the server analyzes calendar information and lists the free time of executives.

[1440] Output: A list of available time slots for executives is generated.

[1441] Step 4:

[1442] The server compares the user's desired date and time with the manager's free time and matches the most suitable candidate date and time.

[1443] Input: A list of the user's preferred date and time and the manager's available time slots.

[1444] Specific operation: The server uses a matching algorithm to compare the user's desired date and time with the manager's available time, and determines the best possible date and time that do not overlap.

[1445] Output: A list of optimal candidate dates and times is generated.

[1446] Step 5:

[1447] The server transmits the optimal candidate dates and times to the terminal and displays them to the user.

[1448] Input: A list of best candidate dates and times.

[1449] Specific operation: The server sends a list of candidate dates and times to the device via API. The device receives it and displays it to the user.

[1450] Output: A list of candidate dates and times will be displayed on the device screen.

[1451] Step 6:

[1452] The user selects an appropriate date and time from the displayed candidate dates and times.

[1453] Input: A user-selected date and time (e.g., 2 PM).

[1454] Specific operation: The user selects the desired date and time from the list of candidate dates and times on the screen and presses the confirm button.

[1455] Output: The date and time data selected by the user is sent to the server.

[1456] Step 7:

[1457] The server reflects the selected date and time on the manager's calendar.

[1458] Input: User selected date and time data and the officer's calendar information.

[1459] Specific operation: The server calls the calendar update API and adds the selected date and time to the executive's calendar.

[1460] Output: Updated calendar information for the executive.

[1461] Step 8:

[1462] The server obtains contact information for each coordination party and automatically selects the most appropriate means of contact.

[1463] Input: ID of each adjustment target.

[1464] Specific operation: The server retrieves contact information for each coordination target from the database and runs the contact method selection algorithm.

[1465] Output: A list of optimal contact methods is generated.

[1466] Step 9:

[1467] The server contacts the coordination destination using the selected optimal contact means, confirms the schedule, and obtains a reply.

[1468] Input: A list of best contact methods and contact information for coordination.

[1469] Specific operation: The server uses an email sending API or messaging service API to send a schedule confirmation request to the coordination destination.

[1470] Output: The request message sent to the reconciliation destination.

[1471] Step 10:

[1472] The server receives a valid reply from the adjuster and notifies the user.

[1473] Input: Reply data from the adjustment destination.

[1474] Specific operation: The server saves the reply content in the database and calls the notification API to notify the user.

[1475] Output: A notification message that will be displayed on the user's terminal.

[1476] Step 11:

[1477] The terminal provides a feedback input form after the meeting or visit.

[1478] Input: Feedback after meetings and visits.

[1479] What happens: The device displays a form and the user submits the input.

[1480] Output: The feedback is sent to the server.

[1481] Step 12:

[1482] The server automatically generates a report based on the feedback and distributes it to relevant parties.

[1483] Input: Feedback data.

[1484] What happens: The server runs the report generation algorithm and emails the generated report to the relevant parties.

[1485] Output: Generated report and report email sent to stakeholders.

[1486] Step 13:

[1487] The server stores the generated reports in a database.

[1488] Input: Generated report data.

[1489] Specific behavior: The server saves the report data to the database.

[1490] Output: Report data stored in a database.

[1491] (Application example 1)

[1492] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1493] In conventional virtual stores, scheduling appointments between users and sales staff is often done manually, requiring a lot of time and effort. Feedback and report creation after the shopping experience are also often done manually, creating issues with operational efficiency. For this reason, there was a need for a system that could automate scheduling between users and sales staff and streamline the creation of reports after the shopping experience.

[1494] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1495] In this invention, the server includes a means for acquiring calendar information from managers and listing available time slots, a means for providing an interface for users to input their desired date and time, and a means for matching the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. This makes it possible to automatically arrange appointments between users and sales staff in a virtual store. Furthermore, by including a means for generating and saving feedback and reports after the shopping experience is completed, work efficiency can be improved.

[1496] A "manager" is someone who holds a specific position within a company and has decision-making power and responsibility.

[1497] "Calendar information" is information that records data on the schedules and free time of managers.

[1498] "Interface" is a general term for software or hardware that provides a screen or operating means for users to interact with a system.

[1499] "Matching" is the process of comparing the user's desired date and time with the available time of the manager and selecting the most suitable date and time.

[1500] A "database" is an integrated data storage device or system that centrally manages and stores large amounts of data and allows for quick search and reference as needed.

[1501] A "virtual store" is a virtual store operated on the Internet where users can purchase goods and services online.

[1502] "Sales staff" refers to people or AI assistants who are responsible for introducing and selling products and services in the virtual store.

[1503] An "appointment" is a scheduled interview or meeting between a user and a sales staff member or a person in a higher position.

[1504] A "report" is a document that summarizes feedback and reports from a meeting or shopping experience.

[1505] "Feedback" refers to the ratings, opinions, and impressions that users provide after a meeting or shopping experience.

[1506] The present invention is a system that performs all processes from scheduling with managers to post-processing within the company, and a specific embodiment thereof is described below. The system is composed of a server, terminals, and users.

[1507] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[1508] The server acquires the manager's calendar information. This calendar information includes the manager's existing reservations and free time. The server analyzes the calendar information and lists the manager's free time slots. The server then compares the user's desired date and time with the manager's free time to find the most suitable candidate date and time. The matching results are sent from the server to the terminal and displayed to the user.

[1509] Next, the user selects an appropriate date and time from the displayed candidate dates and times. Once the selection is confirmed, the server updates the executive's calendar with that date and time, officially reserving the meeting. This process ensures fast and accurate schedule coordination with executives. Furthermore, even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database. The information for each party includes email addresses, phone numbers, messaging service IDs, etc., and the server automatically selects the most appropriate means of communication. The server then sends a schedule coordination request to the party using the selected means of communication. Responses from the parties are also centrally managed by the server, and the user is notified of these.

[1510] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[1511] When this system is applied to a virtual store, it functions as a virtual shopping assistant that automatically arranges appointments with virtual store staff based on the user's desired date and time, and automatically generates feedback and reports after the appointment is completed. The user inputs the desired date and time using a terminal, and the server compares the staff's available times to suggest the optimal slot. Once the suggestion is confirmed, the appointment is smoothly arranged. After the appointment is completed, the terminal provides a feedback form, and the server automatically generates a report based on the user's input and distributes it to the relevant parties.

[1512] As a specific example, if a user wishes to have a shopping experience in a virtual store and wants to set an appointment for next Wednesday at 2:00 PM, they enter that information into their terminal. The server retrieves the staff member's calendar information and confirms that they are free at 2:00 PM and 3:00 PM next Wednesday. The server sends that information to the terminal, which then presents the user with possible dates and times of 2:00 PM and 3:00 PM. When the user selects 2:00 PM, that information is sent to the server, and the staff member's calendar is updated, completing the appointment setting. After the shopping experience is over, feedback and other information can be entered into a form on the terminal, and the server automatically generates and distributes a report and stores it in a database.

[1513] The following types of hardware and software are used in implementing this system:

[1514] Hardware: Personal computers, smartphones, tablets, and other devices that can connect to the internet

[1515] Software: Calendar management software, database software, interface design software

[1516] Examples of prompts that provide specific examples to generative AI models include:

[1517] "Compare the user's desired date and time (e.g., next Wednesday at 2 PM) with the staff's available time and confirm the optimal date and time. Notify them of the confirmed date and time and generate a report."

[1518] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1519] Step 1:

[1520] The user inputs the desired date and time using the terminal. The terminal interface is designed to be intuitive, allowing for easy selection of date and time. The input desired date and time is sent to the server. Input data: User's desired date and time. Output data: Desired date and time sent to the server.

[1521] Step 2:

[1522] The server obtains the manager's calendar information. The obtained calendar information includes the manager's existing schedules and free time. The server uses calendar management software to list the manager's free time slots. Input data: Manager's calendar information. Output data: List of free time slots for the manager.

[1523] Step 3:

[1524] The server compares the user's desired date and time with the manager's available time slots and performs data calculations to match the optimal candidate date and time. Calendar management software is used to select the available slot closest to the desired date and time. Input data: User's desired date and time and a list of available time slots for the manager. Output data: A list of optimal candidate dates and times.

[1525] Step 4:

[1526] The server sends the optimal candidate dates and times to the user's device. The device displays the received list of candidate dates and times to the user. Input data: List of optimal candidate dates and times. Output data: Candidate dates and times displayed to the user.

[1527] Step 5:

[1528] The user selects the appropriate date and time from the displayed candidate dates and times and sends it to the server via the terminal. Input data: The date and time selected by the user. Output data: The confirmed date and time sent to the server.

[1529] Step 6:

[1530] The server reflects the selected date and time on the executive's calendar. Furthermore, the server centrally manages the contact information of the person in charge in a database and automatically selects the most appropriate means of contact. The means of contact used may include email, telephone, messaging services, etc. Input data: The confirmed date and time selected by the user. Output data: The date and time reflected on the executive's calendar and the contact request sent.

[1531] Step 7:

[1532] The server uses the most appropriate communication method to send a schedule adjustment request to the coordination partner and obtains a reply. The obtained reply is centrally managed within the system and notified to the user. Input data: The sent schedule adjustment request. Output data: The obtained reply and notification to the user.

[1533] Step 8:

[1534] After a meeting or client visit is completed, the user enters feedback or reports into a form on the terminal. The entered information is sent to the server. Input data: Feedback or reports. Output data: Feedback or reports sent to the server.

[1535] Step 9:

[1536] The server automatically generates reports based on the input feedback and report content. The generated reports are automatically distributed to the relevant parties and saved in the database. Input data: Feedback and report content. Output data: Generated reports and reports saved in the database.

[1537] Step 10:

[1538] The same steps as above are applied in virtual stores, where appointments between users and sales staff are automatically arranged, and feedback and reports are automatically generated, distributed, and saved after the shopping experience. Specifically, the desired date and time is entered using a terminal, and the server compares this with the staff's available times to suggest the optimal slot. Input data: User's desired date and time and staff calendar information. Output data: Confirmed appointment and generated report.

[1539] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1540] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company, allowing it to recognize the user's emotions and provide optimal scheduling.

[1541] When a user wishes to adjust their schedule, they first input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time.

[1542] The device sends the entered information to the server. Based on the received information, the server generates a request to obtain the manager's calendar information. The server obtains the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. The server then compares the user's desired date and time with the manager's available time slots to find the optimal candidate date and time. The matching results are sent from the server to the device and displayed to the user.

[1543] Furthermore, this invention incorporates an emotion engine that analyzes the user's emotions in real time. The emotion engine analyzes the user's facial expressions, voice, input content, etc., and calculates emotion data such as stress level and fatigue level. Based on this emotion data, the server preferentially presents the most appropriate date and time for the user.

[1544] The user selects a candidate date and time and sends the confirmation information from the terminal to the server. The server then updates the executive's calendar with the date and time and officially reserves the meeting. Even if there are many parties involved or different means of communication, the server centrally manages the contact information for each party in a database and automatically selects the most appropriate means of communication. The server then sends a schedule adjustment request to the parties involved using the selected means of communication. Responses from the parties involved are also centrally managed by the server and are notified to the user.

[1545] After a meeting or client visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. This report is automatically distributed to the relevant parties and also saved in a database for later reference and analysis.

[1546] Specific examples

[1547] For example, if a user wants to schedule a meeting with a manager at 2:00 PM next Wednesday, they enter that information into their device. The server retrieves the manager's calendar information and confirms that he or she is free at 2:00 PM and 3:00 PM next Wednesday. The server then sends that information to the device, which then presents the user with candidate dates and times for 2:00 PM and 3:00 PM. If the emotion engine then analyzes the user's stress level and determines that the user is in a high-stress state, the device will prioritize displaying a time slot that the user can use to relax. When the user selects 2:00 PM, that information is sent to the server, and the manager's calendar is updated, completing the meeting setup.

[1548] Furthermore, when a user adjusts schedules with multiple parties, the server automatically retrieves the contact information for each party and sends a schedule adjustment request using the appropriate communication method. As soon as a reply is received, the user is notified, and the entire adjustment process is completed quickly.

[1549] After the meeting, users enter a summary of the meeting and their feedback into a form on their device, and the emotion engine analyzes the user's emotional data. Based on this, the server automatically generates a report and distributes it to the relevant parties. The generated report is also saved in a database for future reference and analysis.

[1550] The above is an embodiment of the present invention that combines an emotion engine. By using this system, optimal schedule adjustments can be made taking into account the user's emotions, contributing to improved work efficiency.

[1551] The processing flow will be explained below.

[1552] Step 1:

[1553] The user inputs the desired date and time and the meeting details through the terminal interface. For example, the user inputs that they want to set up a meeting for next Wednesday at 2:00 PM.

[1554] Step 2:

[1555] The terminal sends the input information to the server, which generates a request to obtain the manager's calendar information based on the desired date and time and meeting details received.

[1556] Step 3:

[1557] The server retrieves the latest calendar information from the manager's calendar API and analyzes the manager's available time slots. For example, it analyzes that the manager is available at 2:00 PM and 3:00 PM next Wednesday.

[1558] Step 4:

[1559] The server compares the user's desired date and time with the manager's available time, and lists the most suitable candidate dates and times. If the user's desired date and time is not available, the next most suitable candidate date and time will also be included in the list.

[1560] Step 5:

[1561] The server sends the list of candidate dates to the terminal, which displays the candidate dates to the user on the interface.

[1562] Step 6:

[1563] The user selects an appropriate date and time from the displayed candidate dates and times. For example, the user selects 2:00 PM and enters it into the terminal.

[1564] Step 7:

[1565] The terminal sends the selected date and time information to the server. The server updates the executive's calendar with the selected date and time, officially reserving the meeting, and sends a reservation completion notification to the terminal.

[1566] Step 8:

[1567] The server uses an emotion engine to analyze the user's input, voice, and facial expressions, and calculates the user's emotion data. For example, the emotion engine may detect that the user's stress level is high.

[1568] Step 9:

[1569] Based on the emotion data calculated by the emotion engine, the server will suggest the optimal schedule for the user. For example, if the user's stress level is high, it will suggest a time when they can relax.

[1570] Step 10:

[1571] When a user coordinates schedules with multiple parties, the terminal inputs the contact information of the parties, for example, the email address of business partner A and the messaging service ID of business partner B.

[1572] Step 11:

[1573] The server stores the received contact information in a database. Based on the stored contact information, the server automatically selects the most appropriate means of communication. For example, it selects email for client A and a messaging service for client B.

[1574] Step 12:

[1575] The server sends a schedule adjustment request to each of the adjustment destinations using the selected contact method and waits for a response from each of the adjustment destinations.

[1576] Step 13:

[1577] The server receives replies from each coordination destination and manages them in a unified manner. The server performs a final confirmation of the schedule based on the received information and notifies the user.

[1578] Step 14:

[1579] After a meeting or a client visit is completed, the terminal provides a form in which the user can enter feedback or a report. The user inputs the required information into the form.

[1580] Step 15:

[1581] The device sends the input feedback information to the server, which then automatically generates a report based on the received feedback information.

[1582] Step 16:

[1583] The server automatically distributes the generated reports to the relevant parties and stores them in a database for future reference and analysis.

[1584] These are the specific processing steps of the system that combines the emotion engine. By taking the user's emotions into consideration, more flexible and effective schedule adjustment becomes possible.

[1585] Example 2

[1586] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1587] Conventional schedule adjustment systems can match users with managers' free time and finalize schedules, but it is difficult to present an optimal schedule that takes into account the user's emotions and state. Furthermore, they lack the functionality to optimize communication methods after schedule adjustments or to automatically provide feedback and reports after meetings, which can lead to problems with reduced work efficiency. This can lead to users continuing to work under high stress, which can result in a decline in work performance.

[1588] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: means for acquiring the time management information of the manager and listing available time slots; means for providing an interface for the user to input a desired date and time; means for matching the user's desired date and time with the manager's available time to find optimal candidate dates and times; means for displaying the candidate dates and times to the user; means for confirming the user's selected date and time and reflecting it in the schedule management tool; means for centrally managing the contact information of the person to be coordinated in a central database and automatically selecting the optimal contact method; means for contacting the person to be coordinated using the optimal contact method, confirming the schedule and receiving a reply; means for notifying the user of a valid reply; means for automatically generating a report after the meeting or visit; means for automatically distributing the report to relevant parties; means for saving the generated report in a database; and means for including an emotion engine that analyzes the user's emotions in real time and presenting optimal candidate dates and times to the user based on the emotion data. This enables optimal schedule adjustments that take the user's emotions and state into consideration, significantly improving work efficiency.

[1589] "Managerial personnel time management information" is data from calendars and schedule management tools that includes managerial personnel schedules and available time slots.

[1590] An "interface" is a screen or operating means that makes it easy for the user to input the desired date and time.

[1591] The "matching means" refers to an algorithm or program that compares the user's desired date and time with the manager's available time and selects the most suitable candidate date and time.

[1592] "Candidate dates and times" refers to multiple dates and times selected by comparing the user's desired dates and times with the manager's available time.

[1593] A "schedule management tool" is software or a system for managing the schedules of executives and users.

[1594] The "central database" is a database for centrally managing contact information and schedule information for coordination parties.

[1595] An "emotion engine" is an algorithm or program that analyzes emotional data from a user's facial expressions, voice, input content, etc., and evaluates the state of the parasympathetic nervous system, etc.

[1596] A "report" is a document automatically generated after a meeting or visit, also known as a report.

[1597] "Automatic selection method" refers to an algorithm or program that automatically selects the most appropriate means of contacting the coordination party.

[1598] "Means of communication" refers to methods and devices for contacting the person being coordinated, such as email, telephone equipment, or messaging services.

[1599] This invention combines an emotion engine with a system that handles everything from scheduling with managers to post-processing within the company. This system recognizes the user's emotions and provides optimal schedule adjustments.

[1600] First, when a user wishes to adjust their schedule, they input their desired date and time into the system using a terminal. The terminal is provided with an interface that users can operate intuitively, allowing them to easily select the desired date and time using a calendar or time picker. The terminal then sends the input information to the server.

[1601] The server generates a request to retrieve the manager's time management information based on the received information. This includes a software module to retrieve the latest calendar information from the manager's calendar API. The server analyzes the data retrieved from the calendar API and extracts the manager's free time slots.

[1602] The server then compares the user's desired date and time with the manager's available time to find the most suitable candidate date and time. The server incorporates an emotion engine that analyzes emotional data in real time based on the user's facial expressions, voice, and input. The server evaluates the user's stress level and fatigue level based on the emotional data, and prioritizes presenting the most suitable candidate date and time for the user.

[1603] The proposed candidate dates and times are sent from the server to the terminal, which displays them to the user. When the user selects a candidate date and time, the information is sent back to the server. The server then updates the selected date and time in the executive's schedule management tool, officially reserving the meeting.

[1604] Furthermore, the server manages the contact information of the recipient in a central database and automatically selects the most appropriate means of communication (e.g., email, telephone device, or messaging service). The server then sends a schedule adjustment request to the recipient using the selected means of communication. Responses from the recipient are managed centrally by the server, and the user is notified of the response.

[1605] After a meeting or visit, the terminal provides a form where users can easily enter feedback and reports. Once the user enters the necessary information into this form, the server automatically generates a report. The generated report is automatically distributed to the relevant parties and saved in a database, making it available for future reference and analysis.

[1606] Specific examples

[1607] For example, if a user wants to schedule a meeting with an executive next Wednesday at 2pm, the following will work:

[1608] 1. The user types into the terminal, "I'd like to schedule a meeting next Wednesday at 2:00 PM."

[1609] 2. The device sends the information to the server.

[1610] 3. The server retrieves calendar information from the manager's calendar API and analyzes available time slots.

[1611] 4. The server compares the user's desired date and time with the manager's available time, generates a list of candidate dates and times, and sends it to the terminal.

[1612] 5. The emotion engine analyzes the user's stress level, and if the user is in a high stress state, the server prioritizes relaxing time periods.

[1613] 6. When the user selects 2:00 PM, the information is sent to the server and the meeting is set up by updating the executive's calendar.

[1614] 7. A message will be automatically sent to the person making the adjustment, and if there is a reply, the user will be notified via the server.

[1615] 8. After the meeting, the user enters the necessary information into the feedback form on the terminal, and the server automatically generates a report and distributes it to the relevant parties.

[1616] Prompt Sentence Examples

[1617] "A user wants to meet at 2 PM next Wednesday. Please retrieve the calendar information of the person in charge, check their availability, and provide possible dates and times."

[1618] The above is an embodiment of the present invention that combines an emotion engine. This system enables optimal schedule adjustment that takes into account the user's emotions, contributing to improved work efficiency.

[1619] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1620] Step 1:

[1621] The user performs an operation to input a desired date and time.

[1622] Input: The user inputs the desired schedule date and time (e.g., 2:00 p.m. next Wednesday) into the terminal.

[1623] Specific operation: Using the device's calendar or time picker, the user selects "Next Wednesday at 2:00 PM" and presses the "Adjust Schedule" button.

[1624] Output: The selected date and time data is saved to the terminal and sent to the next processing step.

[1625] Step 2:

[1626] The terminal transmits the desired date and time to the server.

[1627] Input: The date and time data selected in step 1.

[1628] Specific operation: The terminal sends the selected date and time data to the server as a POST request.

[1629] Output: The server receives the desired date and time data.

[1630] Step 3:

[1631] The server acquires the time management information of the manager.

[1632] Input: User's desired date and time data.

[1633] Specific operation: The server sends a request such as "GET / calendar?date=YYYYMMDD" to the manager's calendar API and obtains the manager's calendar information as a response.

[1634] Output: The calendar information of the manager is retrieved to the server.

[1635] Step 4:

[1636] The server analyzes the free time of the manager.

[1637] Input: Calendar information of the retrieved manager.

[1638] Specific operation: The server extracts the time periods with a "Free" status from the acquired calendar information and converts them into a format such as "2:00 PM to 3:00 PM."

[1639] Output: Free / busy data of executives.

[1640] Step 5:

[1641] The server compares the user's desired date and time with the free time of the manager and generates candidate dates and times.

[1642] Input: User's desired date and time data and manager's free time data.

[1643] Specific operation: The server uses a matching algorithm to select candidate dates and times that are available close to the user's desired date and time (e.g., 2:00 PM or 3:00 PM).

[1644] Output: A list of candidate dates and times.

[1645] Step 6:

[1646] The server analyzes the user's emotion data using an emotion engine.

[1647] Input: candidate date and time list, user facial expression data, voice data, input content.

[1648] Specific operation: Using the emotion engine, the user's stress level and fatigue level are analyzed, and emotional data such as "high stress" and "relaxed" is calculated.

[1649] Output: Analysis results and a list of optimal candidate dates and times, including sentiment data.

[1650] Step 7:

[1651] The server sends a list of optimal candidate dates and times to the terminal.

[1652] Input: Analysis results and a list of optimal candidate dates and times including sentiment data.

[1653] Specific operation: The server serializes the list of optimal candidate dates and times into JSON format and sends it to the device as a response.

[1654] Output: The terminal displays the received candidate date and time list.

[1655] Step 8:

[1656] The user selects and confirms a candidate date and time.

[1657] Input: A list of best candidate dates and times.

[1658] Specific operation: The user selects the desired date and time (e.g., 2:00 PM) from the list of candidate dates and times and presses the "Confirm" button.

[1659] Output: The selected date and time data.

[1660] Step 9:

[1661] The terminal transmits the selected date and time data to the server.

[1662] Input: Date and time data selected by the user.

[1663] Specific operation: The terminal sends the selected data to the server as a POST request.

[1664] Output: The server receives the selection data.

[1665] Step 10:

[1666] The server reflects the date and time in the schedule management tool of the executive.

[1667] Input: Selected date and time data.

[1668] Specific operation: The server sends a request to the executive's calendar API to add a schedule using "POST / calendar / events".

[1669] Output: The executive's calendar is updated and the meeting is confirmed.

[1670] Step 11:

[1671] The server contacts the coordinating party to adjust the schedule.

[1672] Input: Selected date and time data and contact information for the person you want to adjust.

[1673] Specific operation: The server retrieves the contact information of the person being coordinated from a central database, automatically selects the most appropriate means of communication (email, phone, messaging service, etc.), and sends the notification.

[1674] Output: A schedule confirmation request is sent to the coordinator.

[1675] Step 12:

[1676] The server centralizes the replies and notifies the user.

[1677] Input: Reply data from the adjustment destination.

[1678] Specific operation: When the server receives the reply data, it notifies the user via push notification or email.

[1679] Output: The user is notified of the reply from the adjustment destination.

[1680] Step 13:

[1681] After the meeting, the device provides a feedback form.

[1682] Input: State after meeting ends.

[1683] Specific behavior: The device displays a form for the user to enter feedback or report details.

[1684] Output: The user enters the required information into the form.

[1685] Step 14:

[1686] The terminal transmits the input feedback data to the server.

[1687] Input: Feedback data entered by the user.

[1688] Specific operation: The terminal sends the input data to the server as a POST request.

[1689] Output: The server receives the feedback data.

[1690] Step 15:

[1691] The server generates and distributes reports based on the feedback data.

[1692] Input: Feedback data entered by the user.

[1693] Specific operation: The server embeds the feedback data into the template, automatically generates a report, and distributes it to relevant parties by email.

[1694] Output: The generated report is distributed to the email addresses of the relevant parties and stored in a database.

[1695] The above is the flow of specific processing steps of this system, which allows users to adjust their schedules optimally while taking their emotions into consideration, thereby improving work efficiency.

[1696] (Application example 2)

[1697] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1698] Conventional schedule adjustment systems propose schedules without taking the user's emotional state into consideration, which can lead to stress and fatigue. Furthermore, there is a lack of means to grasp the driver's emotional state while driving and suggest appropriate rest stops or schedule changes, leaving issues in terms of safety and operational efficiency. The present invention aims to solve these issues by analyzing the user's emotions and suggesting optimal schedule adjustments and driving routes based on that analysis.

[1699] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1700] In this invention, the server includes means for analyzing the user's emotional data in real time and calculating emotional data such as stress level and fatigue level, means for preferentially presenting optimal candidate dates and times for the user based on the calculated emotional data, and means for acquiring actual driving route information and suggesting rest points based on the emotional data. This makes it possible to adjust the schedule and suggest rest points optimally taking the user's emotional state into consideration, and is expected to improve the user's work efficiency and safety.

[1701] "Position holder" refers to a person who holds a managerial or high-ranking position in a company or organization.

[1702] "Calendar Information" means electronic or physical time management data that records schedules and appointments.

[1703] "Interface" refers to the part that provides the input and output means for a user to interact with a system or application.

[1704] "Matching" refers to the process of matching the user's desired date and time with the availability of officials to find the best option.

[1705] A "database" refers to an organized collection of data for efficiently storing, managing, and retrieving information.

[1706] "Contact Methods" refers to methods and tools for communication, such as email, telephone, messaging services, etc.

[1707] "Emotional data" refers to information that indicates the user's emotional state, such as stress level or fatigue level, analyzed from facial expressions, voice, input content, etc.

[1708] "Rest points" are places where drivers can take a break while driving, including service areas and rest areas.

[1709] This invention is a system that acquires calendar information from managers, adjusts schedules optimally, analyzes the emotional state of drivers in real time while they are driving, and suggests appropriate rest stops. Specific embodiments of this system will be described in detail below.

[1710] Overview of the emotion analysis and schedule adjustment system

[1711] When a user uses the system interface to input a desired date and time, the terminal sends this information to the server. The server obtains the manager's calendar information and lists available time slots. Using a matching means, the server compares the user's desired date and time with the manager's available time slots and presents the user with the most suitable candidate date and time. At this point, the emotion engine analyzes the user's emotion data in real time and calculates stress levels and fatigue levels. Based on the emotion data, the most suitable candidate date and time for the user is displayed with priority. When the user confirms the selected date and time, the information is sent to the server and the manager's calendar is updated.

[1712] Overview of Autonomous Driving Assistance System

[1713] While a user is traveling in an autonomous vehicle, the device uses sensors such as a camera and microphone to acquire emotional data from the user's facial expressions and voice. The emotion engine analyzes this data and calculates stress levels and fatigue levels. The server combines the analyzed emotional data with driving route information to suggest optimal rest stops. The suggested rest stops are displayed on the device's display in real time, allowing the user to take a break while continuing to drive.

[1714] Hardware and Software Used

[1715] Emotion analysis engine: Uses Affectiva, Microsoft Azure Face API, etc.

[1716] Sensors: camera, microphone.

[1717] Server: The center of data analysis and information transmission and reception.

[1718] Terminal: A device that provides an interface for users to operate (e.g., a smartphone or an in-vehicle display).

[1719] Network communication: Data communication between the terminal and the server.

[1720] Operation example

[1721] For example, when a driver of an autonomous truck is driving from a starting point to a destination, the EAS (Emotion-Aware Auto Scheduler) analyzes the driver's emotional data in real time. If the driver's stress level or fatigue level is high, the EAS will display the nearest service area or rest stop on the display. The following prompt sentence is used:

[1722] "If the current stress level is high, a break is required within the next two hours. Please suggest the best time to rest for a driver with a stress level of 70 and fatigue level of 80."

[1723] Output format

[1724] The system can link users' emotional data with schedule information in real time and suggest appropriate measures. In this way, a system can be built that improves users' work efficiency and safety.

[1725] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1726] Step 1:

[1727] The user adjusts the schedule and inputs driving route information using the terminal interface, including the desired date and time, departure point, and destination.

[1728] Input: desired date and time, departure point, destination

[1729] Output: Sending input information to the server

[1730] Step 2:

[1731] The server retrieves the calendar information of the manager based on the received information, lists the available time slots, and queries the latest calendar information using the calendar API.

[1732] Input: desired date and time, calendar API request

[1733] Output: A list of available time slots

[1734] Step 3:

[1735] A matching means checks the user's desired date and time against the available time of the manager, and selects the most suitable candidate date and time.

[1736] Input: Desired date and time, list of available time slots

[1737] Output: A list of best candidate dates and times

[1738] Step 4:

[1739] The server sends a list of candidate dates and times to the terminal, which displays it to the user.

[1740] Input: A list of best candidate dates and times

[1741] Output: Display of candidate dates and times

[1742] Step 5:

[1743] The user selects from the candidate dates and times, and transmits information from the terminal to the server to confirm the selected date and time.

[1744] Input: Selected date and time

[1745] Output: Confirmation date and time sent to the server

[1746] Step 6:

[1747] The server reflects the confirmed date and time on the manager's calendar and updates the calendar information using the calendar API.

[1748] Input: Confirmed date and time

[1749] Output: Calendar updates

[1750] Step 7:

[1751] The device captures the user's facial expressions and voice through a camera and microphone to obtain emotional data.

[1752] Input: facial expressions, voice data

[1753] Output: Emotion data

[1754] Step 8:

[1755] The server's emotion engine analyzes the captured data and calculates the user's stress level and fatigue level.

[1756] Input: Emotion data

[1757] Output: Stress level, fatigue level

[1758] Step 9:

[1759] Based on the calculated emotion data, the server prioritizes and presents optimal candidate dates, times, and rest points.

[1760] Input: Stress level, fatigue level

[1761] Output: Best candidate date and time, rest point

[1762] Step 10:

[1763] The optimal candidate dates, times and rest points are displayed on the user's device, and the user makes a selection.

[1764] Input: Best candidate date and time, rest point

[1765] Output: Selected date and time, break point confirmation

[1766] Step 11:

[1767] After the meeting or driving is over, the terminal provides the user with a form for inputting feedback or reports, and transmits the input data to the server.

[1768] Input: Feedback, report content

[1769] Output: Sending feedback data to the server

[1770] Step 12:

[1771] The server automatically generates reports based on the feedback and reports, distributes them to the relevant parties, and stores the generated reports in a database.

[1772] Input: Feedback, report content

[1773] Output: Report generation, report distribution, saving to database

[1774] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1775] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The da...

Claims

1. A means of obtaining calendar information for executives and listing their available time slots, means for providing an interface for a user to input a desired date and time; A method to match the user's desired date and time with the availability of the manager to find the best candidate date and time. a means for displaying candidate dates and times to a user; A means to confirm the user's selected date and time and reflect it in the calendar; A method for centrally managing contact information for coordination partners in a database and automatically selecting the most appropriate means of communication; A means of contacting the coordinator using the most appropriate means of communication, confirming the schedule, and receiving a reply; a means of notifying the user of valid replies; A means to automatically generate reports after meetings and visits have concluded, A means of automatically distributing reports to stakeholders, A means of storing the generated reports in a database; A system including:

2. 10. The system of claim 1, further comprising means for providing a form for inputting brief feedback or reports for post-processing of a meeting or visit.

3. The system of claim 1, further comprising means for using email, telephone, or messaging services as a means of contacting the coordination party.

Images