system

The system efficiently links meeting schedules with visitor information to provide timely and appropriate notifications, addressing the inefficiencies of conventional visitor communication systems.

JP2026037188APending Publication Date: 2026-03-06SOFTBANK GROUP CORP
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-21
Publication Date
2026-03-06

AI Technical Summary

Technical Problem

Conventional systems fail to efficiently communicate visitor arrival information to relevant individuals in office environments, leading to long wait times and inappropriate notification methods.

Method used

A system that manages meeting schedule information, receives visitor information, determines individual availability, and notifies using appropriate methods such as internal telephone, email, or chat, ensuring timely and efficient visitor handling.

Benefits of technology

Enables quick and appropriate notification of visitor information to individuals based on their meeting schedules, reducing wait times and improving visitor response efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026037188000001_ABST
    Figure 2026037188000001_ABST
Patent Text Reader

Abstract

Provide a system. A means for managing individual meeting schedule information; A means for receiving visitor information; means for determining availability of a specific individual based on the meeting schedule information and visitor information; A means for notifying specific individuals of visitor information; A system including:
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern office environments, welcoming visitors and managing meeting schedules are important tasks. However, with conventional systems, when a visitor arrives, information about the visitor's arrival is often not communicated to the relevant individuals quickly and efficiently, resulting in long wait times for the visitor. Furthermore, if a specific individual is in a meeting, not properly handling the information can further delay the visitor's arrival. Furthermore, limited notification methods can prevent users from receiving visitor information in an appropriate manner. [Means for solving the problem]

[0005] In order to solve the above-mentioned problems, the present invention provides a system including a means for managing meeting schedule information for each individual, a means for receiving visitor information, a means for determining the availability of a specific individual based on the meeting schedule information and visitor information, and a means for notifying the specific individual of the visitor information. The visitor information is notified to the specific individual using either an internal telephone line, email, or chat, and if the specific individual is in a meeting, the visitor information is notified using another means, thereby enabling efficient visitor handling.

[0006] "Meeting schedule information" is information that includes details such as the date, time, location, and participants of meetings that each individual plans to attend.

[0007] "Visitor information" is information about a specific visit, such as the date and time of the visit, the purpose of the visit, and the name of the visitor.

[0008] "Availability" is information that indicates whether a particular individual is tied up with other work or meetings at a particular date and time.

[0009] A "specific individual" refers to a user whose meeting schedule information is managed within the system and whose visitor information is associated with the user.

[0010] "Notification means" refers to the method of communicating information using means such as internal telephone, email, or chat.

[0011] An "internal telephone" is a telephone system used within a company or organization that allows direct communication via a short dial number.

[0012] "Email" is a means of sending and receiving information such as text, images, and files over the Internet.

[0013] "Chat" is a means of real-time text communication over the Internet, allowing for instant communication.

[0014] The "system" refers to a series of mechanisms that manage meeting schedule information and visitor information, determine availability based on that information, and communicate visitor information to specific individuals using appropriate notification methods. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] overview

[0037] This invention is a system for linking each individual's meeting schedule with visitor information to realize efficient visitor response. This system notifies specific individuals of visitor information quickly and appropriately, enabling visitor response according to the specific individual's meeting schedule.

[0038] System configuration

[0039] The system includes the following main components:

[0040] 1. Server

[0041] 2. Terminal

[0042] 3. Users

[0043] Program processing

[0044] 1. Server

[0045] The server manages the conference schedule database, adds and updates conference information for each user, receives visitor information, determines the availability of specific users based on that information, and transmits the information using the appropriate notification method.

[0046] For example, the server uses the addMeeting method to add a new meeting to a user's meeting schedule, or the isAvailable method to check whether a particular user is available at a specified date and time. Whether the user is in a meeting or not, the server chooses the best notification method (extension, email, chat) and calls the notifyUser method to send the information.

[0047] 2. Terminal

[0048] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[0049] 3. Users

[0050] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[0051] Specific examples

[0052] Registering a meeting schedule

[0053] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0054] The terminal sends this information to the server, which registers it in a conference schedule database.

[0055] Entering and notifying visitor information

[0056] The guests arrive at 10:30 on October 1st.

[0057] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0058] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0059] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[0060] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0061] In this way, this system links each individual's meeting schedule with visitor information, enabling quick and efficient visitor response.

[0062] The processing flow will be explained below.

[0063] Step 1:

[0064] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[0065] Step 2:

[0066] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[0067] Step 3:

[0068] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[0069] Step 4:

[0070] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[0071] Step 5:

[0072] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[0073] Step 6:

[0074] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[0075] Step 7:

[0076] The server checks the user's schedule to see if they have a meeting at a particular time, and if it determines that they are in a meeting, it notifies them by other means (such as an internal phone call or chat).

[0077] Step 8:

[0078] The server selects the most appropriate notification method and notifies the specific user of the visitor information using the notifyUser method. The notification content includes the visitor's name, visit time, purpose, etc.

[0079] Step 9:

[0080] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[0081] Step 10:

[0082] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[0083] Example 1

[0084] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0085] Conventional visitor response systems often failed to promptly and appropriately notify specific individuals of visitor information, resulting in delayed responses due to meetings or other work being involved. As a result, there was a problem of visitors having to wait for long periods of time. Furthermore, because notification methods were limited, the optimal notification method for each individual's situation was often not selected.

[0086] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0087] In this invention, the server includes means for managing conference schedule information, means for receiving visitor information, means for determining availability of a specific individual based on the received visitor information, means for confirming whether the specific individual is available at a specified date and time, means for notifying the specific individual of the visitor information, and means for selecting the most appropriate notification method depending on the availability. This allows visitor information to be notified to the specific individual quickly and appropriately, enabling efficient visitor response in conjunction with the conference schedule.

[0088] "Meeting schedule information" refers to detailed information such as the date, time, location, participants, and agenda of a meeting that the user is scheduled to attend.

[0089] "Visitor information" refers to detailed information such as the visitor's name, purpose of visit, arrival date and time, and contact information.

[0090] "Means for receiving" refers to functions or devices for receiving information through a terminal or network.

[0091] "Availability status" refers to information indicating whether a user is in a meeting, on break, working, or the like at a specific date and time.

[0092] "Means for determining" refers to a function or device that checks whether specific conditions are met based on received data or information.

[0093] "Means of notification" refers to functions and devices for conveying information to users using internal telephones, email, chat, etc.

[0094] "Optimal notification method" refers to the function or process of selecting the most effective method of communicating information at a given time based on specific conditions or settings.

[0095] A "system" refers to an entire system that integrates a set of means and functions and operates to achieve a specific task or purpose.

[0096] MODE FOR CARRYING OUT THE INVENTION

[0097] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. This system allows visitor information to be promptly and appropriately notified to specific individuals, enabling responses according to meeting schedules.

[0098] System configuration

[0099] The system includes the following major components:

[0100] 1. Server

[0101] 2. Terminal

[0102] 3. Users

[0103] Server Features

[0104] The server manages the conference schedule database and has the function of adding and updating conference information for each user. It also receives visitor information, determines the availability of specific users based on that information, and conveys the information using appropriate notification methods. Specific functions are as follows:

[0105] Managing the meeting schedule: The server uses the addMeeting method to add a new meeting to the user's meeting schedule.

[0106] Determining Availability: The server uses the isAvailable method to determine whether a particular user is available at a specified date and time.

[0107] Selection of notification method and notification: The server selects the most appropriate notification method (extension phone, email, chat) and calls the notifyUser method to send the information.

[0108] Device Features

[0109] The terminal is the hardware that provides the interface for users to input meeting schedules and visitor information. Specific functions are as follows:

[0110] Entering a meeting schedule: When a user enters a meeting schedule on a terminal, the information is sent to the server and added to the database.

[0111] Entering visitor information: When a visitor arrives, the receptionist uses a terminal to enter the visitor information and sends it to the server.

[0112] User Roles

[0113] Users use this system to receive visitor information. The specific roles are as follows:

[0114] Receiving notifications: If the user wants to be notified by email, the server calls the notifyUser method and sends the visitor information by email. After receiving the information, the user can take appropriate action to respond to the visitor.

[0115] Specific operation example

[0116] 1. Registering a meeting schedule

[0117] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0118] The terminal sends this information to the server, which registers it in a conference schedule database.

[0119] 2. Entering and notifying visitor information

[0120] The guests arrive at 10:30 on October 1st.

[0121] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0122] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0123] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[0124] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0125] When inputting a generative AI model, you can use prompts like the following:

[0126] Example prompt for adding a scheduled meeting:

[0127] Add a meeting to User A's schedule from 10:00 to 11:00 on October 1st.

[0128] Example of a prompt to notify visitors:

[0129] A visitor arrived at 10:30 on October 1st. Please notify User A, who is in the meeting, by email.

[0130] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0131] Step 1: Schedule a meeting

[0132] Terminal

[0133] The user uses an interface to input a meeting schedule. The user inputs "a meeting from 10:00 to 11:00 on October 1st" on the terminal. This information is sent from the terminal to the server.

[0134] Input: Information such as meeting date and time, target audience, and meeting name.

[0135] Output: The meeting schedule information sent to the server.

[0136] Specific behavior:

[0137] The user enters the details of the meeting on the terminal and presses the "Send" button to send the data to the server. At this time, the terminal checks the format of the input data.

[0138] Step 2: Registering a meeting schedule

[0139] server

[0140] The server receives the meeting schedule information sent from the terminal and adds this information to the meeting schedule database using the addMeeting method.

[0141] Input: Meeting schedule information sent from the terminal.

[0142] Output: The new meeting schedule added to the meeting schedule database.

[0143] Specific behavior:

[0144] The server checks the format of the received data and registers it in the database. If necessary, it notifies the user that registration is complete.

[0145] Step 3: Enter visitor information

[0146] Terminal

[0147] The receptionist uses an interface to enter visitor information, such as the visitor's name, arrival time, and purpose of visit, and then sends this information to the server.

[0148] Input: Guest name, arrival time, purpose of visit, etc.

[0149] Output: Visitor information sent to the server.

[0150] Specific behavior:

[0151] The receptionist enters the visitor information on the terminal and presses the "Send" button to send the data to the server. The terminal performs an initial check of the entered data.

[0152] Step 4: Receiving visitor information

[0153] server

[0154] The server receives the visitor information sent from the terminal and stores the received information in its internal memory.

[0155] Input: Visitor information sent from the device.

[0156] Output: Visitor information stored in internal memory.

[0157] Specific behavior:

[0158] The server receives the visitor information, checks the data format, and stores it in its internal memory.

[0159] Step 5: Determine availability

[0160] server

[0161] The server uses the isAvailable method to check whether a particular user is available at a specified date and time. It checks the guest information against the conference schedule database to determine availability.

[0162] Input: Conference schedule database, visitor information.

[0163] Output: Availability status (available, in a meeting, busy, etc.).

[0164] Specific behavior:

[0165] Based on the arrival time of the visitor information received by the server, the server queries the conference schedule database to check the usage status of a specific user, and stores the results in internal memory.

[0166] Step 6: Select notification methods

[0167] server

[0168] Based on availability, the server will select the most appropriate notification method (extension, email, chat) depending on the user's preferences and current state.

[0169] Input: Availability status, user preference.

[0170] Output: The selected notification method.

[0171] Specific behavior:

[0172] The server runs an algorithm that looks at availability and user preferences to choose the best notification method, for example, email if the user prefers email notifications.

[0173] Step 7: Notify users

[0174] server

[0175] The server uses the selected notification method to call the notifyUser method and send the visitor information to the user. For example, if email is selected, an email containing the visitor information is created and sent.

[0176] Input: Selected notification method, visitor information.

[0177] Output: Notification sent to the user (phone extension, email, chat message).

[0178] Specific behavior:

[0179] The server sends the visitor information via the selected notification method. For example, if the user selects email, the server connects to the mail server and sends an email containing the visitor information. The user receives this notification and takes appropriate action.

[0180] (Application example 1)

[0181] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0182] In brick-and-mortar stores, it is difficult for busy store staff to efficiently respond to customers. In particular, if visitor information is not notified in a timely manner based on the staff's work schedule, response delays and lack of communication with customers can occur. A system that can solve these problems and provide quick and appropriate responses to customers is needed.

[0183] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0184] In this invention, the server includes a means for managing work schedule information for each individual, a means for receiving visitor information, a means for determining the availability of a specific individual based on the work schedule information and visitor information, and a means for notifying the specific individual of the visitor information. This makes it possible to notify the store staff of the visitor information at the optimal timing based on their work schedules.

[0185] Definitions of important words with application examples

[0186] "Work schedule information management" is a system that records each individual's working hours and shifts and manages daily work status.

[0187] "Visitor information reception" is a system in which the system takes in information about customers who visit the store and delivers that information to the staff member who needs to respond.

[0188] "Availability determination" is the process by which the system determines whether an individual is currently available based on their work schedule and other conditions.

[0189] "Visitor information notification" refers to notifying a specific individual of the date and time when future customer service is required.

[0190] "Push notifications" are a notification method that provides real-time information to smartphones and other devices.

[0191] "Email" is a digital message sent and received over the Internet.

[0192] "Chat" is a text-based real-time communication method.

[0193] "In progress" refers to a situation in which a specific individual is already engaged in other work or customer service.

[0194] overview

[0195] This invention is a system that enables efficient and appropriate customer service in a physical store by linking staff work schedule information with visitor information. This system includes means for managing staff work schedule information and inputting and receiving visitor information. Furthermore, the system determines staff availability based on visitor information and notifies staff at the optimal timing, thereby achieving fast and efficient customer service.

[0196] System configuration

[0197] The system includes the following major components:

[0198] 1. Server

[0199] 2. Devices (staff smartphones, reception tablets)

[0200] 3. User (store staff)

[0201] Server Processing

[0202] The server manages staff work schedule information and receives visitor information. The server achieves this by:

[0203] Work schedule information management tool

[0204] The server receives work schedule information from staff and stores it in a database, allowing you to manage when specific staff members are working.

[0205] Visitor information receiving means

[0206] The server receives customer information from the reception desk and stores it in a database. When the receptionist enters customer information using a tablet device, the server receives the information.

[0207] Means for determining availability of response

[0208] The server determines staff availability based on work schedule information and visitor information. For example, it checks the work schedule to determine whether a staff member is currently working on another task. This determination is made using the isAvailable method.

[0209] Visitor information notification means

[0210] The server selects the most appropriate notification method and notifies the specific staff member of the visitor information. Notification methods include push notification, email, and chat. For example, the notifyStaff method is used to send a push notification to the staff member's smartphone.

[0211] Terminal handling

[0212] The terminals used by staff and receptionists work as follows:

[0213] Work schedule entry

[0214] Staff members use their smartphones to enter their work schedules, which are then sent to a server and stored in a database.

[0215] Enter visitor information

[0216] The receptionist uses a tablet to enter visitor information, which is then sent to the server and stored in a database.

[0217] User Action

[0218] Store staff receive notifications on their smartphones:

[0219] Receive notifications

[0220] Customer information is sent to staff members' smartphones via push notifications, email, and chat. For example, by receiving a notification such as "A customer with a reservation is scheduled to arrive at 2 p.m.", staff can respond at the appropriate time.

[0221] Specific examples

[0222] Registering work schedules

[0223] Staff members use their smartphones to enter their work schedules. For example, they might enter "Working from 10:00 to 18:00 on October 1st."

[0224] The terminal sends this information to the server, which registers the information in a database.

[0225] Entering and notifying visitor information

[0226] The receptionist uses a tablet to enter visitor information. For example, they might enter "Reservation to visit on October 1st at 2pm."

[0227] The terminal sends this information to a server, which stores the information in a database.

[0228] The server checks the staff's work schedules and determines which staff are available at 2 p.m. For example, it checks using the isAvailable method.

[0229] The server selects the best notification method (push notification) and sends the information to a specific staff member, for example, by using the notifyStaff method.

[0230] Prompt Sentence Examples

[0231] Create an endpoint for your Flask application that meets the following criteria:

[0232] Add a staff member's shift schedule with a POST request.

[0233] Use a GET request to check if a specific staff member is available at a specified time.

[0234] Send notifications to staff members with a POST request.

[0235] Data is stored in a simple in-memory database.

[0236] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0237] System processing steps

[0238] Step 1:

[0239] Registering work schedules

[0240] explanation:

[0241] The server receives the staff's work schedule information sent from the terminal. The terminal sends the work schedule data entered by the user to the addShift endpoint. The server saves this information in a database.

[0242] input:

[0243] Work schedule entered by the user into the terminal (e.g., staff ID and work date and time)

[0244] Data processing and calculation:

[0245] The server uses the received work schedule information to update existing schedule data or add new schedule data.

[0246] output:

[0247] The work schedule is saved in the database, and the server responds by sending a "Registration successful" message to the terminal.

[0248] Step 2:

[0249] Entering visitor information

[0250] explanation:

[0251] The server receives visitor information sent from the reception terminal. The receptionist enters the visitor information into a tablet and sends it to the server. The server stores this information in a database.

[0252] input:

[0253] Visitor information entered by the receptionist into the tablet (e.g., visitor's name, planned visit date and time)

[0254] Data processing and calculation:

[0255] The server processes the received visitor information and stores it in a database.

[0256] output:

[0257] The visitor information is saved in the database, and the server responds by sending a message to the reception terminal saying, "Visitor information has been registered."

[0258] Step 3:

[0259] Determining availability

[0260] explanation:

[0261] Based on the visitor information, the server determines which staff members are available on the work schedule at the relevant date and time. It uses the isAvailable method to identify staff members who are not available.

[0262] input:

[0263] Visitor information and work schedule information (e.g., planned visit time)

[0264] Data processing and calculation:

[0265] The server checks the customer's planned arrival time against work schedule data to determine which staff member is available to handle the customer. Specifically, it searches the work schedule information in the database for staff who are available on the relevant date and time.

[0266] output:

[0267] A list of available staff members is generated, and the server responds with the "Available Staff Determination Result."

[0268] Step 4:

[0269] Visitor information notification

[0270] explanation:

[0271] Based on the result of the judgment, the server selects the most appropriate notification method and sends the visitor information to the available staff member. The notifyStaff method is used to select one of the following: push notification, email, or chat.

[0272] input:

[0273] Available staff list, notification message (e.g. "A customer with a reservation is expected to arrive at 2 p.m.")

[0274] Data processing and calculation:

[0275] The server selects the most appropriate notification method for available staff and sends the notification message, specifically using a push notification API or an email sending library.

[0276] output:

[0277] The staff member receives the notification, and the server responds with "Notification sent."

[0278] The above steps enable efficient work schedule management and customer service in physical stores.

[0279] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0280] overview

[0281] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. This system quickly and appropriately notifies specific individuals of visitor information, enabling visitor response according to the specific individual's meeting schedule and emotions.

[0282] System configuration

[0283] The system includes the following main components:

[0284] 1. Server

[0285] 2. Terminal

[0286] 3. Users

[0287] 4. Emotion Engine

[0288] Program processing

[0289] 1. Server

[0290] The server manages the conference schedule database, adds and updates each user's conference information, and receives visitor information. Based on that information, the server selects the optimal notification method according to the availability of the specific user and the emotion determined by the emotion engine, and then transmits the information.

[0291] For example, the server can use the addMeeting method to add a new meeting to a user's meeting schedule, the isAvailable method to check whether a particular user is available at a specified date and time, and the emotion engine to analyze the user's emotions and the notifyUser method to select the most appropriate notification method and send the information.

[0292] 2. Terminal

[0293] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[0294] 3. Users

[0295] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[0296] 4. Emotion Engine

[0297] The emotion engine determines the user's emotions through voice input, facial expression analysis, text analysis, etc. For example, it determines emotions by analyzing the tone of voice and facial expressions when the user speaks to the device, or the content of chat messages. The emotion engine provides this information to the server, which then selects a notification method according to the emotion.

[0298] Specific examples

[0299] Registering a meeting schedule

[0300] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0301] The terminal sends this information to the server, which registers it in a conference schedule database.

[0302] Entering and notifying visitor information

[0303] The guests arrive at 10:30 on October 1st.

[0304] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0305] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0306] The server uses an emotion engine to determine the user's current emotion from their voice input and facial expressions.

[0307] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[0308] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0309] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[0310] The processing flow will be explained below.

[0311] Step 1:

[0312] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[0313] Step 2:

[0314] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[0315] Step 3:

[0316] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[0317] Step 4:

[0318] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[0319] Step 5:

[0320] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[0321] Step 6:

[0322] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[0323] Step 7:

[0324] The server checks the user's schedule to see if there is a meeting at that time. If it determines that there is a meeting, it uses an emotion engine to determine the user's emotion.

[0325] Step 8:

[0326] The emotion engine uses the user's voice input, facial expression analysis, or text analysis to determine the user's emotion. For example, it may determine that the user is tired.

[0327] Step 9:

[0328] The server selects the most appropriate notification method based on the user's emotion determined by the emotion engine. For example, if the user is feeling stressed, notification by email is selected.

[0329] Step 10:

[0330] The server uses the selected notification method to call the notifyUser method to notify the specific user of the visitor information. The notification content includes the visitor's name, time of visit, purpose of visit, etc.

[0331] Step 11:

[0332] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[0333] Step 12:

[0334] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[0335] Example 2

[0336] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0337] In conventional visitor response systems, it was difficult to link each individual's meeting schedule information with visitor information, making it difficult to respond efficiently. Furthermore, because the notification method was selected uniformly without considering the user's emotional state, users sometimes felt stressed or were unable to respond appropriately. In particular, when notifying users during a meeting, it was necessary to select an appropriate method, and a system that could achieve this was needed.

[0338] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0339] In this invention, the server includes means for managing each individual's meeting schedule information, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion analysis means for determining the user's emotion, means for selecting the optimal notification means in accordance with the user's emotion determined by the emotion analysis means, and means for notifying the specific individual of the visitor information. This enables the meeting schedule information and visitor information of each individual to be linked, the optimal notification means to be selected taking into consideration the user's emotional state, and a quick and efficient response to be made.

[0340] "Meeting schedule information" is data that includes detailed information such as the dates, times, and locations of individual plans and meetings.

[0341] "Visitor information" is data that includes detailed information such as the visitor's name, the date and time of the visit, and the purpose of the visit.

[0342] "Availability status" is a status indicating whether an individual has no meetings or appointments and is available to attend to visitors on a specific date and time.

[0343] "Emotion analysis means" refers to technology for determining a user's current emotional state through voice input, facial expression analysis, text analysis, and the like.

[0344] "Notification means" refers to a method for transmitting information to a specific individual, and specifically includes internal telephone calls, emails, chats, etc.

[0345] The "server" is a computer system that manages each individual's meeting schedule information and visitor information, performs emotion analysis as needed, and sends appropriate notifications.

[0346] A "terminal" is a device used by a user or a receptionist to input meeting schedules and visitor information, and includes a PC, tablet, smartphone, etc.

[0347] overview

[0348] The present invention relates to a system that links each individual's meeting schedule information with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion analysis means that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. In this way, visitor information can be quickly and appropriately notified to specific individuals, enabling visitor response according to the user's meeting schedule and emotions.

[0349] Hardware and software used

[0350] The system uses the following main hardware and software:

[0351] Server: Database management, schedule checking, sentiment analysis, and sending notifications.

[0352] Terminal: The device (computer, tablet, smartphone, etc.) used by users and receptionists to enter information.

[0353] Emotion analysis means: Software that analyzes user emotions through voice input, facial expression analysis, and text analysis.

[0354] Program processing

[0355] server:

[0356] The server manages the conference schedule database and adds and updates conference information for each user. It also receives visitor information and, based on that information, selects the optimal notification method according to the availability status of a specific user and the emotions determined by the emotion analysis means, and transmits the information. For example, the server uses the addMeeting method to add a new conference to a user's conference schedule. It also uses the isAvailable method to check whether a specific user is available at a specified date and time. It then uses the emotion analysis means to analyze the user's emotions, selects the optimal notification method using the notifyUser method, and sends the information.

[0357] Device:

[0358] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[0359] User:

[0360] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[0361] Emotion analysis means:

[0362] The emotion analysis means determines the user's emotion through the user's voice input, facial expression analysis, text analysis, etc. For example, it determines the emotion by analyzing the tone of voice and facial expression when the user speaks to the terminal, or the content of chat messages. The emotion analysis means provides this information to the server, and the server selects a notification means according to the emotion.

[0363] Specific examples

[0364] Schedule a meeting:

[0365] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0366] The terminal sends this information to the server, which registers it in a conference schedule database.

[0367] Visitor information entry and notification:

[0368] The guests arrive at 10:30 on October 1st.

[0369] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0370] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0371] The server utilizes emotion analysis means to determine the user's current emotion from their voice input and facial expressions.

[0372] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[0373] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0374] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[0375] Example prompts to input to the generative AI model

[0376] "There is a system that integrates a user's meeting schedule and visitor information, and also combines emotion recognition to provide the most appropriate notification method. The process is as follows:

[0377] 1. The user enters the meeting schedule using a terminal, and the server registers this information in a database.

[0378] 2. The receptionist uses a terminal to enter visitor information, and the server temporarily stores this information.

[0379] 3. The server checks the user's schedule and analyzes the user's emotions using an emotion analysis method.

[0380] 4. The server selects the most appropriate notification method and notifies the user of the visitor information.

[0381] For example, if the user is stressed, the server will send a notification via email.

[0382] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0383] Step 1: Schedule a meeting

[0384] Device:

[0385] A user uses a terminal to input details of a meeting schedule, such as the name of the meeting, the date and time, and the location.

[0386] input:

[0387] Schedule information for "Meeting on October 1st from 10:00 to 11:00"

[0388] Data processing and calculation:

[0389] The terminal correctly formats the entered meeting schedule information.

[0390] output:

[0391] The formatted meeting schedule information is sent to a server.

[0392] Specific operation:

[0393] The user enters "a meeting from 10:00 to 11:00 on October 1st" into the terminal and presses the "Register" button. The terminal then sends this information to the server.

[0394] Step 2: Registering meeting schedule data

[0395] server:

[0396] The conference schedule data sent from the terminal is received, and a new conference is registered in the database using the addMeeting method.

[0397] input:

[0398] Meeting schedule information sent from the device

[0399] Data processing and calculation:

[0400] The server checks the data for consistency and ensures that it is in the correct format.

[0401] output:

[0402] The conference schedule information is registered in the database and a success message is returned.

[0403] Specific operation:

[0404] The server receives the data "Meeting from 10:00 to 11:00 on October 1st," verifies its consistency, and then registers it in the database.

[0405] Step 3: Enter visitor information

[0406] Device:

[0407] The receptionist uses a terminal to input visitor information, such as the visitor's name, date and time of visit, and purpose of visit.

[0408] input:

[0409] Information on "Visiting at 10:30 on October 1st"

[0410] Data processing and calculation:

[0411] The terminal correctly formats the entered visitor information.

[0412] output:

[0413] The formatted guest information is sent to a server.

[0414] Specific operation:

[0415] The receptionist enters the information "A visitor will arrive at 10:30 on October 1st" into the terminal and presses the "Send" button. The terminal then sends this information to the server.

[0416] Step 4: Receiving and temporarily storing visitor information

[0417] server:

[0418] Visitor information sent from the terminal is received and temporarily stored.

[0419] input:

[0420] Visitor information sent from the device

[0421] Data processing and calculation:

[0422] The server temporarily stores the visitor information and prepares it for use in subsequent steps.

[0423] output:

[0424] Temporarily saved visitor information

[0425] Specific operation:

[0426] The server receives the information that "a visitor will arrive at 10:30 on October 1st" and temporarily stores it.

[0427] Step 5: Check user availability

[0428] server:

[0429] Based on the visitor information, the isAvailable method is used to check the meeting schedule of the relevant user and determine whether the user is available at the specified date and time.

[0430] input:

[0431] Temporarily saved visitor information and user meeting schedule information

[0432] Data processing and calculation:

[0433] The server checks the meeting schedule information and visitor information in the database to see if the user is in a meeting on the relevant date and time.

[0434] output:

[0435] Determine user availability and obtain results.

[0436] Specific operation:

[0437] The server determines that "the user is in a meeting at 10:30 on October 1st."

[0438] Step 6: User sentiment analysis

[0439] Emotion analysis means:

[0440] The user's current emotional state is determined through voice input, facial expression analysis, and text analysis.

[0441] input:

[0442] Data such as user voice, facial expressions, and chat messages

[0443] Data processing and calculation:

[0444] The emotion analysis means analyzes the tone of voice, changes in facial expressions, and text content to determine the emotion the user is currently feeling.

[0445] output:

[0446] User's emotional state judgment result

[0447] Specific operation:

[0448] The emotion analysis means analyzes the user's tone of voice and facial expression and determines that "the user is feeling stressed."

[0449] Step 7: Choose the best notification method

[0450] server:

[0451] Based on the information obtained from the emotion analysis method, the optimal notification method is selected taking into account the user's emotional state. The notification is also sent using the notifyUser method.

[0452] input:

[0453] User availability and emotional state

[0454] Data processing and calculation:

[0455] The server combines availability and emotional state to select the most appropriate notification method (extension phone, email, chat, etc.).

[0456] output:

[0457] The visitor information is notified by the selected notification means.

[0458] Specific operation:

[0459] The server sends the user an email with the message "A visitor will arrive at 10:30 on October 1st. Please adjust the time as I am in a meeting."

[0460] Step 8: Receive and respond to notifications

[0461] User:

[0462] Receive visitor information via the selected notification method (e.g., email) and respond to the visitor based on the received information.

[0463] input:

[0464] Notification of visitor information sent from the server

[0465] Data processing and calculation:

[0466] The user checks the notification and decides how to respond.

[0467] output:

[0468] Deciding and implementing response methods

[0469] Specific operation:

[0470] The user receives an email notification that "a visitor will arrive at 10:30 on October 1st" and plans to respond to the request after the meeting ends.

[0471] (Application example 2)

[0472] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0473] Conventional visitor response systems primarily provide notifications based on meeting schedules and availability, and therefore are unable to provide optimal notification methods that take the user's emotional state into account. For example, if a user is feeling stressed, the system may select a notification method that is unpleasant, resulting in problems such as reduced visitor response efficiency and reduced user satisfaction. Furthermore, there has been a lack of systems for quickly and efficiently managing staff work schedules, meeting schedules, and visitor responses in commercial facilities and stores.

[0474] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0475] In this invention, the server includes means for managing meeting schedule information for each individual, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion recognition means for determining the emotional state of the specific individual, and means for selecting the optimal notification means based on the emotional state. This makes it possible to quickly and efficiently notify a specific individual of visitor information and to select the optimal notification means taking into account the emotional state of the specific individual.

[0476] "Meeting schedule information" is information held by each individual, such as the date, time, location, and participants of meetings.

[0477] "Visitor information" refers to information including the visitor's name, date and time of visit, purpose of visit, etc.

[0478] "Availability" refers to the status of whether a particular individual is free to use the facility at a specified time.

[0479] An "emotion recognition means" is a means for determining the emotional state of a specific individual through voice input, facial expression analysis, text analysis, or the like.

[0480] "Notification means" refers to a method for transmitting visitor information to a specific individual, and specifically includes internal telephone calls, emails, chats, and the like.

[0481] "Fast and efficient" means achieving objectives with minimal delay and no waste.

[0482] "Specific individuals" refers to users of this system who are the targets of notifications based on meeting schedules and visitor information.

[0483] A system embodying this invention includes the following major components:

[0484] 1. Server

[0485] The server manages each individual's meeting schedule information and receives visitor information. The server performs the following main processes:

[0486] Conference Schedule Management: Add and update users' conference schedules to the database.

[0487] Availability determination: Determine the availability of a particular individual based on meeting schedule information and visitor information.

[0488] Emotion Recognition: Emotion recognition measures are used to determine the emotional state of a particular individual.

[0489] Notification method selection: Based on the determined emotional state, the optimal notification method (extension phone, email, chat) is selected.

[0490] Examples:

[0491] When a user inputs "a meeting from 10:00 to 11:00 on October 1st," the server registers this information in the meeting schedule database. Also, if a guest arrives at 10:30 on October 1st, the server receives this information and confirms that the user is in a meeting. The server uses emotion recognition means to determine the user's emotional state, and if the user is in a relaxed state, it notifies the user by email.

[0492] 2. Terminal

[0493] The terminal is used by users to input meeting schedules and visitor information. The terminal has the following functions:

[0494] Entering a meeting schedule: When a user enters a meeting schedule using a terminal, the information is sent to the server.

[0495] Entering visitor information: The receptionist uses a terminal to enter visitor information and sends it to the server.

[0496] Examples:

[0497] When "Meeting from 10:00 to 11:00 on October 1st" is entered into the terminal, the terminal sends this information to the server. When a visitor arrives, the receptionist enters "The visitor arrived at 10:30 on October 1st" and sends this information to the server.

[0498] 3. Users

[0499] Users can use this system to receive visitor information. The notification method is selected based on the user's emotional state, allowing the user to receive notifications in the most optimal way.

[0500] Examples:

[0501] If the server analyzes the user's emotional state using an emotion recognition means and determines that the user is in a relaxed state, the user will receive a notification by email stating, "A visitor has arrived at 10:30 on October 1st."

[0502] Hardware and Software

[0503] Hardware: Smartphone, PC

[0504] Software: Python, SQL database, emotion recognition engine (EmotionEngine), notification system (NotificationSystem)

[0505] Prompt Sentence Examples

[0506] "Please check the user's meeting schedule at 10:00 on October 1st and see if they are in a meeting. Then, based on the analysis results of the emotion engine when notifying them of visitor information, please notify them in an appropriate manner."

[0507] In this way, the present invention not only links each individual's meeting schedule information with visitor information, but also uses emotion recognition to provide optimal notification methods according to the user's emotional state, enabling quick and efficient visitor response.

[0508] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0509] Step 1:

[0510] The user inputs a meeting schedule into the terminal. For example, the user inputs "a meeting from 10:00 to 11:00 on October 1st," and the terminal receives this information. The terminal then sends this input information to the server, which adds or updates the information in the meeting schedule database.

[0511] Input: User-entered meeting schedules

[0512] Data processing: Formatting meeting schedule information and saving it in a database

[0513] Output: New meeting information is added to the meeting schedule database.

[0514] Step 2:

[0515] The receptionist enters visitor information into the terminal. For example, the visitor enters that they arrived at "October 1st at 10:30," and the terminal sends this information to the server. The server receives this information and stores it in the visitor information database.

[0516] Input: Receptionist inputs visitor information

[0517] Data processing: Format the entered visitor information and save it in the database

[0518] Output: New visitor information is added to the visitor information database.

[0519] Step 3:

[0520] The server determines the availability of a specific individual based on the visitor information. The server references the conference schedule database and confirms that the user is in a conference at 10:30 on October 1st.

[0521] Input: Visitor information and meeting schedule information

[0522] Data processing: Determining availability

[0523] Output: Availability of a particular person is determined

[0524] Step 4:

[0525] The server uses emotion recognition means to determine the emotional state of a particular individual, analyzing whether the user is stressed or relaxed through voice analysis, facial expression analysis, or text analysis.

[0526] Input: Voice, facial expression, and text data of a specific individual

[0527] Data processing: Emotional state analysis

[0528] Output: The emotional state of a particular individual is determined.

[0529] Step 5:

[0530] The server selects the optimal notification method based on the determined emotional state. For example, if the user is relaxed, notification by email is selected. Depending on the emotional state, notification methods such as extension phone, email, chat, etc. are set.

[0531] Input: The emotional state of a particular individual

[0532] Data processing: Selection of notification method

[0533] Output: The optimal notification method is selected.

[0534] Step 6:

[0535] The server notifies the specific individual of the visitor information using the selected notification method. For example, if email is selected, a notification email stating "A visitor arrived at 10:30 on October 1st" will be sent.

[0536] Input: Selected notification method and visitor information

[0537] Data processing: generating and sending notification information

[0538] Output: A specific individual is notified of the visitor information

[0539] Through these steps, users can efficiently receive visitor information and receive optimal notifications according to their emotional state.

[0540] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0541] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0542] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0543] [Second embodiment]

[0544] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0545] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0546] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0547] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0548] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0549] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0550] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0551] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0552] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0553] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0554] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0555] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0556] overview

[0557] This invention is a system for linking each individual's meeting schedule with visitor information to realize efficient visitor response. This system notifies specific individuals of visitor information quickly and appropriately, enabling visitor response according to the specific individual's meeting schedule.

[0558] System configuration

[0559] The system includes the following main components:

[0560] 1. Server

[0561] 2. Terminal

[0562] 3. Users

[0563] Program processing

[0564] 1. Server

[0565] The server manages the conference schedule database, adds and updates conference information for each user, receives visitor information, determines the availability of specific users based on that information, and transmits the information using the appropriate notification method.

[0566] For example, the server uses the addMeeting method to add a new meeting to a user's meeting schedule, or the isAvailable method to check whether a particular user is available at a specified date and time. Whether the user is in a meeting or not, the server chooses the best notification method (extension, email, chat) and calls the notifyUser method to send the information.

[0567] 2. Terminal

[0568] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[0569] 3. Users

[0570] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[0571] Specific examples

[0572] Registering a meeting schedule

[0573] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0574] The terminal sends this information to the server, which registers it in a conference schedule database.

[0575] Entering and notifying visitor information

[0576] The guests arrive at 10:30 on October 1st.

[0577] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0578] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0579] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[0580] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0581] In this way, this system links each individual's meeting schedule with visitor information, enabling quick and efficient visitor response.

[0582] The processing flow will be explained below.

[0583] Step 1:

[0584] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[0585] Step 2:

[0586] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[0587] Step 3:

[0588] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[0589] Step 4:

[0590] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[0591] Step 5:

[0592] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[0593] Step 6:

[0594] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[0595] Step 7:

[0596] The server checks the user's schedule to see if they have a meeting at a particular time, and if it determines that they are in a meeting, it notifies them by other means (such as an internal phone call or chat).

[0597] Step 8:

[0598] The server selects the most appropriate notification method and notifies the specific user of the visitor information using the notifyUser method. The notification content includes the visitor's name, visit time, purpose, etc.

[0599] Step 9:

[0600] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[0601] Step 10:

[0602] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[0603] Example 1

[0604] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0605] Conventional visitor response systems often failed to promptly and appropriately notify specific individuals of visitor information, resulting in delayed responses due to meetings or other work being involved. As a result, there was a problem of visitors having to wait for long periods of time. Furthermore, because notification methods were limited, the optimal notification method for each individual's situation was often not selected.

[0606] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0607] In this invention, the server includes means for managing conference schedule information, means for receiving visitor information, means for determining availability of a specific individual based on the received visitor information, means for confirming whether the specific individual is available at a specified date and time, means for notifying the specific individual of the visitor information, and means for selecting the most appropriate notification method depending on the availability. This allows visitor information to be notified to the specific individual quickly and appropriately, enabling efficient visitor response in conjunction with the conference schedule.

[0608] "Meeting schedule information" refers to detailed information such as the date, time, location, participants, and agenda of a meeting that the user is scheduled to attend.

[0609] "Visitor information" refers to detailed information such as the visitor's name, purpose of visit, arrival date and time, and contact information.

[0610] "Means for receiving" refers to functions or devices for receiving information through a terminal or network.

[0611] "Availability status" refers to information indicating whether a user is in a meeting, on break, working, or the like at a specific date and time.

[0612] "Means for determining" refers to a function or device that checks whether specific conditions are met based on received data or information.

[0613] "Means of notification" refers to functions and devices for conveying information to users using internal telephones, email, chat, etc.

[0614] "Optimal notification method" refers to the function or process of selecting the most effective method of communicating information at a given time based on specific conditions or settings.

[0615] A "system" refers to an entire system that integrates a set of means and functions and operates to achieve a specific task or purpose.

[0616] MODE FOR CARRYING OUT THE INVENTION

[0617] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. This system allows visitor information to be promptly and appropriately notified to specific individuals, enabling responses according to meeting schedules.

[0618] System configuration

[0619] The system includes the following major components:

[0620] 1. Server

[0621] 2. Terminal

[0622] 3. Users

[0623] Server Features

[0624] The server manages the conference schedule database and has the function of adding and updating conference information for each user. It also receives visitor information, determines the availability of specific users based on that information, and conveys the information using appropriate notification methods. Specific functions are as follows:

[0625] Managing the meeting schedule: The server uses the addMeeting method to add a new meeting to the user's meeting schedule.

[0626] Determining Availability: The server uses the isAvailable method to determine whether a particular user is available at a specified date and time.

[0627] Selection of notification method and notification: The server selects the most appropriate notification method (extension phone, email, chat) and calls the notifyUser method to send the information.

[0628] Device Features

[0629] The terminal is the hardware that provides the interface for users to input meeting schedules and visitor information. Specific functions are as follows:

[0630] Entering a meeting schedule: When a user enters a meeting schedule on a terminal, the information is sent to the server and added to the database.

[0631] Entering visitor information: When a visitor arrives, the receptionist uses a terminal to enter the visitor information and sends it to the server.

[0632] User Roles

[0633] Users use this system to receive visitor information. The specific roles are as follows:

[0634] Receiving notifications: If the user wants to be notified by email, the server calls the notifyUser method and sends the visitor information by email. After receiving the information, the user can take appropriate action to respond to the visitor.

[0635] Specific operation example

[0636] 1. Registering a meeting schedule

[0637] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0638] The terminal sends this information to the server, which registers it in a conference schedule database.

[0639] 2. Entering and notifying visitor information

[0640] The guests arrive at 10:30 on October 1st.

[0641] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0642] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0643] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[0644] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0645] When inputting a generative AI model, you can use prompts like the following:

[0646] Example prompt for adding a scheduled meeting:

[0647] Add a meeting to User A's schedule from 10:00 to 11:00 on October 1st.

[0648] Example of a prompt to notify visitors:

[0649] A visitor arrived at 10:30 on October 1st. Please notify User A, who is in the meeting, by email.

[0650] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0651] Step 1: Schedule a meeting

[0652] Terminal

[0653] The user uses an interface to input a meeting schedule. The user inputs "a meeting from 10:00 to 11:00 on October 1st" on the terminal. This information is sent from the terminal to the server.

[0654] Input: Information such as meeting date and time, target audience, and meeting name.

[0655] Output: The meeting schedule information sent to the server.

[0656] Specific behavior:

[0657] The user enters the details of the meeting on the terminal and presses the "Send" button to send the data to the server. At this time, the terminal checks the format of the input data.

[0658] Step 2: Registering a meeting schedule

[0659] server

[0660] The server receives the meeting schedule information sent from the terminal and adds this information to the meeting schedule database using the addMeeting method.

[0661] Input: Meeting schedule information sent from the terminal.

[0662] Output: The new meeting schedule added to the meeting schedule database.

[0663] Specific behavior:

[0664] The server checks the format of the received data and registers it in the database. If necessary, it notifies the user that registration is complete.

[0665] Step 3: Enter visitor information

[0666] Terminal

[0667] The receptionist uses an interface to enter visitor information, such as the visitor's name, arrival time, and purpose of visit, and then sends this information to the server.

[0668] Input: Guest name, arrival time, purpose of visit, etc.

[0669] Output: Visitor information sent to the server.

[0670] Specific behavior:

[0671] The receptionist enters the visitor information on the terminal and presses the "Send" button to send the data to the server. The terminal performs an initial check of the entered data.

[0672] Step 4: Receiving visitor information

[0673] server

[0674] The server receives the visitor information sent from the terminal and stores the received information in its internal memory.

[0675] Input: Visitor information sent from the device.

[0676] Output: Visitor information stored in internal memory.

[0677] Specific behavior:

[0678] The server receives the visitor information, checks the data format, and stores it in its internal memory.

[0679] Step 5: Determine availability

[0680] server

[0681] The server uses the isAvailable method to check whether a particular user is available at a specified date and time. It checks the guest information against the conference schedule database to determine availability.

[0682] Input: Conference schedule database, visitor information.

[0683] Output: Availability status (available, in a meeting, busy, etc.).

[0684] Specific behavior:

[0685] Based on the arrival time of the visitor information received by the server, the server queries the conference schedule database to check the usage status of a specific user, and stores the results in internal memory.

[0686] Step 6: Select notification methods

[0687] server

[0688] Based on availability, the server will select the most appropriate notification method (extension, email, chat) depending on the user's preferences and current state.

[0689] Input: Availability status, user preference.

[0690] Output: The selected notification method.

[0691] Specific behavior:

[0692] The server runs an algorithm that looks at availability and user preferences to choose the best notification method, for example, email if the user prefers email notifications.

[0693] Step 7: Notify users

[0694] server

[0695] The server uses the selected notification method to call the notifyUser method and send the visitor information to the user. For example, if email is selected, an email containing the visitor information is created and sent.

[0696] Input: Selected notification method, visitor information.

[0697] Output: Notification sent to the user (phone extension, email, chat message).

[0698] Specific behavior:

[0699] The server sends the visitor information via the selected notification method. For example, if the user selects email, the server connects to the mail server and sends an email containing the visitor information. The user receives this notification and takes appropriate action.

[0700] (Application example 1)

[0701] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0702] In brick-and-mortar stores, it is difficult for busy store staff to efficiently respond to customers. In particular, if visitor information is not notified in a timely manner based on the staff's work schedule, response delays and lack of communication with customers can occur. A system that can solve these problems and provide quick and appropriate responses to customers is needed.

[0703] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0704] In this invention, the server includes a means for managing work schedule information for each individual, a means for receiving visitor information, a means for determining the availability of a specific individual based on the work schedule information and visitor information, and a means for notifying the specific individual of the visitor information. This makes it possible to notify the store staff of the visitor information at the optimal timing based on their work schedules.

[0705] Definitions of important words with application examples

[0706] "Work schedule information management" is a system that records each individual's working hours and shifts and manages daily work status.

[0707] "Visitor information reception" is a system in which the system takes in information about customers who visit the store and delivers that information to the staff member who needs to respond.

[0708] "Availability determination" is the process by which the system determines whether an individual is currently available based on their work schedule and other conditions.

[0709] "Visitor information notification" refers to notifying a specific individual of the date and time when future customer service is required.

[0710] "Push notifications" are a notification method that provides real-time information to smartphones and other devices.

[0711] "Email" is a digital message sent and received over the Internet.

[0712] "Chat" is a text-based real-time communication method.

[0713] "In progress" refers to a situation in which a specific individual is already engaged in other work or customer service.

[0714] overview

[0715] This invention is a system that enables efficient and appropriate customer service in a physical store by linking staff work schedule information with visitor information. This system includes means for managing staff work schedule information and inputting and receiving visitor information. Furthermore, the system determines staff availability based on visitor information and notifies staff at the optimal timing, thereby achieving fast and efficient customer service.

[0716] System configuration

[0717] The system includes the following major components:

[0718] 1. Server

[0719] 2. Devices (staff smartphones, reception tablets)

[0720] 3. User (store staff)

[0721] Server Processing

[0722] The server manages staff work schedule information and receives visitor information. The server achieves this by:

[0723] Work schedule information management tool

[0724] The server receives work schedule information from staff and stores it in a database, allowing you to manage when specific staff members are working.

[0725] Visitor information receiving means

[0726] The server receives customer information from the reception desk and stores it in a database. When the receptionist enters customer information using a tablet device, the server receives the information.

[0727] Means for determining availability of response

[0728] The server determines staff availability based on work schedule information and visitor information. For example, it checks the work schedule to determine whether a staff member is currently working on another task. This determination is made using the isAvailable method.

[0729] Visitor information notification means

[0730] The server selects the most appropriate notification method and notifies the specific staff member of the visitor information. Notification methods include push notification, email, and chat. For example, the notifyStaff method is used to send a push notification to the staff member's smartphone.

[0731] Terminal handling

[0732] The terminals used by staff and receptionists work as follows:

[0733] Work schedule entry

[0734] Staff members use their smartphones to enter their work schedules, which are then sent to a server and stored in a database.

[0735] Enter visitor information

[0736] The receptionist uses a tablet to enter visitor information, which is then sent to the server and stored in a database.

[0737] User Action

[0738] Store staff receive notifications on their smartphones:

[0739] Receive notifications

[0740] Customer information is sent to staff members' smartphones via push notifications, email, and chat. For example, by receiving a notification such as "A customer with a reservation is scheduled to arrive at 2 p.m.", staff can respond at the appropriate time.

[0741] Specific examples

[0742] Registering work schedules

[0743] Staff members use their smartphones to enter their work schedules. For example, they might enter "Working from 10:00 to 18:00 on October 1st."

[0744] The terminal sends this information to the server, which registers the information in a database.

[0745] Entering and notifying visitor information

[0746] The receptionist uses a tablet to enter visitor information. For example, they might enter "Reservation to visit on October 1st at 2pm."

[0747] The terminal sends this information to a server, which stores the information in a database.

[0748] The server checks the staff's work schedules and determines which staff are available at 2 p.m. For example, it checks using the isAvailable method.

[0749] The server selects the best notification method (push notification) and sends the information to a specific staff member, for example, by using the notifyStaff method.

[0750] Prompt Sentence Examples

[0751] Create an endpoint for your Flask application that meets the following criteria:

[0752] Add a staff member's shift schedule with a POST request.

[0753] Use a GET request to check if a specific staff member is available at a specified time.

[0754] Send notifications to staff members with a POST request.

[0755] Data is stored in a simple in-memory database.

[0756] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0757] System processing steps

[0758] Step 1:

[0759] Registering work schedules

[0760] explanation:

[0761] The server receives the staff's work schedule information sent from the terminal. The terminal sends the work schedule data entered by the user to the addShift endpoint. The server saves this information in a database.

[0762] input:

[0763] Work schedule entered by the user into the terminal (e.g., staff ID and work date and time)

[0764] Data processing and calculation:

[0765] The server uses the received work schedule information to update existing schedule data or add new schedule data.

[0766] output:

[0767] The work schedule is saved in the database, and the server responds by sending a "Registration successful" message to the terminal.

[0768] Step 2:

[0769] Entering visitor information

[0770] explanation:

[0771] The server receives visitor information sent from the reception terminal. The receptionist enters the visitor information into a tablet and sends it to the server. The server stores this information in a database.

[0772] input:

[0773] Visitor information entered by the receptionist into the tablet (e.g., visitor's name, planned visit date and time)

[0774] Data processing and calculation:

[0775] The server processes the received visitor information and stores it in a database.

[0776] output:

[0777] The visitor information is saved in the database, and the server responds by sending a message to the reception terminal saying, "Visitor information has been registered."

[0778] Step 3:

[0779] Determining availability

[0780] explanation:

[0781] Based on the visitor information, the server determines which staff members are available on the work schedule at the relevant date and time. It uses the isAvailable method to identify staff members who are not available.

[0782] input:

[0783] Visitor information and work schedule information (e.g., planned visit time)

[0784] Data processing and calculation:

[0785] The server checks the customer's planned arrival time against work schedule data to determine which staff member is available to handle the customer. Specifically, it searches the work schedule information in the database for staff who are available on the relevant date and time.

[0786] output:

[0787] A list of available staff members is generated, and the server responds with the "Available Staff Determination Result."

[0788] Step 4:

[0789] Visitor information notification

[0790] explanation:

[0791] Based on the result of the judgment, the server selects the most appropriate notification method and sends the visitor information to the available staff member. The notifyStaff method is used to select one of the following: push notification, email, or chat.

[0792] input:

[0793] Available staff list, notification message (e.g. "A customer with a reservation is expected to arrive at 2 p.m.")

[0794] Data processing and calculation:

[0795] The server selects the most appropriate notification method for available staff and sends the notification message, specifically using a push notification API or an email sending library.

[0796] output:

[0797] The staff member receives the notification, and the server responds with "Notification sent."

[0798] The above steps enable efficient work schedule management and customer service in physical stores.

[0799] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0800] overview

[0801] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. This system quickly and appropriately notifies specific individuals of visitor information, enabling visitor response according to the specific individual's meeting schedule and emotions.

[0802] System configuration

[0803] The system includes the following main components:

[0804] 1. Server

[0805] 2. Terminal

[0806] 3. Users

[0807] 4. Emotion Engine

[0808] Program processing

[0809] 1. Server

[0810] The server manages the conference schedule database, adds and updates each user's conference information, and receives visitor information. Based on that information, the server selects the optimal notification method according to the availability of the specific user and the emotion determined by the emotion engine, and then transmits the information.

[0811] For example, the server can use the addMeeting method to add a new meeting to a user's meeting schedule, the isAvailable method to check whether a particular user is available at a specified date and time, and the emotion engine to analyze the user's emotions and the notifyUser method to select the most appropriate notification method and send the information.

[0812] 2. Terminal

[0813] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[0814] 3. Users

[0815] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[0816] 4. Emotion Engine

[0817] The emotion engine determines the user's emotions through voice input, facial expression analysis, text analysis, etc. For example, it determines emotions by analyzing the tone of voice and facial expressions when the user speaks to the device, or the content of chat messages. The emotion engine provides this information to the server, which then selects a notification method according to the emotion.

[0818] Specific examples

[0819] Registering a meeting schedule

[0820] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0821] The terminal sends this information to the server, which registers it in a conference schedule database.

[0822] Entering and notifying visitor information

[0823] The guests arrive at 10:30 on October 1st.

[0824] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0825] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0826] The server uses an emotion engine to determine the user's current emotion from their voice input and facial expressions.

[0827] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[0828] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0829] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[0830] The processing flow will be explained below.

[0831] Step 1:

[0832] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[0833] Step 2:

[0834] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[0835] Step 3:

[0836] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[0837] Step 4:

[0838] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[0839] Step 5:

[0840] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[0841] Step 6:

[0842] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[0843] Step 7:

[0844] The server checks the user's schedule to see if there is a meeting at that time. If it determines that there is a meeting, it uses an emotion engine to determine the user's emotion.

[0845] Step 8:

[0846] The emotion engine uses the user's voice input, facial expression analysis, or text analysis to determine the user's emotion. For example, it may determine that the user is tired.

[0847] Step 9:

[0848] The server selects the most appropriate notification method based on the user's emotion determined by the emotion engine. For example, if the user is feeling stressed, notification by email is selected.

[0849] Step 10:

[0850] The server uses the selected notification method to call the notifyUser method to notify the specific user of the visitor information. The notification content includes the visitor's name, time of visit, purpose of visit, etc.

[0851] Step 11:

[0852] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[0853] Step 12:

[0854] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[0855] Example 2

[0856] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0857] In conventional visitor response systems, it was difficult to link each individual's meeting schedule information with visitor information, making it difficult to respond efficiently. Furthermore, because the notification method was selected uniformly without considering the user's emotional state, users sometimes felt stressed or were unable to respond appropriately. In particular, when notifying users during a meeting, it was necessary to select an appropriate method, and a system that could achieve this was needed.

[0858] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0859] In this invention, the server includes means for managing each individual's meeting schedule information, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion analysis means for determining the user's emotion, means for selecting the optimal notification means in accordance with the user's emotion determined by the emotion analysis means, and means for notifying the specific individual of the visitor information. This enables the meeting schedule information and visitor information of each individual to be linked, the optimal notification means to be selected taking into consideration the user's emotional state, and a quick and efficient response to be made.

[0860] "Meeting schedule information" is data that includes detailed information such as the dates, times, and locations of individual plans and meetings.

[0861] "Visitor information" is data that includes detailed information such as the visitor's name, the date and time of the visit, and the purpose of the visit.

[0862] "Availability status" is a status indicating whether an individual has no meetings or appointments and is available to attend to visitors on a specific date and time.

[0863] "Emotion analysis means" refers to technology for determining a user's current emotional state through voice input, facial expression analysis, text analysis, and the like.

[0864] "Notification means" refers to a method for transmitting information to a specific individual, and specifically includes internal telephone calls, emails, chats, etc.

[0865] The "server" is a computer system that manages each individual's meeting schedule information and visitor information, performs emotion analysis as needed, and sends appropriate notifications.

[0866] A "terminal" is a device used by a user or a receptionist to input meeting schedules and visitor information, and includes a PC, tablet, smartphone, etc.

[0867] overview

[0868] The present invention relates to a system that links each individual's meeting schedule information with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion analysis means that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. In this way, visitor information can be quickly and appropriately notified to specific individuals, enabling visitor response according to the user's meeting schedule and emotions.

[0869] Hardware and software used

[0870] The system uses the following main hardware and software:

[0871] Server: Database management, schedule checking, sentiment analysis, and sending notifications.

[0872] Terminal: The device (computer, tablet, smartphone, etc.) used by users and receptionists to enter information.

[0873] Emotion analysis means: Software that analyzes user emotions through voice input, facial expression analysis, and text analysis.

[0874] Program processing

[0875] server:

[0876] The server manages the conference schedule database and adds and updates conference information for each user. It also receives visitor information and, based on that information, selects the optimal notification method according to the availability status of a specific user and the emotions determined by the emotion analysis means, and transmits the information. For example, the server uses the addMeeting method to add a new conference to a user's conference schedule. It also uses the isAvailable method to check whether a specific user is available at a specified date and time. It then uses the emotion analysis means to analyze the user's emotions, selects the optimal notification method using the notifyUser method, and sends the information.

[0877] Device:

[0878] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[0879] User:

[0880] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[0881] Emotion analysis means:

[0882] The emotion analysis means determines the user's emotion through the user's voice input, facial expression analysis, text analysis, etc. For example, it determines the emotion by analyzing the tone of voice and facial expression when the user speaks to the terminal, or the content of chat messages. The emotion analysis means provides this information to the server, and the server selects a notification means according to the emotion.

[0883] Specific examples

[0884] Schedule a meeting:

[0885] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[0886] The terminal sends this information to the server, which registers it in a conference schedule database.

[0887] Visitor information entry and notification:

[0888] The guests arrive at 10:30 on October 1st.

[0889] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[0890] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[0891] The server utilizes emotion analysis means to determine the user's current emotion from their voice input and facial expressions.

[0892] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[0893] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[0894] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[0895] Example prompts to input to the generative AI model

[0896] "There is a system that integrates a user's meeting schedule and visitor information, and also combines emotion recognition to provide the most appropriate notification method. The process is as follows:

[0897] 1. The user enters the meeting schedule using a terminal, and the server registers this information in a database.

[0898] 2. The receptionist uses a terminal to enter visitor information, and the server temporarily stores this information.

[0899] 3. The server checks the user's schedule and analyzes the user's emotions using an emotion analysis method.

[0900] 4. The server selects the most appropriate notification method and notifies the user of the visitor information.

[0901] For example, if the user is stressed, the server will send a notification via email.

[0902] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0903] Step 1: Schedule a meeting

[0904] Device:

[0905] A user uses a terminal to input details of a meeting schedule, such as the name of the meeting, the date and time, and the location.

[0906] input:

[0907] Schedule information for "Meeting on October 1st from 10:00 to 11:00"

[0908] Data processing and calculation:

[0909] The terminal correctly formats the entered meeting schedule information.

[0910] output:

[0911] The formatted meeting schedule information is sent to a server.

[0912] Specific operation:

[0913] The user enters "a meeting from 10:00 to 11:00 on October 1st" into the terminal and presses the "Register" button. The terminal then sends this information to the server.

[0914] Step 2: Registering meeting schedule data

[0915] server:

[0916] The conference schedule data sent from the terminal is received, and a new conference is registered in the database using the addMeeting method.

[0917] input:

[0918] Meeting schedule information sent from the device

[0919] Data processing and calculation:

[0920] The server checks the data for consistency and ensures that it is in the correct format.

[0921] output:

[0922] The conference schedule information is registered in the database and a success message is returned.

[0923] Specific operation:

[0924] The server receives the data "Meeting from 10:00 to 11:00 on October 1st," verifies its consistency, and then registers it in the database.

[0925] Step 3: Enter visitor information

[0926] Device:

[0927] The receptionist uses a terminal to input visitor information, such as the visitor's name, date and time of visit, and purpose of visit.

[0928] input:

[0929] Information on "Visiting at 10:30 on October 1st"

[0930] Data processing and calculation:

[0931] The terminal correctly formats the entered visitor information.

[0932] output:

[0933] The formatted guest information is sent to a server.

[0934] Specific operation:

[0935] The receptionist enters the information "A visitor will arrive at 10:30 on October 1st" into the terminal and presses the "Send" button. The terminal then sends this information to the server.

[0936] Step 4: Receiving and temporarily storing visitor information

[0937] server:

[0938] Visitor information sent from the terminal is received and temporarily stored.

[0939] input:

[0940] Visitor information sent from the device

[0941] Data processing and calculation:

[0942] The server temporarily stores the visitor information and prepares it for use in subsequent steps.

[0943] output:

[0944] Temporarily saved visitor information

[0945] Specific operation:

[0946] The server receives the information that "a visitor will arrive at 10:30 on October 1st" and temporarily stores it.

[0947] Step 5: Check user availability

[0948] server:

[0949] Based on the visitor information, the isAvailable method is used to check the meeting schedule of the relevant user and determine whether the user is available at the specified date and time.

[0950] input:

[0951] Temporarily saved visitor information and user meeting schedule information

[0952] Data processing and calculation:

[0953] The server checks the meeting schedule information and visitor information in the database to see if the user is in a meeting on the relevant date and time.

[0954] output:

[0955] Determine user availability and obtain results.

[0956] Specific operation:

[0957] The server determines that "the user is in a meeting at 10:30 on October 1st."

[0958] Step 6: User sentiment analysis

[0959] Emotion analysis means:

[0960] The user's current emotional state is determined through voice input, facial expression analysis, and text analysis.

[0961] input:

[0962] Data such as user voice, facial expressions, and chat messages

[0963] Data processing and calculation:

[0964] The emotion analysis means analyzes the tone of voice, changes in facial expressions, and text content to determine the emotion the user is currently feeling.

[0965] output:

[0966] User's emotional state judgment result

[0967] Specific operation:

[0968] The emotion analysis means analyzes the user's tone of voice and facial expression and determines that "the user is feeling stressed."

[0969] Step 7: Choose the best notification method

[0970] server:

[0971] Based on the information obtained from the emotion analysis method, the optimal notification method is selected taking into account the user's emotional state. The notification is also sent using the notifyUser method.

[0972] input:

[0973] User availability and emotional state

[0974] Data processing and calculation:

[0975] The server combines availability and emotional state to select the most appropriate notification method (extension phone, email, chat, etc.).

[0976] output:

[0977] The visitor information is notified by the selected notification means.

[0978] Specific operation:

[0979] The server sends the user an email with the message "A visitor will arrive at 10:30 on October 1st. Please adjust the time as I am in a meeting."

[0980] Step 8: Receive and respond to notifications

[0981] User:

[0982] Receive visitor information via the selected notification method (e.g., email) and respond to the visitor based on the received information.

[0983] input:

[0984] Notification of visitor information sent from the server

[0985] Data processing and calculation:

[0986] The user checks the notification and decides how to respond.

[0987] output:

[0988] Deciding and implementing response methods

[0989] Specific operation:

[0990] The user receives an email notification that "a visitor will arrive at 10:30 on October 1st" and plans to respond to the request after the meeting ends.

[0991] (Application example 2)

[0992] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0993] Conventional visitor response systems primarily provide notifications based on meeting schedules and availability, and therefore are unable to provide optimal notification methods that take the user's emotional state into account. For example, if a user is feeling stressed, the system may select a notification method that is unpleasant, resulting in problems such as reduced visitor response efficiency and reduced user satisfaction. Furthermore, there has been a lack of systems for quickly and efficiently managing staff work schedules, meeting schedules, and visitor responses in commercial facilities and stores.

[0994] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0995] In this invention, the server includes means for managing meeting schedule information for each individual, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion recognition means for determining the emotional state of the specific individual, and means for selecting the optimal notification means based on the emotional state. This makes it possible to quickly and efficiently notify a specific individual of visitor information and to select the optimal notification means taking into account the emotional state of the specific individual.

[0996] "Meeting schedule information" is information held by each individual, such as the date, time, location, and participants of meetings.

[0997] "Visitor information" refers to information including the visitor's name, date and time of visit, purpose of visit, etc.

[0998] "Availability" refers to the status of whether a particular individual is free to use the facility at a specified time.

[0999] An "emotion recognition means" is a means for determining the emotional state of a specific individual through voice input, facial expression analysis, text analysis, or the like.

[1000] "Notification means" refers to a method for transmitting visitor information to a specific individual, and specifically includes internal telephone calls, emails, chats, and the like.

[1001] "Fast and efficient" means achieving objectives with minimal delay and no waste.

[1002] "Specific individuals" refers to users of this system who are the targets of notifications based on meeting schedules and visitor information.

[1003] A system embodying this invention includes the following major components:

[1004] 1. Server

[1005] The server manages each individual's meeting schedule information and receives visitor information. The server performs the following main processes:

[1006] Conference Schedule Management: Add and update users' conference schedules to the database.

[1007] Availability determination: Determine the availability of a particular individual based on meeting schedule information and visitor information.

[1008] Emotion Recognition: Emotion recognition measures are used to determine the emotional state of a particular individual.

[1009] Notification method selection: Based on the determined emotional state, the optimal notification method (extension phone, email, chat) is selected.

[1010] Examples:

[1011] When a user inputs "a meeting from 10:00 to 11:00 on October 1st," the server registers this information in the meeting schedule database. Also, if a guest arrives at 10:30 on October 1st, the server receives this information and confirms that the user is in a meeting. The server uses emotion recognition means to determine the user's emotional state, and if the user is in a relaxed state, it notifies the user by email.

[1012] 2. Terminal

[1013] The terminal is used by users to input meeting schedules and visitor information. The terminal has the following functions:

[1014] Entering a meeting schedule: When a user enters a meeting schedule using a terminal, the information is sent to the server.

[1015] Entering visitor information: The receptionist uses a terminal to enter visitor information and sends it to the server.

[1016] Examples:

[1017] When "Meeting from 10:00 to 11:00 on October 1st" is entered into the terminal, the terminal sends this information to the server. When a visitor arrives, the receptionist enters "The visitor arrived at 10:30 on October 1st" and sends this information to the server.

[1018] 3. Users

[1019] Users can use this system to receive visitor information. The notification method is selected based on the user's emotional state, allowing the user to receive notifications in the most optimal way.

[1020] Examples:

[1021] If the server analyzes the user's emotional state using an emotion recognition means and determines that the user is in a relaxed state, the user will receive a notification by email stating, "A visitor has arrived at 10:30 on October 1st."

[1022] Hardware and Software

[1023] Hardware: Smartphone, PC

[1024] Software: Python, SQL database, emotion recognition engine (EmotionEngine), notification system (NotificationSystem)

[1025] Prompt Sentence Examples

[1026] "Please check the user's meeting schedule at 10:00 on October 1st and see if they are in a meeting. Then, based on the analysis results of the emotion engine when notifying them of visitor information, please notify them in an appropriate manner."

[1027] In this way, the present invention not only links each individual's meeting schedule information with visitor information, but also uses emotion recognition to provide optimal notification methods according to the user's emotional state, enabling quick and efficient visitor response.

[1028] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1029] Step 1:

[1030] The user inputs a meeting schedule into the terminal. For example, the user inputs "a meeting from 10:00 to 11:00 on October 1st," and the terminal receives this information. The terminal then sends this input information to the server, which adds or updates the information in the meeting schedule database.

[1031] Input: User-entered meeting schedules

[1032] Data processing: Formatting meeting schedule information and saving it in a database

[1033] Output: New meeting information is added to the meeting schedule database.

[1034] Step 2:

[1035] The receptionist enters visitor information into the terminal. For example, the visitor enters that they arrived at "October 1st at 10:30," and the terminal sends this information to the server. The server receives this information and stores it in the visitor information database.

[1036] Input: Receptionist inputs visitor information

[1037] Data processing: Format the entered visitor information and save it in the database

[1038] Output: New visitor information is added to the visitor information database.

[1039] Step 3:

[1040] The server determines the availability of a specific individual based on the visitor information. The server references the conference schedule database and confirms that the user is in a conference at 10:30 on October 1st.

[1041] Input: Visitor information and meeting schedule information

[1042] Data processing: Determining availability

[1043] Output: Availability of a particular person is determined

[1044] Step 4:

[1045] The server uses emotion recognition means to determine the emotional state of a particular individual, analyzing whether the user is stressed or relaxed through voice analysis, facial expression analysis, or text analysis.

[1046] Input: Voice, facial expression, and text data of a specific individual

[1047] Data processing: Emotional state analysis

[1048] Output: The emotional state of a particular individual is determined.

[1049] Step 5:

[1050] The server selects the optimal notification method based on the determined emotional state. For example, if the user is relaxed, notification by email is selected. Depending on the emotional state, notification methods such as extension phone, email, chat, etc. are set.

[1051] Input: The emotional state of a particular individual

[1052] Data processing: Selection of notification method

[1053] Output: The optimal notification method is selected.

[1054] Step 6:

[1055] The server notifies the specific individual of the visitor information using the selected notification method. For example, if email is selected, a notification email stating "A visitor arrived at 10:30 on October 1st" will be sent.

[1056] Input: Selected notification method and visitor information

[1057] Data processing: generating and sending notification information

[1058] Output: A specific individual is notified of the visitor information

[1059] Through these steps, users can efficiently receive visitor information and receive optimal notifications according to their emotional state.

[1060] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1061] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1062] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1063] [Third embodiment]

[1064] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1065] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1066] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1067] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1068] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1069] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1070] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1071] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1072] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1073] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1074] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1075] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1076] overview

[1077] This invention is a system for linking each individual's meeting schedule with visitor information to realize efficient visitor response. This system notifies specific individuals of visitor information quickly and appropriately, enabling visitor response according to the specific individual's meeting schedule.

[1078] System configuration

[1079] The system includes the following main components:

[1080] 1. Server

[1081] 2. Terminal

[1082] 3. Users

[1083] Program processing

[1084] 1. Server

[1085] The server manages the conference schedule database, adds and updates conference information for each user, receives visitor information, determines the availability of specific users based on that information, and transmits the information using the appropriate notification method.

[1086] For example, the server uses the addMeeting method to add a new meeting to a user's meeting schedule, or the isAvailable method to check whether a particular user is available at a specified date and time. Whether the user is in a meeting or not, the server chooses the best notification method (extension, email, chat) and calls the notifyUser method to send the information.

[1087] 2. Terminal

[1088] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[1089] 3. Users

[1090] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[1091] Specific examples

[1092] Registering a meeting schedule

[1093] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1094] The terminal sends this information to the server, which registers it in a conference schedule database.

[1095] Entering and notifying visitor information

[1096] The guests arrive at 10:30 on October 1st.

[1097] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1098] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1099] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[1100] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1101] In this way, this system links each individual's meeting schedule with visitor information, enabling quick and efficient visitor response.

[1102] The processing flow will be explained below.

[1103] Step 1:

[1104] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[1105] Step 2:

[1106] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[1107] Step 3:

[1108] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[1109] Step 4:

[1110] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[1111] Step 5:

[1112] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[1113] Step 6:

[1114] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[1115] Step 7:

[1116] The server checks the user's schedule to see if they have a meeting at a particular time, and if it determines that they are in a meeting, it notifies them by other means (such as an internal phone call or chat).

[1117] Step 8:

[1118] The server selects the most appropriate notification method and notifies the specific user of the visitor information using the notifyUser method. The notification content includes the visitor's name, visit time, purpose, etc.

[1119] Step 9:

[1120] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[1121] Step 10:

[1122] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[1123] Example 1

[1124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1125] Conventional visitor response systems often failed to promptly and appropriately notify specific individuals of visitor information, resulting in delayed responses due to meetings or other work being involved. As a result, there was a problem of visitors having to wait for long periods of time. Furthermore, because notification methods were limited, the optimal notification method for each individual's situation was often not selected.

[1126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1127] In this invention, the server includes means for managing conference schedule information, means for receiving visitor information, means for determining availability of a specific individual based on the received visitor information, means for confirming whether the specific individual is available at a specified date and time, means for notifying the specific individual of the visitor information, and means for selecting the most appropriate notification method depending on the availability. This allows visitor information to be notified to the specific individual quickly and appropriately, enabling efficient visitor response in conjunction with the conference schedule.

[1128] "Meeting schedule information" refers to detailed information such as the date, time, location, participants, and agenda of a meeting that the user is scheduled to attend.

[1129] "Visitor information" refers to detailed information such as the visitor's name, purpose of visit, arrival date and time, and contact information.

[1130] "Means for receiving" refers to functions or devices for receiving information through a terminal or network.

[1131] "Availability status" refers to information indicating whether a user is in a meeting, on break, working, or the like at a specific date and time.

[1132] "Means for determining" refers to a function or device that checks whether specific conditions are met based on received data or information.

[1133] "Means of notification" refers to functions and devices for conveying information to users using internal telephones, email, chat, etc.

[1134] "Optimal notification method" refers to the function or process of selecting the most effective method of communicating information at a given time based on specific conditions or settings.

[1135] A "system" refers to an entire system that integrates a set of means and functions and operates to achieve a specific task or purpose.

[1136] MODE FOR CARRYING OUT THE INVENTION

[1137] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. This system allows visitor information to be promptly and appropriately notified to specific individuals, enabling responses according to meeting schedules.

[1138] System configuration

[1139] The system includes the following major components:

[1140] 1. Server

[1141] 2. Terminal

[1142] 3. Users

[1143] Server Features

[1144] The server manages the conference schedule database and has the function of adding and updating conference information for each user. It also receives visitor information, determines the availability of specific users based on that information, and conveys the information using appropriate notification methods. Specific functions are as follows:

[1145] Managing the meeting schedule: The server uses the addMeeting method to add a new meeting to the user's meeting schedule.

[1146] Determining Availability: The server uses the isAvailable method to determine whether a particular user is available at a specified date and time.

[1147] Selection of notification method and notification: The server selects the most appropriate notification method (extension phone, email, chat) and calls the notifyUser method to send the information.

[1148] Device Features

[1149] The terminal is the hardware that provides the interface for users to input meeting schedules and visitor information. Specific functions are as follows:

[1150] Entering a meeting schedule: When a user enters a meeting schedule on a terminal, the information is sent to the server and added to the database.

[1151] Entering visitor information: When a visitor arrives, the receptionist uses a terminal to enter the visitor information and sends it to the server.

[1152] User Roles

[1153] Users use this system to receive visitor information. The specific roles are as follows:

[1154] Receiving notifications: If the user wants to be notified by email, the server calls the notifyUser method and sends the visitor information by email. After receiving the information, the user can take appropriate action to respond to the visitor.

[1155] Specific operation example

[1156] 1. Registering a meeting schedule

[1157] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1158] The terminal sends this information to the server, which registers it in a conference schedule database.

[1159] 2. Entering and notifying visitor information

[1160] The guests arrive at 10:30 on October 1st.

[1161] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1162] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1163] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[1164] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1165] When inputting a generative AI model, you can use prompts like the following:

[1166] Example prompt for adding a scheduled meeting:

[1167] Add a meeting to User A's schedule from 10:00 to 11:00 on October 1st.

[1168] Example of a prompt to notify visitors:

[1169] A visitor arrived at 10:30 on October 1st. Please notify User A, who is in the meeting, by email.

[1170] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1171] Step 1: Schedule a meeting

[1172] Terminal

[1173] The user uses an interface to input a meeting schedule. The user inputs "a meeting from 10:00 to 11:00 on October 1st" on the terminal. This information is sent from the terminal to the server.

[1174] Input: Information such as meeting date and time, target audience, and meeting name.

[1175] Output: The meeting schedule information sent to the server.

[1176] Specific behavior:

[1177] The user enters the details of the meeting on the terminal and presses the "Send" button to send the data to the server. At this time, the terminal checks the format of the input data.

[1178] Step 2: Registering a meeting schedule

[1179] server

[1180] The server receives the meeting schedule information sent from the terminal and adds this information to the meeting schedule database using the addMeeting method.

[1181] Input: Meeting schedule information sent from the terminal.

[1182] Output: The new meeting schedule added to the meeting schedule database.

[1183] Specific behavior:

[1184] The server checks the format of the received data and registers it in the database. If necessary, it notifies the user that registration is complete.

[1185] Step 3: Enter visitor information

[1186] Terminal

[1187] The receptionist uses an interface to enter visitor information, such as the visitor's name, arrival time, and purpose of visit, and then sends this information to the server.

[1188] Input: Guest name, arrival time, purpose of visit, etc.

[1189] Output: Visitor information sent to the server.

[1190] Specific behavior:

[1191] The receptionist enters the visitor information on the terminal and presses the "Send" button to send the data to the server. The terminal performs an initial check of the entered data.

[1192] Step 4: Receiving visitor information

[1193] server

[1194] The server receives the visitor information sent from the terminal and stores the received information in its internal memory.

[1195] Input: Visitor information sent from the device.

[1196] Output: Visitor information stored in internal memory.

[1197] Specific behavior:

[1198] The server receives the visitor information, checks the data format, and stores it in its internal memory.

[1199] Step 5: Determine availability

[1200] server

[1201] The server uses the isAvailable method to check whether a particular user is available at a specified date and time. It checks the guest information against the conference schedule database to determine availability.

[1202] Input: Conference schedule database, visitor information.

[1203] Output: Availability status (available, in a meeting, busy, etc.).

[1204] Specific behavior:

[1205] Based on the arrival time of the visitor information received by the server, the server queries the conference schedule database to check the usage status of a specific user, and stores the results in internal memory.

[1206] Step 6: Select notification methods

[1207] server

[1208] Based on availability, the server will select the most appropriate notification method (extension, email, chat) depending on the user's preferences and current state.

[1209] Input: Availability status, user preference.

[1210] Output: The selected notification method.

[1211] Specific behavior:

[1212] The server runs an algorithm that looks at availability and user preferences to choose the best notification method, for example, email if the user prefers email notifications.

[1213] Step 7: Notify users

[1214] server

[1215] The server uses the selected notification method to call the notifyUser method and send the visitor information to the user. For example, if email is selected, an email containing the visitor information is created and sent.

[1216] Input: Selected notification method, visitor information.

[1217] Output: Notification sent to the user (phone extension, email, chat message).

[1218] Specific behavior:

[1219] The server sends the visitor information via the selected notification method. For example, if the user selects email, the server connects to the mail server and sends an email containing the visitor information. The user receives this notification and takes appropriate action.

[1220] (Application example 1)

[1221] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1222] In brick-and-mortar stores, it is difficult for busy store staff to efficiently respond to customers. In particular, if visitor information is not notified in a timely manner based on the staff's work schedule, response delays and lack of communication with customers can occur. A system that can solve these problems and provide quick and appropriate responses to customers is needed.

[1223] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1224] In this invention, the server includes a means for managing work schedule information for each individual, a means for receiving visitor information, a means for determining the availability of a specific individual based on the work schedule information and visitor information, and a means for notifying the specific individual of the visitor information. This makes it possible to notify the store staff of the visitor information at the optimal timing based on their work schedules.

[1225] Definitions of important words with application examples

[1226] "Work schedule information management" is a system that records each individual's working hours and shifts and manages daily work status.

[1227] "Visitor information reception" is a system in which the system takes in information about customers who visit the store and delivers that information to the staff member who needs to respond.

[1228] "Availability determination" is the process by which the system determines whether an individual is currently available based on their work schedule and other conditions.

[1229] "Visitor information notification" refers to notifying a specific individual of the date and time when future customer service is required.

[1230] "Push notifications" are a notification method that provides real-time information to smartphones and other devices.

[1231] "Email" is a digital message sent and received over the Internet.

[1232] "Chat" is a text-based real-time communication method.

[1233] "In progress" refers to a situation in which a specific individual is already engaged in other work or customer service.

[1234] overview

[1235] This invention is a system that enables efficient and appropriate customer service in a physical store by linking staff work schedule information with visitor information. This system includes means for managing staff work schedule information and inputting and receiving visitor information. Furthermore, the system determines staff availability based on visitor information and notifies staff at the optimal timing, thereby achieving fast and efficient customer service.

[1236] System configuration

[1237] The system includes the following major components:

[1238] 1. Server

[1239] 2. Devices (staff smartphones, reception tablets)

[1240] 3. User (store staff)

[1241] Server Processing

[1242] The server manages staff work schedule information and receives visitor information. The server achieves this by:

[1243] Work schedule information management tool

[1244] The server receives work schedule information from staff and stores it in a database, allowing you to manage when specific staff members are working.

[1245] Visitor information receiving means

[1246] The server receives customer information from the reception desk and stores it in a database. When the receptionist enters customer information using a tablet device, the server receives the information.

[1247] Means for determining availability of response

[1248] The server determines staff availability based on work schedule information and visitor information. For example, it checks the work schedule to determine whether a staff member is currently working on another task. This determination is made using the isAvailable method.

[1249] Visitor information notification means

[1250] The server selects the most appropriate notification method and notifies the specific staff member of the visitor information. Notification methods include push notification, email, and chat. For example, the notifyStaff method is used to send a push notification to the staff member's smartphone.

[1251] Terminal handling

[1252] The terminals used by staff and receptionists work as follows:

[1253] Work schedule entry

[1254] Staff members use their smartphones to enter their work schedules, which are then sent to a server and stored in a database.

[1255] Enter visitor information

[1256] The receptionist uses a tablet to enter visitor information, which is then sent to the server and stored in a database.

[1257] User Action

[1258] Store staff receive notifications on their smartphones:

[1259] Receive notifications

[1260] Customer information is sent to staff members' smartphones via push notifications, email, and chat. For example, by receiving a notification such as "A customer with a reservation is scheduled to arrive at 2 p.m.", staff can respond at the appropriate time.

[1261] Specific examples

[1262] Registering work schedules

[1263] Staff members use their smartphones to enter their work schedules. For example, they might enter "Working from 10:00 to 18:00 on October 1st."

[1264] The terminal sends this information to the server, which registers the information in a database.

[1265] Entering and notifying visitor information

[1266] The receptionist uses a tablet to enter visitor information. For example, they might enter "Reservation to visit on October 1st at 2pm."

[1267] The terminal sends this information to a server, which stores the information in a database.

[1268] The server checks the staff's work schedules and determines which staff are available at 2 p.m. For example, it checks using the isAvailable method.

[1269] The server selects the best notification method (push notification) and sends the information to a specific staff member, for example, by using the notifyStaff method.

[1270] Prompt Sentence Examples

[1271] Create an endpoint for your Flask application that meets the following criteria:

[1272] Add a staff member's shift schedule with a POST request.

[1273] Use a GET request to check if a specific staff member is available at a specified time.

[1274] Send notifications to staff members with a POST request.

[1275] Data is stored in a simple in-memory database.

[1276] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1277] System processing steps

[1278] Step 1:

[1279] Registering work schedules

[1280] explanation:

[1281] The server receives the staff's work schedule information sent from the terminal. The terminal sends the work schedule data entered by the user to the addShift endpoint. The server saves this information in a database.

[1282] input:

[1283] Work schedule entered by the user into the terminal (e.g., staff ID and work date and time)

[1284] Data processing and calculation:

[1285] The server uses the received work schedule information to update existing schedule data or add new schedule data.

[1286] output:

[1287] The work schedule is saved in the database, and the server responds by sending a "Registration successful" message to the terminal.

[1288] Step 2:

[1289] Entering visitor information

[1290] explanation:

[1291] The server receives visitor information sent from the reception terminal. The receptionist enters the visitor information into a tablet and sends it to the server. The server stores this information in a database.

[1292] input:

[1293] Visitor information entered by the receptionist into the tablet (e.g., visitor's name, planned visit date and time)

[1294] Data processing and calculation:

[1295] The server processes the received visitor information and stores it in a database.

[1296] output:

[1297] The visitor information is saved in the database, and the server responds by sending a message to the reception terminal saying, "Visitor information has been registered."

[1298] Step 3:

[1299] Determining availability

[1300] explanation:

[1301] Based on the visitor information, the server determines which staff members are available on the work schedule at the relevant date and time. It uses the isAvailable method to identify staff members who are not available.

[1302] input:

[1303] Visitor information and work schedule information (e.g., planned visit time)

[1304] Data processing and calculation:

[1305] The server checks the customer's planned arrival time against work schedule data to determine which staff member is available to handle the customer. Specifically, it searches the work schedule information in the database for staff who are available on the relevant date and time.

[1306] output:

[1307] A list of available staff members is generated, and the server responds with the "Available Staff Determination Result."

[1308] Step 4:

[1309] Visitor information notification

[1310] explanation:

[1311] Based on the result of the judgment, the server selects the most appropriate notification method and sends the visitor information to the available staff member. The notifyStaff method is used to select one of the following: push notification, email, or chat.

[1312] input:

[1313] Available staff list, notification message (e.g. "A customer with a reservation is expected to arrive at 2 p.m.")

[1314] Data processing and calculation:

[1315] The server selects the most appropriate notification method for available staff and sends the notification message, specifically using a push notification API or an email sending library.

[1316] output:

[1317] The staff member receives the notification, and the server responds with "Notification sent."

[1318] The above steps enable efficient work schedule management and customer service in physical stores.

[1319] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1320] overview

[1321] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. This system quickly and appropriately notifies specific individuals of visitor information, enabling visitor response according to the specific individual's meeting schedule and emotions.

[1322] System configuration

[1323] The system includes the following main components:

[1324] 1. Server

[1325] 2. Terminal

[1326] 3. Users

[1327] 4. Emotion Engine

[1328] Program processing

[1329] 1. Server

[1330] The server manages the conference schedule database, adds and updates each user's conference information, and receives visitor information. Based on that information, the server selects the optimal notification method according to the availability of the specific user and the emotion determined by the emotion engine, and then transmits the information.

[1331] For example, the server can use the addMeeting method to add a new meeting to a user's meeting schedule, the isAvailable method to check whether a particular user is available at a specified date and time, and the emotion engine to analyze the user's emotions and the notifyUser method to select the most appropriate notification method and send the information.

[1332] 2. Terminal

[1333] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[1334] 3. Users

[1335] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[1336] 4. Emotion Engine

[1337] The emotion engine determines the user's emotions through voice input, facial expression analysis, text analysis, etc. For example, it determines emotions by analyzing the tone of voice and facial expressions when the user speaks to the device, or the content of chat messages. The emotion engine provides this information to the server, which then selects a notification method according to the emotion.

[1338] Specific examples

[1339] Registering a meeting schedule

[1340] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1341] The terminal sends this information to the server, which registers it in a conference schedule database.

[1342] Entering and notifying visitor information

[1343] The guests arrive at 10:30 on October 1st.

[1344] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1345] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1346] The server uses an emotion engine to determine the user's current emotion from their voice input and facial expressions.

[1347] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[1348] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1349] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[1350] The processing flow will be explained below.

[1351] Step 1:

[1352] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[1353] Step 2:

[1354] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[1355] Step 3:

[1356] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[1357] Step 4:

[1358] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[1359] Step 5:

[1360] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[1361] Step 6:

[1362] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[1363] Step 7:

[1364] The server checks the user's schedule to see if there is a meeting at that time. If it determines that there is a meeting, it uses an emotion engine to determine the user's emotion.

[1365] Step 8:

[1366] The emotion engine uses the user's voice input, facial expression analysis, or text analysis to determine the user's emotion. For example, it may determine that the user is tired.

[1367] Step 9:

[1368] The server selects the most appropriate notification method based on the user's emotion determined by the emotion engine. For example, if the user is feeling stressed, notification by email is selected.

[1369] Step 10:

[1370] The server uses the selected notification method to call the notifyUser method to notify the specific user of the visitor information. The notification content includes the visitor's name, time of visit, purpose of visit, etc.

[1371] Step 11:

[1372] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[1373] Step 12:

[1374] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[1375] Example 2

[1376] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1377] In conventional visitor response systems, it was difficult to link each individual's meeting schedule information with visitor information, making it difficult to respond efficiently. Furthermore, because the notification method was selected uniformly without considering the user's emotional state, users sometimes felt stressed or were unable to respond appropriately. In particular, when notifying users during a meeting, it was necessary to select an appropriate method, and a system that could achieve this was needed.

[1378] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1379] In this invention, the server includes means for managing each individual's meeting schedule information, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion analysis means for determining the user's emotion, means for selecting the optimal notification means in accordance with the user's emotion determined by the emotion analysis means, and means for notifying the specific individual of the visitor information. This enables the meeting schedule information and visitor information of each individual to be linked, the optimal notification means to be selected taking into consideration the user's emotional state, and a quick and efficient response to be made.

[1380] "Meeting schedule information" is data that includes detailed information such as the dates, times, and locations of individual plans and meetings.

[1381] "Visitor information" is data that includes detailed information such as the visitor's name, the date and time of the visit, and the purpose of the visit.

[1382] "Availability status" is a status indicating whether an individual has no meetings or appointments and is available to attend to visitors on a specific date and time.

[1383] "Emotion analysis means" refers to technology for determining a user's current emotional state through voice input, facial expression analysis, text analysis, and the like.

[1384] "Notification means" refers to a method for transmitting information to a specific individual, and specifically includes internal telephone calls, emails, chats, etc.

[1385] The "server" is a computer system that manages each individual's meeting schedule information and visitor information, performs emotion analysis as needed, and sends appropriate notifications.

[1386] A "terminal" is a device used by a user or a receptionist to input meeting schedules and visitor information, and includes a PC, tablet, smartphone, etc.

[1387] overview

[1388] The present invention relates to a system that links each individual's meeting schedule information with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion analysis means that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. In this way, visitor information can be quickly and appropriately notified to specific individuals, enabling visitor response according to the user's meeting schedule and emotions.

[1389] Hardware and software used

[1390] The system uses the following main hardware and software:

[1391] Server: Database management, schedule checking, sentiment analysis, and sending notifications.

[1392] Terminal: The device (computer, tablet, smartphone, etc.) used by users and receptionists to enter information.

[1393] Emotion analysis means: Software that analyzes user emotions through voice input, facial expression analysis, and text analysis.

[1394] Program processing

[1395] server:

[1396] The server manages the conference schedule database and adds and updates conference information for each user. It also receives visitor information and, based on that information, selects the optimal notification method according to the availability status of a specific user and the emotions determined by the emotion analysis means, and transmits the information. For example, the server uses the addMeeting method to add a new conference to a user's conference schedule. It also uses the isAvailable method to check whether a specific user is available at a specified date and time. It then uses the emotion analysis means to analyze the user's emotions, selects the optimal notification method using the notifyUser method, and sends the information.

[1397] Device:

[1398] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[1399] User:

[1400] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[1401] Emotion analysis means:

[1402] The emotion analysis means determines the user's emotion through the user's voice input, facial expression analysis, text analysis, etc. For example, it determines the emotion by analyzing the tone of voice and facial expression when the user speaks to the terminal, or the content of chat messages. The emotion analysis means provides this information to the server, and the server selects a notification means according to the emotion.

[1403] Specific examples

[1404] Schedule a meeting:

[1405] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1406] The terminal sends this information to the server, which registers it in a conference schedule database.

[1407] Visitor information entry and notification:

[1408] The guests arrive at 10:30 on October 1st.

[1409] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1410] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1411] The server utilizes emotion analysis means to determine the user's current emotion from their voice input and facial expressions.

[1412] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[1413] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1414] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[1415] Example prompts to input to the generative AI model

[1416] "There is a system that integrates a user's meeting schedule and visitor information, and also combines emotion recognition to provide the most appropriate notification method. The process is as follows:

[1417] 1. The user enters the meeting schedule using a terminal, and the server registers this information in a database.

[1418] 2. The receptionist uses a terminal to enter visitor information, and the server temporarily stores this information.

[1419] 3. The server checks the user's schedule and analyzes the user's emotions using an emotion analysis method.

[1420] 4. The server selects the most appropriate notification method and notifies the user of the visitor information.

[1421] For example, if the user is stressed, the server will send a notification via email.

[1422] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1423] Step 1: Schedule a meeting

[1424] Device:

[1425] A user uses a terminal to input details of a meeting schedule, such as the name of the meeting, the date and time, and the location.

[1426] input:

[1427] Schedule information for "Meeting on October 1st from 10:00 to 11:00"

[1428] Data processing and calculation:

[1429] The terminal correctly formats the entered meeting schedule information.

[1430] output:

[1431] The formatted meeting schedule information is sent to a server.

[1432] Specific operation:

[1433] The user enters "a meeting from 10:00 to 11:00 on October 1st" into the terminal and presses the "Register" button. The terminal then sends this information to the server.

[1434] Step 2: Registering meeting schedule data

[1435] server:

[1436] The conference schedule data sent from the terminal is received, and a new conference is registered in the database using the addMeeting method.

[1437] input:

[1438] Meeting schedule information sent from the device

[1439] Data processing and calculation:

[1440] The server checks the data for consistency and ensures that it is in the correct format.

[1441] output:

[1442] The conference schedule information is registered in the database and a success message is returned.

[1443] Specific operation:

[1444] The server receives the data "Meeting from 10:00 to 11:00 on October 1st," verifies its consistency, and then registers it in the database.

[1445] Step 3: Enter visitor information

[1446] Device:

[1447] The receptionist uses a terminal to input visitor information, such as the visitor's name, date and time of visit, and purpose of visit.

[1448] input:

[1449] Information on "Visiting at 10:30 on October 1st"

[1450] Data processing and calculation:

[1451] The terminal correctly formats the entered visitor information.

[1452] output:

[1453] The formatted guest information is sent to a server.

[1454] Specific operation:

[1455] The receptionist enters the information "A visitor will arrive at 10:30 on October 1st" into the terminal and presses the "Send" button. The terminal then sends this information to the server.

[1456] Step 4: Receiving and temporarily storing visitor information

[1457] server:

[1458] Visitor information sent from the terminal is received and temporarily stored.

[1459] input:

[1460] Visitor information sent from the device

[1461] Data processing and calculation:

[1462] The server temporarily stores the visitor information and prepares it for use in subsequent steps.

[1463] output:

[1464] Temporarily saved visitor information

[1465] Specific operation:

[1466] The server receives the information that "a visitor will arrive at 10:30 on October 1st" and temporarily stores it.

[1467] Step 5: Check user availability

[1468] server:

[1469] Based on the visitor information, the isAvailable method is used to check the meeting schedule of the relevant user and determine whether the user is available at the specified date and time.

[1470] input:

[1471] Temporarily saved visitor information and user meeting schedule information

[1472] Data processing and calculation:

[1473] The server checks the meeting schedule information and visitor information in the database to see if the user is in a meeting on the relevant date and time.

[1474] output:

[1475] Determine user availability and obtain results.

[1476] Specific operation:

[1477] The server determines that "the user is in a meeting at 10:30 on October 1st."

[1478] Step 6: User sentiment analysis

[1479] Emotion analysis means:

[1480] The user's current emotional state is determined through voice input, facial expression analysis, and text analysis.

[1481] input:

[1482] Data such as user voice, facial expressions, and chat messages

[1483] Data processing and calculation:

[1484] The emotion analysis means analyzes the tone of voice, changes in facial expressions, and text content to determine the emotion the user is currently feeling.

[1485] output:

[1486] User's emotional state judgment result

[1487] Specific operation:

[1488] The emotion analysis means analyzes the user's tone of voice and facial expression and determines that "the user is feeling stressed."

[1489] Step 7: Choose the best notification method

[1490] server:

[1491] Based on the information obtained from the emotion analysis method, the optimal notification method is selected taking into account the user's emotional state. The notification is also sent using the notifyUser method.

[1492] input:

[1493] User availability and emotional state

[1494] Data processing and calculation:

[1495] The server combines availability and emotional state to select the most appropriate notification method (extension phone, email, chat, etc.).

[1496] output:

[1497] The visitor information is notified by the selected notification means.

[1498] Specific operation:

[1499] The server sends the user an email with the message "A visitor will arrive at 10:30 on October 1st. Please adjust the time as I am in a meeting."

[1500] Step 8: Receive and respond to notifications

[1501] User:

[1502] Receive visitor information via the selected notification method (e.g., email) and respond to the visitor based on the received information.

[1503] input:

[1504] Notification of visitor information sent from the server

[1505] Data processing and calculation:

[1506] The user checks the notification and decides how to respond.

[1507] output:

[1508] Deciding and implementing response methods

[1509] Specific operation:

[1510] The user receives an email notification that "a visitor will arrive at 10:30 on October 1st" and plans to respond to the request after the meeting ends.

[1511] (Application example 2)

[1512] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1513] Conventional visitor response systems primarily provide notifications based on meeting schedules and availability, and therefore are unable to provide optimal notification methods that take the user's emotional state into account. For example, if a user is feeling stressed, the system may select a notification method that is unpleasant, resulting in problems such as reduced visitor response efficiency and reduced user satisfaction. Furthermore, there has been a lack of systems for quickly and efficiently managing staff work schedules, meeting schedules, and visitor responses in commercial facilities and stores.

[1514] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1515] In this invention, the server includes means for managing meeting schedule information for each individual, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion recognition means for determining the emotional state of the specific individual, and means for selecting the optimal notification means based on the emotional state. This makes it possible to quickly and efficiently notify a specific individual of visitor information and to select the optimal notification means taking into account the emotional state of the specific individual.

[1516] "Meeting schedule information" is information held by each individual, such as the date, time, location, and participants of meetings.

[1517] "Visitor information" refers to information including the visitor's name, date and time of visit, purpose of visit, etc.

[1518] "Availability" refers to the status of whether a particular individual is free to use the facility at a specified time.

[1519] An "emotion recognition means" is a means for determining the emotional state of a specific individual through voice input, facial expression analysis, text analysis, or the like.

[1520] "Notification means" refers to a method for transmitting visitor information to a specific individual, and specifically includes internal telephone calls, emails, chats, and the like.

[1521] "Fast and efficient" means achieving objectives with minimal delay and no waste.

[1522] "Specific individuals" refers to users of this system who are the targets of notifications based on meeting schedules and visitor information.

[1523] A system embodying this invention includes the following major components:

[1524] 1. Server

[1525] The server manages each individual's meeting schedule information and receives visitor information. The server performs the following main processes:

[1526] Conference Schedule Management: Add and update users' conference schedules to the database.

[1527] Availability determination: Determine the availability of a particular individual based on meeting schedule information and visitor information.

[1528] Emotion Recognition: Emotion recognition measures are used to determine the emotional state of a particular individual.

[1529] Notification method selection: Based on the determined emotional state, the optimal notification method (extension phone, email, chat) is selected.

[1530] Examples:

[1531] When a user inputs "a meeting from 10:00 to 11:00 on October 1st," the server registers this information in the meeting schedule database. Also, if a guest arrives at 10:30 on October 1st, the server receives this information and confirms that the user is in a meeting. The server uses emotion recognition means to determine the user's emotional state, and if the user is in a relaxed state, it notifies the user by email.

[1532] 2. Terminal

[1533] The terminal is used by users to input meeting schedules and visitor information. The terminal has the following functions:

[1534] Entering a meeting schedule: When a user enters a meeting schedule using a terminal, the information is sent to the server.

[1535] Entering visitor information: The receptionist uses a terminal to enter visitor information and sends it to the server.

[1536] Examples:

[1537] When "Meeting from 10:00 to 11:00 on October 1st" is entered into the terminal, the terminal sends this information to the server. When a visitor arrives, the receptionist enters "The visitor arrived at 10:30 on October 1st" and sends this information to the server.

[1538] 3. Users

[1539] Users can use this system to receive visitor information. The notification method is selected based on the user's emotional state, allowing the user to receive notifications in the most optimal way.

[1540] Examples:

[1541] If the server analyzes the user's emotional state using an emotion recognition means and determines that the user is in a relaxed state, the user will receive a notification by email stating, "A visitor has arrived at 10:30 on October 1st."

[1542] Hardware and Software

[1543] Hardware: Smartphone, PC

[1544] Software: Python, SQL database, emotion recognition engine (EmotionEngine), notification system (NotificationSystem)

[1545] Prompt Sentence Examples

[1546] "Please check the user's meeting schedule at 10:00 on October 1st and see if they are in a meeting. Then, based on the analysis results of the emotion engine when notifying them of visitor information, please notify them in an appropriate manner."

[1547] In this way, the present invention not only links each individual's meeting schedule information with visitor information, but also uses emotion recognition to provide optimal notification methods according to the user's emotional state, enabling quick and efficient visitor response.

[1548] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1549] Step 1:

[1550] The user inputs a meeting schedule into the terminal. For example, the user inputs "a meeting from 10:00 to 11:00 on October 1st," and the terminal receives this information. The terminal then sends this input information to the server, which adds or updates the information in the meeting schedule database.

[1551] Input: User-entered meeting schedules

[1552] Data processing: Formatting meeting schedule information and saving it in a database

[1553] Output: New meeting information is added to the meeting schedule database.

[1554] Step 2:

[1555] The receptionist enters visitor information into the terminal. For example, the visitor enters that they arrived at "October 1st at 10:30," and the terminal sends this information to the server. The server receives this information and stores it in the visitor information database.

[1556] Input: Receptionist inputs visitor information

[1557] Data processing: Format the entered visitor information and save it in the database

[1558] Output: New visitor information is added to the visitor information database.

[1559] Step 3:

[1560] The server determines the availability of a specific individual based on the visitor information. The server references the conference schedule database and confirms that the user is in a conference at 10:30 on October 1st.

[1561] Input: Visitor information and meeting schedule information

[1562] Data processing: Determining availability

[1563] Output: Availability of a particular person is determined

[1564] Step 4:

[1565] The server uses emotion recognition means to determine the emotional state of a particular individual, analyzing whether the user is stressed or relaxed through voice analysis, facial expression analysis, or text analysis.

[1566] Input: Voice, facial expression, and text data of a specific individual

[1567] Data processing: Emotional state analysis

[1568] Output: The emotional state of a particular individual is determined.

[1569] Step 5:

[1570] The server selects the optimal notification method based on the determined emotional state. For example, if the user is relaxed, notification by email is selected. Depending on the emotional state, notification methods such as extension phone, email, chat, etc. are set.

[1571] Input: The emotional state of a particular individual

[1572] Data processing: Selection of notification method

[1573] Output: The optimal notification method is selected.

[1574] Step 6:

[1575] The server notifies the specific individual of the visitor information using the selected notification method. For example, if email is selected, a notification email stating "A visitor arrived at 10:30 on October 1st" will be sent.

[1576] Input: Selected notification method and visitor information

[1577] Data processing: generating and sending notification information

[1578] Output: A specific individual is notified of the visitor information

[1579] Through these steps, users can efficiently receive visitor information and receive optimal notifications according to their emotional state.

[1580] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1581] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1582] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1583] [Fourth embodiment]

[1584] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1585] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1586] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1587] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1588] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1589] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1590] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1591] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1592] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1593] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1594] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1595] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1596] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1597] overview

[1598] This invention is a system for linking each individual's meeting schedule with visitor information to realize efficient visitor response. This system notifies specific individuals of visitor information quickly and appropriately, enabling visitor response according to the specific individual's meeting schedule.

[1599] System configuration

[1600] The system includes the following main components:

[1601] 1. Server

[1602] 2. Terminal

[1603] 3. Users

[1604] Program processing

[1605] 1. Server

[1606] The server manages the conference schedule database, adds and updates conference information for each user, receives visitor information, determines the availability of specific users based on that information, and transmits the information using the appropriate notification method.

[1607] For example, the server uses the addMeeting method to add a new meeting to a user's meeting schedule, or the isAvailable method to check whether a particular user is available at a specified date and time. Whether the user is in a meeting or not, the server chooses the best notification method (extension, email, chat) and calls the notifyUser method to send the information.

[1608] 2. Terminal

[1609] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[1610] 3. Users

[1611] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[1612] Specific examples

[1613] Registering a meeting schedule

[1614] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1615] The terminal sends this information to the server, which registers it in a conference schedule database.

[1616] Entering and notifying visitor information

[1617] The guests arrive at 10:30 on October 1st.

[1618] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1619] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1620] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[1621] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1622] In this way, this system links each individual's meeting schedule with visitor information, enabling quick and efficient visitor response.

[1623] The processing flow will be explained below.

[1624] Step 1:

[1625] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[1626] Step 2:

[1627] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[1628] Step 3:

[1629] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[1630] Step 4:

[1631] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[1632] Step 5:

[1633] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[1634] Step 6:

[1635] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[1636] Step 7:

[1637] The server checks the user's schedule to see if they have a meeting at a particular time, and if it determines that they are in a meeting, it notifies them by other means (such as an internal phone call or chat).

[1638] Step 8:

[1639] The server selects the most appropriate notification method and notifies the specific user of the visitor information using the notifyUser method. The notification content includes the visitor's name, visit time, purpose, etc.

[1640] Step 9:

[1641] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[1642] Step 10:

[1643] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[1644] Example 1

[1645] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1646] Conventional visitor response systems often failed to promptly and appropriately notify specific individuals of visitor information, resulting in delayed responses due to meetings or other work being involved. As a result, there was a problem of visitors having to wait for long periods of time. Furthermore, because notification methods were limited, the optimal notification method for each individual's situation was often not selected.

[1647] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1648] In this invention, the server includes means for managing conference schedule information, means for receiving visitor information, means for determining availability of a specific individual based on the received visitor information, means for confirming whether the specific individual is available at a specified date and time, means for notifying the specific individual of the visitor information, and means for selecting the most appropriate notification method depending on the availability. This allows visitor information to be notified to the specific individual quickly and appropriately, enabling efficient visitor response in conjunction with the conference schedule.

[1649] "Meeting schedule information" refers to detailed information such as the date, time, location, participants, and agenda of a meeting that the user is scheduled to attend.

[1650] "Visitor information" refers to detailed information such as the visitor's name, purpose of visit, arrival date and time, and contact information.

[1651] "Means for receiving" refers to functions or devices for receiving information through a terminal or network.

[1652] "Availability status" refers to information indicating whether a user is in a meeting, on break, working, or the like at a specific date and time.

[1653] "Means for determining" refers to a function or device that checks whether specific conditions are met based on received data or information.

[1654] "Means of notification" refers to functions and devices for conveying information to users using internal telephones, email, chat, etc.

[1655] "Optimal notification method" refers to the function or process of selecting the most effective method of communicating information at a given time based on specific conditions or settings.

[1656] A "system" refers to an entire system that integrates a set of means and functions and operates to achieve a specific task or purpose.

[1657] MODE FOR CARRYING OUT THE INVENTION

[1658] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. This system allows visitor information to be promptly and appropriately notified to specific individuals, enabling responses according to meeting schedules.

[1659] System configuration

[1660] The system includes the following major components:

[1661] 1. Server

[1662] 2. Terminal

[1663] 3. Users

[1664] Server Features

[1665] The server manages the conference schedule database and has the function of adding and updating conference information for each user. It also receives visitor information, determines the availability of specific users based on that information, and conveys the information using appropriate notification methods. Specific functions are as follows:

[1666] Managing the meeting schedule: The server uses the addMeeting method to add a new meeting to the user's meeting schedule.

[1667] Determining Availability: The server uses the isAvailable method to determine whether a particular user is available at a specified date and time.

[1668] Selection of notification method and notification: The server selects the most appropriate notification method (extension phone, email, chat) and calls the notifyUser method to send the information.

[1669] Device Features

[1670] The terminal is the hardware that provides the interface for users to input meeting schedules and visitor information. Specific functions are as follows:

[1671] Entering a meeting schedule: When a user enters a meeting schedule on a terminal, the information is sent to the server and added to the database.

[1672] Entering visitor information: When a visitor arrives, the receptionist uses a terminal to enter the visitor information and sends it to the server.

[1673] User Roles

[1674] Users use this system to receive visitor information. The specific roles are as follows:

[1675] Receiving notifications: If the user wants to be notified by email, the server calls the notifyUser method and sends the visitor information by email. After receiving the information, the user can take appropriate action to respond to the visitor.

[1676] Specific operation example

[1677] 1. Registering a meeting schedule

[1678] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1679] The terminal sends this information to the server, which registers it in a conference schedule database.

[1680] 2. Entering and notifying visitor information

[1681] The guests arrive at 10:30 on October 1st.

[1682] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1683] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1684] The server selects the most appropriate notification means (for example, email) and sends the visitor information to the user.

[1685] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1686] When inputting a generative AI model, you can use prompts like the following:

[1687] Example prompt for adding a scheduled meeting:

[1688] Add a meeting to User A's schedule from 10:00 to 11:00 on October 1st.

[1689] Example of a prompt to notify visitors:

[1690] A visitor arrived at 10:30 on October 1st. Please notify User A, who is in the meeting, by email.

[1691] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1692] Step 1: Schedule a meeting

[1693] Terminal

[1694] The user uses an interface to input a meeting schedule. The user inputs "a meeting from 10:00 to 11:00 on October 1st" on the terminal. This information is sent from the terminal to the server.

[1695] Input: Information such as meeting date and time, target audience, and meeting name.

[1696] Output: The meeting schedule information sent to the server.

[1697] Specific behavior:

[1698] The user enters the details of the meeting on the terminal and presses the "Send" button to send the data to the server. At this time, the terminal checks the format of the input data.

[1699] Step 2: Registering a meeting schedule

[1700] server

[1701] The server receives the meeting schedule information sent from the terminal and adds this information to the meeting schedule database using the addMeeting method.

[1702] Input: Meeting schedule information sent from the terminal.

[1703] Output: The new meeting schedule added to the meeting schedule database.

[1704] Specific behavior:

[1705] The server checks the format of the received data and registers it in the database. If necessary, it notifies the user that registration is complete.

[1706] Step 3: Enter visitor information

[1707] Terminal

[1708] The receptionist uses an interface to enter visitor information, such as the visitor's name, arrival time, and purpose of visit, and then sends this information to the server.

[1709] Input: Guest name, arrival time, purpose of visit, etc.

[1710] Output: Visitor information sent to the server.

[1711] Specific behavior:

[1712] The receptionist enters the visitor information on the terminal and presses the "Send" button to send the data to the server. The terminal performs an initial check of the entered data.

[1713] Step 4: Receiving visitor information

[1714] server

[1715] The server receives the visitor information sent from the terminal and stores the received information in its internal memory.

[1716] Input: Visitor information sent from the device.

[1717] Output: Visitor information stored in internal memory.

[1718] Specific behavior:

[1719] The server receives the visitor information, checks the data format, and stores it in its internal memory.

[1720] Step 5: Determine availability

[1721] server

[1722] The server uses the isAvailable method to check whether a particular user is available at a specified date and time. It checks the guest information against the conference schedule database to determine availability.

[1723] Input: Conference schedule database, visitor information.

[1724] Output: Availability status (available, in a meeting, busy, etc.).

[1725] Specific behavior:

[1726] Based on the arrival time of the visitor information received by the server, the server queries the conference schedule database to check the usage status of a specific user, and stores the results in internal memory.

[1727] Step 6: Select notification methods

[1728] server

[1729] Based on availability, the server will select the most appropriate notification method (extension, email, chat) depending on the user's preferences and current state.

[1730] Input: Availability status, user preference.

[1731] Output: The selected notification method.

[1732] Specific behavior:

[1733] The server runs an algorithm that looks at availability and user preferences to choose the best notification method, for example, email if the user prefers email notifications.

[1734] Step 7: Notify users

[1735] server

[1736] The server uses the selected notification method to call the notifyUser method and send the visitor information to the user. For example, if email is selected, an email containing the visitor information is created and sent.

[1737] Input: Selected notification method, visitor information.

[1738] Output: Notification sent to the user (phone extension, email, chat message).

[1739] Specific behavior:

[1740] The server sends the visitor information via the selected notification method. For example, if the user selects email, the server connects to the mail server and sends an email containing the visitor information. The user receives this notification and takes appropriate action.

[1741] (Application example 1)

[1742] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1743] In brick-and-mortar stores, it is difficult for busy store staff to efficiently respond to customers. In particular, if visitor information is not notified in a timely manner based on the staff's work schedule, response delays and lack of communication with customers can occur. A system that can solve these problems and provide quick and appropriate responses to customers is needed.

[1744] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1745] In this invention, the server includes a means for managing work schedule information for each individual, a means for receiving visitor information, a means for determining the availability of a specific individual based on the work schedule information and visitor information, and a means for notifying the specific individual of the visitor information. This makes it possible to notify the store staff of the visitor information at the optimal timing based on their work schedules.

[1746] Definitions of important words with application examples

[1747] "Work schedule information management" is a system that records each individual's working hours and shifts and manages daily work status.

[1748] "Visitor information reception" is a system in which the system takes in information about customers who visit the store and delivers that information to the staff member who needs to respond.

[1749] "Availability determination" is the process by which the system determines whether an individual is currently available based on their work schedule and other conditions.

[1750] "Visitor information notification" refers to notifying a specific individual of the date and time when future customer service is required.

[1751] "Push notifications" are a notification method that provides real-time information to smartphones and other devices.

[1752] "Email" is a digital message sent and received over the Internet.

[1753] "Chat" is a text-based real-time communication method.

[1754] "In progress" refers to a situation in which a specific individual is already engaged in other work or customer service.

[1755] overview

[1756] This invention is a system that enables efficient and appropriate customer service in a physical store by linking staff work schedule information with visitor information. This system includes means for managing staff work schedule information and inputting and receiving visitor information. Furthermore, the system determines staff availability based on visitor information and notifies staff at the optimal timing, thereby achieving fast and efficient customer service.

[1757] System configuration

[1758] The system includes the following major components:

[1759] 1. Server

[1760] 2. Devices (staff smartphones, reception tablets)

[1761] 3. User (store staff)

[1762] Server Processing

[1763] The server manages staff work schedule information and receives visitor information. The server achieves this by:

[1764] Work schedule information management tool

[1765] The server receives work schedule information from staff and stores it in a database, allowing you to manage when specific staff members are working.

[1766] Visitor information receiving means

[1767] The server receives customer information from the reception desk and stores it in a database. When the receptionist enters customer information using a tablet device, the server receives the information.

[1768] Means for determining availability of response

[1769] The server determines staff availability based on work schedule information and visitor information. For example, it checks the work schedule to determine whether a staff member is currently working on another task. This determination is made using the isAvailable method.

[1770] Visitor information notification means

[1771] The server selects the most appropriate notification method and notifies the specific staff member of the visitor information. Notification methods include push notification, email, and chat. For example, the notifyStaff method is used to send a push notification to the staff member's smartphone.

[1772] Terminal handling

[1773] The terminals used by staff and receptionists work as follows:

[1774] Work schedule entry

[1775] Staff members use their smartphones to enter their work schedules, which are then sent to a server and stored in a database.

[1776] Enter visitor information

[1777] The receptionist uses a tablet to enter visitor information, which is then sent to the server and stored in a database.

[1778] User Action

[1779] Store staff receive notifications on their smartphones:

[1780] Receive notifications

[1781] Customer information is sent to staff members' smartphones via push notifications, email, and chat. For example, by receiving a notification such as "A customer with a reservation is scheduled to arrive at 2 p.m.", staff can respond at the appropriate time.

[1782] Specific examples

[1783] Registering work schedules

[1784] Staff members use their smartphones to enter their work schedules. For example, they might enter "Working from 10:00 to 18:00 on October 1st."

[1785] The terminal sends this information to the server, which registers the information in a database.

[1786] Entering and notifying visitor information

[1787] The receptionist uses a tablet to enter visitor information. For example, they might enter "Reservation to visit on October 1st at 2pm."

[1788] The terminal sends this information to a server, which stores the information in a database.

[1789] The server checks the staff's work schedules and determines which staff are available at 2 p.m. For example, it checks using the isAvailable method.

[1790] The server selects the best notification method (push notification) and sends the information to a specific staff member, for example, by using the notifyStaff method.

[1791] Prompt Sentence Examples

[1792] Create an endpoint for your Flask application that meets the following criteria:

[1793] Add a staff member's shift schedule with a POST request.

[1794] Use a GET request to check if a specific staff member is available at a specified time.

[1795] Send notifications to staff members with a POST request.

[1796] Data is stored in a simple in-memory database.

[1797] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1798] System processing steps

[1799] Step 1:

[1800] Registering work schedules

[1801] explanation:

[1802] The server receives the staff's work schedule information sent from the terminal. The terminal sends the work schedule data entered by the user to the addShift endpoint. The server saves this information in a database.

[1803] input:

[1804] Work schedule entered by the user into the terminal (e.g., staff ID and work date and time)

[1805] Data processing and calculation:

[1806] The server uses the received work schedule information to update existing schedule data or add new schedule data.

[1807] output:

[1808] The work schedule is saved in the database, and the server responds by sending a "Registration successful" message to the terminal.

[1809] Step 2:

[1810] Entering visitor information

[1811] explanation:

[1812] The server receives visitor information sent from the reception terminal. The receptionist enters the visitor information into a tablet and sends it to the server. The server stores this information in a database.

[1813] input:

[1814] Visitor information entered by the receptionist into the tablet (e.g., visitor's name, planned visit date and time)

[1815] Data processing and calculation:

[1816] The server processes the received visitor information and stores it in a database.

[1817] output:

[1818] The visitor information is saved in the database, and the server responds by sending a message to the reception terminal saying, "Visitor information has been registered."

[1819] Step 3:

[1820] Determining availability

[1821] explanation:

[1822] Based on the visitor information, the server determines which staff members are available on the work schedule at the relevant date and time. It uses the isAvailable method to identify staff members who are not available.

[1823] input:

[1824] Visitor information and work schedule information (e.g., planned visit time)

[1825] Data processing and calculation:

[1826] The server checks the customer's planned arrival time against work schedule data to determine which staff member is available to handle the customer. Specifically, it searches the work schedule information in the database for staff who are available on the relevant date and time.

[1827] output:

[1828] A list of available staff members is generated, and the server responds with the "Available Staff Determination Result."

[1829] Step 4:

[1830] Visitor information notification

[1831] explanation:

[1832] Based on the result of the judgment, the server selects the most appropriate notification method and sends the visitor information to the available staff member. The notifyStaff method is used to select one of the following: push notification, email, or chat.

[1833] input:

[1834] Available staff list, notification message (e.g. "A customer with a reservation is expected to arrive at 2 p.m.")

[1835] Data processing and calculation:

[1836] The server selects the most appropriate notification method for available staff and sends the notification message, specifically using a push notification API or an email sending library.

[1837] output:

[1838] The staff member receives the notification, and the server responds with "Notification sent."

[1839] The above steps enable efficient work schedule management and customer service in physical stores.

[1840] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1841] overview

[1842] This invention is a system that links each individual's meeting schedule with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. This system quickly and appropriately notifies specific individuals of visitor information, enabling visitor response according to the specific individual's meeting schedule and emotions.

[1843] System configuration

[1844] The system includes the following main components:

[1845] 1. Server

[1846] 2. Terminal

[1847] 3. Users

[1848] 4. Emotion Engine

[1849] Program processing

[1850] 1. Server

[1851] The server manages the conference schedule database, adds and updates each user's conference information, and receives visitor information. Based on that information, the server selects the optimal notification method according to the availability of the specific user and the emotion determined by the emotion engine, and then transmits the information.

[1852] For example, the server can use the addMeeting method to add a new meeting to a user's meeting schedule, the isAvailable method to check whether a particular user is available at a specified date and time, and the emotion engine to analyze the user's emotions and the notifyUser method to select the most appropriate notification method and send the information.

[1853] 2. Terminal

[1854] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[1855] 3. Users

[1856] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[1857] 4. Emotion Engine

[1858] The emotion engine determines the user's emotions through voice input, facial expression analysis, text analysis, etc. For example, it determines emotions by analyzing the tone of voice and facial expressions when the user speaks to the device, or the content of chat messages. The emotion engine provides this information to the server, which then selects a notification method according to the emotion.

[1859] Specific examples

[1860] Registering a meeting schedule

[1861] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1862] The terminal sends this information to the server, which registers it in a conference schedule database.

[1863] Entering and notifying visitor information

[1864] The guests arrive at 10:30 on October 1st.

[1865] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1866] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1867] The server uses an emotion engine to determine the user's current emotion from their voice input and facial expressions.

[1868] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[1869] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1870] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[1871] The processing flow will be explained below.

[1872] Step 1:

[1873] The terminal provides an interface for users to input meeting schedules, including details such as the date, time, location, and participants of the meeting.

[1874] Step 2:

[1875] The terminal sends the entered meeting schedule information to the server using an HTTP request or an API call.

[1876] Step 3:

[1877] The server adds a new meeting to the database based on the received meeting schedule information. The server uses the addMeeting method to register this information in the meeting schedule database.

[1878] Step 4:

[1879] The receptionist receives the visitor information. The terminal provides an interface for the visitor to input information such as the date and time of the visit, the purpose of the visit, and the visitor's name.

[1880] Step 5:

[1881] The terminal sends the entered visitor information to the server, again using an HTTP request or API call.

[1882] Step 6:

[1883] Based on the received visitor information, the server checks whether the visitor's visiting time overlaps with the specific user's scheduled meeting. The server uses the isAvailable method to determine whether the user is available at that time.

[1884] Step 7:

[1885] The server checks the user's schedule to see if there is a meeting at that time. If it determines that there is a meeting, it uses an emotion engine to determine the user's emotion.

[1886] Step 8:

[1887] The emotion engine uses the user's voice input, facial expression analysis, or text analysis to determine the user's emotion. For example, it may determine that the user is tired.

[1888] Step 9:

[1889] The server selects the most appropriate notification method based on the user's emotion determined by the emotion engine. For example, if the user is feeling stressed, notification by email is selected.

[1890] Step 10:

[1891] The server uses the selected notification method to call the notifyUser method to notify the specific user of the visitor information. The notification content includes the visitor's name, time of visit, purpose of visit, etc.

[1892] Step 11:

[1893] The user receives a notification from the server and checks it on their terminal or mobile device during a meeting. The user recognizes that they need to attend to a visitor and decides on an appropriate response method.

[1894] Step 12:

[1895] Users can pause the meeting or attend to the visitor in other ways as needed, so that the visitor can be served quickly without having to wait for a long time.

[1896] Example 2

[1897] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1898] In conventional visitor response systems, it was difficult to link each individual's meeting schedule information with visitor information, making it difficult to respond efficiently. Furthermore, because the notification method was selected uniformly without considering the user's emotional state, users sometimes felt stressed or were unable to respond appropriately. In particular, when notifying users during a meeting, it was necessary to select an appropriate method, and a system that could achieve this was needed.

[1899] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1900] In this invention, the server includes means for managing each individual's meeting schedule information, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion analysis means for determining the user's emotion, means for selecting the optimal notification means in accordance with the user's emotion determined by the emotion analysis means, and means for notifying the specific individual of the visitor information. This enables the meeting schedule information and visitor information of each individual to be linked, the optimal notification means to be selected taking into consideration the user's emotional state, and a quick and efficient response to be made.

[1901] "Meeting schedule information" is data that includes detailed information such as the dates, times, and locations of individual plans and meetings.

[1902] "Visitor information" is data that includes detailed information such as the visitor's name, the date and time of the visit, and the purpose of the visit.

[1903] "Availability status" is a status indicating whether an individual has no meetings or appointments and is available to attend to visitors on a specific date and time.

[1904] "Emotion analysis means" refers to technology for determining a user's current emotional state through voice input, facial expression analysis, text analysis, and the like.

[1905] "Notification means" refers to a method for transmitting information to a specific individual, and specifically includes internal telephone calls, emails, chats, etc.

[1906] The "server" is a computer system that manages each individual's meeting schedule information and visitor information, performs emotion analysis as needed, and sends appropriate notifications.

[1907] A "terminal" is a device used by a user or a receptionist to input meeting schedules and visitor information, and includes a PC, tablet, smartphone, etc.

[1908] overview

[1909] The present invention relates to a system that links each individual's meeting schedule information with visitor information to realize efficient visitor response. Furthermore, by combining it with an emotion analysis means that recognizes the user's emotions, it provides an optimal notification method according to the user's emotions. In this way, visitor information can be quickly and appropriately notified to specific individuals, enabling visitor response according to the user's meeting schedule and emotions.

[1910] Hardware and software used

[1911] The system uses the following main hardware and software:

[1912] Server: Database management, schedule checking, sentiment analysis, and sending notifications.

[1913] Terminal: The device (computer, tablet, smartphone, etc.) used by users and receptionists to enter information.

[1914] Emotion analysis means: Software that analyzes user emotions through voice input, facial expression analysis, and text analysis.

[1915] Program processing

[1916] server:

[1917] The server manages the conference schedule database and adds and updates conference information for each user. It also receives visitor information and, based on that information, selects the optimal notification method according to the availability status of a specific user and the emotions determined by the emotion analysis means, and transmits the information. For example, the server uses the addMeeting method to add a new conference to a user's conference schedule. It also uses the isAvailable method to check whether a specific user is available at a specified date and time. It then uses the emotion analysis means to analyze the user's emotions, selects the optimal notification method using the notifyUser method, and sends the information.

[1918] Device:

[1919] The terminal is used to input the user's meeting schedule and visitor information. For example, when a user inputs a meeting schedule into the terminal, the information is sent to the server and added to the database. When a visitor arrives, the receptionist uses the terminal to input visitor information and sends it to the server.

[1920] User:

[1921] Users use this system to receive visitor information. For example, if a user requests to be notified by email, the server calls the notifyUser method and sends the visitor information to the user by email. The user receives the information and handles the visitor appropriately.

[1922] Emotion analysis means:

[1923] The emotion analysis means determines the user's emotion through the user's voice input, facial expression analysis, text analysis, etc. For example, it determines the emotion by analyzing the tone of voice and facial expression when the user speaks to the terminal, or the content of chat messages. The emotion analysis means provides this information to the server, and the server selects a notification means according to the emotion.

[1924] Specific examples

[1925] Schedule a meeting:

[1926] The user uses the terminal to input "a meeting from 10:00 to 11:00 on October 1st."

[1927] The terminal sends this information to the server, which registers it in a conference schedule database.

[1928] Visitor information entry and notification:

[1929] The guests arrive at 10:30 on October 1st.

[1930] The receptionist uses a terminal to input this visitor information and transmits it to the server.

[1931] The server checks the user's meeting schedule and finds that the user is in a meeting at 10:30.

[1932] The server utilizes emotion analysis means to determine the user's current emotion from their voice input and facial expressions.

[1933] If a user is stressed, the server will avoid internal phone calls and chats and notify them via email.

[1934] The user receives an email notification saying, "A visitor will arrive at 10:30 on October 1st. Please adjust the time as we are in a meeting."

[1935] In this way, this system links each individual's meeting schedule with visitor information, and takes into account the user's emotions to achieve quick and efficient visitor response.

[1936] Example prompts to input to the generative AI model

[1937] "There is a system that integrates a user's meeting schedule and visitor information, and also combines emotion recognition to provide the most appropriate notification method. The process is as follows:

[1938] 1. The user enters the meeting schedule using a terminal, and the server registers this information in a database.

[1939] 2. The receptionist uses a terminal to enter visitor information, and the server temporarily stores this information.

[1940] 3. The server checks the user's schedule and analyzes the user's emotions using an emotion analysis method.

[1941] 4. The server selects the most appropriate notification method and notifies the user of the visitor information.

[1942] For example, if the user is stressed, the server will send a notification via email.

[1943] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1944] Step 1: Schedule a meeting

[1945] Device:

[1946] A user uses a terminal to input details of a meeting schedule, such as the name of the meeting, the date and time, and the location.

[1947] input:

[1948] Schedule information for "Meeting on October 1st from 10:00 to 11:00"

[1949] Data processing and calculation:

[1950] The terminal correctly formats the entered meeting schedule information.

[1951] output:

[1952] The formatted meeting schedule information is sent to a server.

[1953] Specific operation:

[1954] The user enters "a meeting from 10:00 to 11:00 on October 1st" into the terminal and presses the "Register" button. The terminal then sends this information to the server.

[1955] Step 2: Registering meeting schedule data

[1956] server:

[1957] The conference schedule data sent from the terminal is received, and a new conference is registered in the database using the addMeeting method.

[1958] input:

[1959] Meeting schedule information sent from the device

[1960] Data processing and calculation:

[1961] The server checks the data for consistency and ensures that it is in the correct format.

[1962] output:

[1963] The conference schedule information is registered in the database and a success message is returned.

[1964] Specific operation:

[1965] The server receives the data "Meeting from 10:00 to 11:00 on October 1st," verifies its consistency, and then registers it in the database.

[1966] Step 3: Enter visitor information

[1967] Device:

[1968] The receptionist uses a terminal to input visitor information, such as the visitor's name, date and time of visit, and purpose of visit.

[1969] input:

[1970] Information on "Visiting at 10:30 on October 1st"

[1971] Data processing and calculation:

[1972] The terminal correctly formats the entered visitor information.

[1973] output:

[1974] The formatted guest information is sent to a server.

[1975] Specific operation:

[1976] The receptionist enters the information "A visitor will arrive at 10:30 on October 1st" into the terminal and presses the "Send" button. The terminal then sends this information to the server.

[1977] Step 4: Receiving and temporarily storing visitor information

[1978] server:

[1979] Visitor information sent from the terminal is received and temporarily stored.

[1980] input:

[1981] Visitor information sent from the device

[1982] Data processing and calculation:

[1983] The server temporarily stores the visitor information and prepares it for use in subsequent steps.

[1984] output:

[1985] Temporarily saved visitor information

[1986] Specific operation:

[1987] The server receives the information that "a visitor will arrive at 10:30 on October 1st" and temporarily stores it.

[1988] Step 5: Check user availability

[1989] server:

[1990] Based on the visitor information, the isAvailable method is used to check the meeting schedule of the relevant user and determine whether the user is available at the specified date and time.

[1991] input:

[1992] Temporarily saved visitor information and user meeting schedule information

[1993] Data processing and calculation:

[1994] The server checks the meeting schedule information and visitor information in the database to see if the user is in a meeting on the relevant date and time.

[1995] output:

[1996] Determine user availability and obtain results.

[1997] Specific operation:

[1998] The server determines that "the user is in a meeting at 10:30 on October 1st."

[1999] Step 6: User sentiment analysis

[2000] Emotion analysis means:

[2001] The user's current emotional state is determined through voice input, facial expression analysis, and text analysis.

[2002] input:

[2003] Data such as user voice, facial expressions, and chat messages

[2004] Data processing and calculation:

[2005] The emotion analysis means analyzes the tone of voice, changes in facial expressions, and text content to determine the emotion the user is currently feeling.

[2006] output:

[2007] User's emotional state judgment result

[2008] Specific operation:

[2009] The emotion analysis means analyzes the user's tone of voice and facial expression and determines that "the user is feeling stressed."

[2010] Step 7: Choose the best notification method

[2011] server:

[2012] Based on the information obtained from the emotion analysis method, the optimal notification method is selected taking into account the user's emotional state. The notification is also sent using the notifyUser method.

[2013] input:

[2014] User availability and emotional state

[2015] Data processing and calculation:

[2016] The server combines availability and emotional state to select the most appropriate notification method (extension phone, email, chat, etc.).

[2017] output:

[2018] The visitor information is notified by the selected notification means.

[2019] Specific operation:

[2020] The server sends the user an email with the message "A visitor will arrive at 10:30 on October 1st. Please adjust the time as I am in a meeting."

[2021] Step 8: Receive and respond to notifications

[2022] User:

[2023] Receive visitor information via the selected notification method (e.g., email) and respond to the visitor based on the received information.

[2024] input:

[2025] Notification of visitor information sent from the server

[2026] Data processing and calculation:

[2027] The user checks the notification and decides how to respond.

[2028] output:

[2029] Deciding and implementing response methods

[2030] Specific operation:

[2031] The user receives an email notification that "a visitor will arrive at 10:30 on October 1st" and plans to respond to the request after the meeting ends.

[2032] (Application example 2)

[2033] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2034] Conventional visitor response systems primarily provide notifications based on meeting schedules and availability, and therefore are unable to provide optimal notification methods that take the user's emotional state into account. For example, if a user is feeling stressed, the system may select a notification method that is unpleasant, resulting in problems such as reduced visitor response efficiency and reduced user satisfaction. Furthermore, there has been a lack of systems for quickly and efficiently managing staff work schedules, meeting schedules, and visitor responses in commercial facilities and stores.

[2035] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2036] In this invention, the server includes means for managing meeting schedule information for each individual, means for receiving visitor information, means for determining the availability of a specific individual based on the meeting schedule information and visitor information, emotion recognition means for determining the emotional state of the specific individual, and means for selecting the optimal notification means based on the emotional state. This makes it possible to quickly and efficiently notify a specific individual of visitor information and to select the optimal notification means taking into account the emotional state of the specific individual.

[2037] "Meeting schedule information" is information held by each individual, such as the date, time, location, and participants of meetings.

[2038] "Visitor information" refers to information including the visitor's name, date and time of visit, purpose of visit, etc.

[2039] "Availability" refers to the status of whether a particular individual is free to use the facility at a specified time.

[2040] An "emotion recognition means" is a means for determining the emotional state of a specific individual through voice input, facial expression analysis, text analysis, or the like.

[2041] "Notification means" refers to a method for transmitting visitor information to a specific individual, and specifically includes internal telephone calls, emails, chats, and the like.

[2042] "Fast and efficient" means achieving objectives with minimal delay and no waste.

[2043] "Specific individuals" refers to users of this system who are the targets of notifications based on meeting schedules and visitor information.

[2044] A system embodying this invention includes the following major components:

[2045] 1. Server

[2046] The server manages each individual's meeting schedule information and receives visitor information. The server performs the following main processes:

[2047] Conference Schedule Management: Add and update users' conference schedules to the database.

[2048] Availability determination: Determine the availability of a particular individual based on meeting schedule information and visitor information.

[2049] Emotion Recognition: Emotion recognition measures are used to determine the emotional state of a particular individual.

[2050] Notification method selection: Based on the determined emotional state, the optimal notification method (extension phone, email, chat) is selected.

[2051] Examples:

[2052] When a user inputs "a meeting from 10:00 to 11:00 on October 1st," the server registers this information in the meeting schedule database. Also, if a guest arrives at 10:30 on October 1st, the server receives this information and confirms that the user is in a meeting. The server uses emotion recognition means to determine the user's emotional state, and if the user is in a relaxed state, it notifies the user by email.

[2053] 2. Terminal

[2054] The terminal is used by users to input meeting schedules and visitor information. The terminal has the following functions:

[2055] Entering a meeting schedule: When a user enters a meeting schedule using a terminal, the information is sent to the server.

[2056] Entering visitor information: The receptionist uses a terminal to enter visitor information and sends it to the server.

[2057] Examples:

[2058] When "Meeting from 10:00 to 11:00 on October 1st" is entered into the terminal, the terminal sends this information to the server. When a visitor arrives, the receptionist enters "The visitor arrived at 10:30 on October 1st" and sends this information to the server.

[2059] 3. Users

[2060] Users can use this system to receive visitor information. The notification method is selected based on the user's emotional state, allowing the user to receive notifications in the most optimal way.

[2061] Examples:

[2062] If the server analyzes the user's emotional state using an emotion recognition means and determines that the user is in a relaxed state, the user will receive a notification by email stating, "A visitor has arrived at 10:30 on October 1st."

[2063] Hardware and Software

[2064] Hardware: Smartphone, PC

[2065] Software: Python, SQL database, emotion recognition engine (EmotionEngine), notification system (NotificationSystem)

[2066] Prompt Sentence Examples

[2067] "Please check the user's meeting schedule at 10:00 on October 1st and see if they are in a meeting. Then, based on the analysis results of the emotion engine when notifying them of visitor information, please notify them in an appropriate manner."

[2068] In this way, the present invention not only links each individual's meeting schedule information with visitor information, but also uses emotion recognition to provide optimal notification methods according to the user's emotional state, enabling quick and efficient visitor response.

[2069] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2070] Step 1:

[2071] The user inputs a meeting schedule into the terminal. For example, the user inputs "a meeting from 10:00 to 11:00 on October 1st," and the terminal receives this information. The terminal then sends this input information to the server, which adds or updates the information in the meeting schedule database.

[2072] Input: User-entered meeting schedules

[2073] Data processing: Formatting meeting schedule information and saving it in a database

[2074] Output: New meeting information is added to the meeting schedule database.

[2075] Step 2:

[2076] The receptionist enters visitor information into the terminal. For example, the visitor enters that they arrived at "October 1st at 10:30," and the terminal sends this information to the server. The server receives this information and stores it in the visitor information database.

[2077] Input: Receptionist inputs visitor information

[2078] Data processing: Format the entered visitor information and save it in the database

[2079] Output: New visitor information is added to the visitor information database.

[2080] Step 3:

[2081] The server determines the availability of a specific individual based on the visitor information. The server references the conference schedule database and confirms that the user is in a conference at 10:30 on October 1st.

[2082] Input: Visitor information and meeting schedule information

[2083] Data processing: Determining availability

[2084] Output: Availability of a particular person is determined

[2085] Step 4:

[2086] The server uses emotion recognition means to determine the emotional state of a particular individual, analyzing whether the user is stressed or relaxed through voice analysis, facial expression analysis, or text analysis.

[2087] Input: Voice, facial expression, and text data of a specific individual

[2088] Data processing: Emotional state analysis

[2089] Output: The emotional state of a particular individual is determined.

[2090] Step 5:

[2091] The server selects the optimal notification method based on the determined emotional state. For example, if the user is relaxed, notification by email is selected. Depending on the emotional state, notification methods such as extension phone, email, chat, etc. are set.

[2092] Input: The emotional state of a particular individual

[2093] Data processing: Selection of notification method

[2094] Output: The optimal notification method is selected.

[2095] Step 6:

[2096] The server notifies the specific individual of the visitor information using the selected notification method. For example, if email is selected, a notification email stating "A visitor arrived at 10:30 on October 1st" will be sent.

[2097] Input: Selected notification method and visitor information

[2098] Data processing: generating and sending notification information

[2099] Output: A specific individual is notified of the visitor information

[2100] Through these steps, users can efficiently receive visitor information and receive optimal notifications according to their emotional state.

[2101] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2102] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2103] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2104] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2105] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2106] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2107] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2108] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2109] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2110] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2111] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2112] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2113] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2114] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2115] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2116] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2117] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2118] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2119] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2120] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2121] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2122] The following is further disclosed regarding the above embodiment.

[2123] (Claim 1)

[2124] a means for managing individual meeting schedule information;

[2125] A means for receiving visitor information;

[2126] means for determining availability of a specific individual based on the meeting schedule information and visitor information;

[2127] A means for notifying specific individuals of visitor information;

[2128] A system including:

[2129] (Claim 2)

[2130] 2. The system according to claim 1, wherein the specific individual is notified of visitor information by using an extension telephone, email, or chat.

[2131] (Claim 3)

[2132] 10. The system of claim 1, wherein if the specific individual is in a meeting, the visitor information is notified using another means.

[2133] "Example 1"

[2134] (Claim 1)

[2135] a means for managing conference schedule information;

[2136] A means for receiving visitor information;

[2137] A means for determining availability of a specific individual based on the received visitor information;

[2138] A means of verifying the availability of a particular individual at a specified date and time;

[2139] A means for notifying specific individuals of visitor information;

[2140] means for selecting an optimal notification means according to the availability status;

[2141] A system including:

[2142] (Claim 2)

[2143] 2. The system according to claim 1, wherein visitor information is notified to a specific individual by using an internal telephone number, email, or chat.

[2144] (Claim 3)

[2145] 10. The system of claim 1, wherein if a particular individual is in a meeting, another means is used to notify the visitor information.

[2146] "Application Example 1"

[2147] (Claim 1)

[2148] A means for managing each individual's work schedule information;

[2149] A means for receiving visitor information;

[2150] A means for determining the availability of a specific individual based on the work schedule information and visitor information;

[2151] A means for notifying specific individuals of visitor information;

[2152] A system including:

[2153] (Claim 2)

[2154] The system according to claim 1, wherein the specific individual is notified of visitor information using push notification, email, or chat.

[2155] (Claim 3)

[2156] The system according to claim 1, wherein when the specific individual is busy, the visitor information is notified using another means.

[2157] Combination New Matters

[2158] 1. Work schedule information management: Manage which store staff are working and when

[2159] 2. Visitor notification methods: Push notifications, emails, chats, etc.

[2160] 3. Response status detection: Determine whether staff are responding or not, and flexibly select different notification methods

[2161] These changes specifically outline a system that will enable staff to efficiently handle customers in physical stores.

[2162] "Example 2: Combining Emotion Engines"

[2163] (Claim 1)

[2164] a means for managing individual meeting schedule information;

[2165] A means for receiving visitor information;

[2166] means for determining availability of a specific individual based on the meeting schedule information and visitor information;

[2167] emotion analysis means for determining the emotion of a user;

[2168] means for selecting an optimal notification means in accordance with the user's emotion determined by the emotion analysis means;

[2169] A means for notifying specific individuals of visitor information;

[2170] A system including:

[2171] (Claim 2)

[2172] 2. The system according to claim 1, wherein visitor information is notified using an internal telephone line, email, or chat.

[2173] (Claim 3)

[2174] 2. The system according to claim 1, wherein when the specific individual is in a meeting, the visitor information is notified using another means depending on the emotion determined by the emotion analysis means.

[2175] "Application example 2 when combining emotion engines"

[2176] (Claim 1)

[2177] a means for managing individual meeting schedule information;

[2178] A means for receiving visitor information;

[2179] means for determining availability of a specific individual based on the meeting schedule information and visitor information;

[2180] A means for notifying specific individuals of visitor information;

[2181] an emotion recognition means for determining the emotional state of a particular individual;

[2182] A means for selecting an optimal notification means based on the emotional state;

[2183] A system including:

[2184] (Claim 2)

[2185] 2. The system according to claim 1, wherein the specific individual is notified of visitor information by using an extension telephone, email, or chat.

[2186] (Claim 3)

[2187] 10. The system of claim 1, wherein if the specific individual is in a meeting, the visitor information is notified using another means. [Explanation of symbols]

[2188] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for managing individual meeting schedule information; A means for receiving visitor information; means for determining availability of a specific individual based on the meeting schedule information and visitor information; A means for notifying specific individuals of visitor information; A system including:

2. 2. The system according to claim 1, wherein the visitor information is notified to the specific individual by using any one of an extension telephone, e-mail, and chat.

3. The system of claim 1, wherein if the particular individual is in a meeting, another means is used to notify the visitor information.

Citation Information

Patent Citations

  • Persona chatbot control method and system

    JP2022180282A