system

Abstract

We provide the system. [Solution] A means by which the user inputs and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal, The aforementioned communication terminal includes means for analyzing the visitor's name and scheduled arrival date and time using the messaging application, The communication terminal includes means for transmitting the analyzed visitor name and scheduled arrival date and time to the server, A means for reserving a meeting room based on the visitor's name and scheduled arrival date and time received by the server, A system including means for the server to generate and send an informational email based on the reservation of the meeting room.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional method for handling visitors, it takes time and effort to manually input visitor information, make a reservation for a meeting room, and send an invitation email. This work is inefficient and prone to human errors. Also, manually inputting business card information is cumbersome. Furthermore, since it takes labor to make a reservation while checking the availability of the meeting room, it is difficult to improve work efficiency. Therefore, there is a need for a system that reduces the workload of handling visitors and processes accurately and quickly.

Means for Solving the Problems

[0005] The present invention is a system that includes means for a user to input and send a visitor's name and scheduled arrival date and time using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor's name and scheduled arrival date and time using the messaging application; means for the communication terminal to send the analyzed visitor's name and scheduled arrival date and time to a server; means for the server to reserve a meeting room based on the received visitor's name and scheduled arrival date and time; and means for the server to generate and send an information email based on the meeting room reservation.

[0006] The system further includes means for the user to send an image of a business card and the scheduled date and time of visit to a communication terminal, means for the communication terminal to analyze the image of the business card and extract the visitor's name, and means for the communication terminal to send the extracted visitor's name and scheduled date and time of visit to a server.

[0007] Furthermore, the system includes means for the server to check the availability of meeting rooms and select the most suitable meeting room, means for the server to save meeting room reservation information to a database, and means for a communication terminal to notify the user of a successful meeting room reservation.

[0008] This invention allows for easy registration of visitor information and scheduled arrival dates and times, automatically reserving meeting rooms and sending invitation emails. This improves operational efficiency and reduces human error. Furthermore, using business card images for information registration enables even faster and more accurate processing.

[0009] A "user" refers to the entity that operates the system and inputs and submits visitor information and scheduled visit dates and times.

[0010] A "communication terminal" refers to an electronic device that a user installs and uses with a messaging application.

[0011] A "messaging application" is software that runs on a communication terminal and is a platform for users to send and receive messages.

[0012] "Visitor name" refers to the name information of the visitor.

[0013] The "scheduled arrival date and time" refers to the information on the date and time when the visitor is scheduled to arrive at the company.

[0014] The "server" refers to a computer system for receiving, analyzing, and processing information transmitted from a communication terminal.

[0015] The "meeting room" refers to a room for specific purposes.

[0016] "Reservation" refers to the procedure for securing a meeting room at a specific date and time.

[0017] The "guidance email" refers to an email containing detailed information on the scheduled visit to the company.

[0018] The "business card image" refers to the image data obtained by photographing the visitor's business card.

[0019] "Analysis" refers to the process of extracting necessary information from the received information and image data.

[0020] The "optimal meeting room" refers to the most suitable meeting room considering the availability and other constraints.

[0021] The "database" refers to a system for managing and storing reservation information of meeting rooms and other related data.

[0022] The "reservation success notification" refers to a message informing the user that the reservation of the meeting room has been successfully completed.

Brief Explanation of Drawings

[0023] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0024] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0025] First, the terms used in the following description will be explained.

[0026] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0027] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0028] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0029] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0030] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0031] [First Embodiment]

[0032] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0033] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0034] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0035] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0036] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0037] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0038] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0039] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0040] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0041] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0042] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0043] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0044] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit.

[0045] 1. Enter and submit visitor information.

[0046] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user sends a message in the format of "Taro Yamada, December 1, 2023, 10:00". Alternatively, the user can attach an image of a business card and enter "December 1, 2023, 10:00" and send it.

[0047] 2. Receiving and parsing messages

[0048] The communication terminal receives messages from the user and analyzes their content. For example, the terminal might extract information such as "Taro Yamada" and "December 1, 2023, 10:00". In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Yamada". The analyzed information is then sent to the server.

[0049] 3. Booking a meeting room via the server

[0050] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, if the server receives data such as "Taro Yamada" and "December 1, 2023, 10:00," it sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0051] 4. Generating and sending the notification email

[0052] After the server confirms that the meeting room reservation was successful, it generates and sends an invitation email to the visitor and related users. For example, an email with the following content is generated and sent: "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1, 2023."

[0053] 5. Notification to the user

[0054] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal displays "Reservation successful" on the screen to inform the user. With this system, users only need to easily register visitor information and the scheduled date and time of visit, and the system will automatically reserve a meeting room and send out confirmation emails, improving work efficiency and reducing human error.

[0055] Specific example

[0056] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of meeting rooms, reserves meeting room B, and generates a confirmation email. The confirmation email is then sent with the message, "Dear Taro Yamada, We look forward to seeing you in meeting room B at 10:00 on December 1, 2023." Finally, the communication terminal notifies the user that the reservation was successful.

[0057] Thus, the system of the present invention enables efficient handling of visitors while minimizing the burden on the user.

[0058] The following describes the processing flow.

[0059] Step 1:

[0060] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Yamada, December 1, 2023, 10:00" and send it.

[0061] Step 2:

[0062] The communication terminal receives a message from the user and analyzes its contents. For example, if the terminal receives the message "Taro Yamada, December 1, 2023, 10:00", it separates and extracts the name and date / time.

[0063] Step 3:

[0064] The communication terminal sends the analyzed visitor's name and scheduled arrival date and time to the server. For example, the terminal sends the information "Taro Yamada" and "December 1, 2023, 10:00" to the server.

[0065] Step 4:

[0066] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "December 1, 2023, 10:00".

[0067] Step 5:

[0068] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room B is available.

[0069] Step 6:

[0070] The server reserves Conference Room B with the request "Taro Yamada" and "December 1, 2023, 10:00," and saves this reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0071] Step 7:

[0072] The server confirms the successful reservation of the meeting room and generates an invitation email. For example, it might generate an email with the message, "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1st, 2023."

[0073] Step 8:

[0074] The server sends invitation emails to the relevant users and visitors. For example, the server sends the above email to the user and Taro Yamada.

[0075] Step 9:

[0076] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user.

[0077] (Example 1)

[0078] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0079] Conventional meeting room reservation systems often required users to make reservations manually, which was time-consuming and cumbersome. Furthermore, errors were prone to occur during the reservation process, potentially leading to scheduling discrepancies and duplicate bookings. This invention aims to solve these problems, reduce the burden on users, and provide a system that efficiently automates meeting room reservations and the sending of confirmation emails.

[0080] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0081] In this invention, the server includes means for a user to input and send a visitor's name and scheduled date and time of visit using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor's name and scheduled date and time of visit using the messaging application; means for the communication terminal to send the analyzed visitor's name and scheduled date and time of visit to the server; means for the server to reserve a meeting room based on the received visitor's name and scheduled date and time of visit; means for the server to generate and send an information email based on the meeting room reservation; means for the communication terminal to receive a reservation success notification from the server and notify the user; means for the user to send an image of a business card and the scheduled date and time of visit to the communication terminal; means for the communication terminal to analyze the image of the business card and extract the visitor's name; means for the communication terminal to send the extracted visitor's name and scheduled date and time of visit to the server; means for the server to check the availability of meeting rooms and select the most suitable meeting room; and means for the server to store the meeting room reservation information in a database. This allows for easy registration of visitor information and scheduled arrival dates and times, automatically reserving meeting rooms and sending invitation emails. This improves operational efficiency and reduces human error.

[0082] A "communication terminal" is an electronic device used to send and receive data over a network.

[0083] A "messaging application" is software used to communicate with other users using data such as text and images.

[0084] "Visitor Name" refers to the full name of a visitor as specified by the user of the system.

[0085] "Scheduled visit date and time" refers to information indicating the specific date and time when the visitor is scheduled to visit the company.

[0086] "Analyzing" refers to the process of recognizing input data or information and understanding or extracting its content.

[0087] A "server" is a computer system that receives requests from communication terminals on a network and processes the data.

[0088] "Meeting room reservation" is the procedure for making a meeting room available for use at a specific date and time.

[0089] An "information email" is an email containing specific information, intended to notify or inform the recipient.

[0090] A "Reservation Success Notification" is a message that informs the user that the meeting room reservation process has been successfully completed.

[0091] A "business card image" is an image file containing the contents of a business card, saved in digital format.

[0092] "Analyzing an image" refers to the process of extracting text and other information from an image using image recognition technology.

[0093] "Meeting room availability" refers to information indicating whether a meeting room is available for use at a specific date and time.

[0094] "Saving to a database" means registering information in an electronic management system so that it can be accessed later.

[0095] The "optimal meeting room" is the one selected to best meet the specified conditions.

[0096] The present invention provides a system that automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled visit date and time using a messaging application on a communication terminal. It is also possible to perform the same process automatically simply by sending an image of a business card and the scheduled visit date and time.

[0097] First, the user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, then sends the message. At this stage, the user can either send a text message such as "Taro Yamada, December 1, 2023, 10:00," or attach an image of a business card with "December 1, 2023, 10:00" attached. This input data is processed by the messaging application installed on the communication device.

[0098] Text analysis and image recognition technologies (e.g., Google® Cloud Vision API) are used to analyze messages received by the communication terminal. In the case of text messages, the communication terminal parses them and extracts the "visitor's name" and "scheduled date and time of visit." In the case of business card images, image recognition technology extracts text information from the business card and analyzes it as the "visitor's name." The analyzed information is sent to the server via the internet.

[0099] The server analyzes the received data and checks the availability of meeting rooms based on the visitor's name and scheduled arrival date and time provided by the user. The server sends a query to the database and uses a meeting room reservation system (e.g., Microsoft® Exchange) to check meeting room availability. When the server finds an available meeting room, it reserves the room and saves the information to the database.

[0100] After a meeting room reservation is successfully completed, the server generates a confirmation email. The email will contain a message such as, "Dear Visitor, We look forward to seeing you in the meeting room at your scheduled arrival time." The confirmation email is sent via an SMTP server (for example, SendGrid).

[0101] Finally, the communication terminal receives a reservation success notification from the server and displays it to the user in the form of a notification saying "Reservation successful." This notification allows the user to confirm that the reservation has been successfully completed.

[0102] As a concrete example, when a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server then checks the availability of meeting rooms and reserves Meeting Room B. The server generates and sends an email with the content "Mr. / Ms. Taro Yamada, we will be waiting for you in Meeting Room B on December 1, 2023 at 10:00." Finally, the communication terminal notifies the user that the reservation was successful. This allows users to easily register visitor information and the planned date and time of visit, and the system will automatically reserve meeting rooms and send invitation emails, improving work efficiency and reducing human error.

[0103] (Example of prompts for a generative AI model)

[0104] Please send the message "Taro Yamada, December 1, 2023, 10:00" via a messaging application. Then, please describe the subsequent automated process.

[0105] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0106] Step 1:

[0107] The user enters the visitor's name and scheduled arrival date and time using the messaging application on their communication device and sends the message. For example, they might send a message in the format "Taro Yamada, December 1, 2023, 10:00". The input can be in text format or as an image of a business card.

[0108] Input: Visitor's name, scheduled date and time of visit

[0109] Output: Data sent to the messaging application

[0110] Step 2:

[0111] The communication terminal receives messages from users and analyzes their content. In the case of text messages, it parses them to extract the "visitor's name" and "scheduled date and time of visit." In the case of business card images, it uses image recognition technology (e.g., Google Cloud Vision API) to extract text information from the business card.

[0112] Input: Message sent by the user

[0113] Output: Analyzed visitor names and scheduled visit dates / times.

[0114] Step 3:

[0115] The communication terminal sends the analyzed visitor name and scheduled arrival date and time to the server. This allows the server to begin the next step in the reservation process.

[0116] Input: Analyzed visitor name and scheduled visit date / time data

[0117] Output: Visitor name and scheduled arrival date and time data sent to the server.

[0118] Step 4:

[0119] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server queries the database to check meeting room availability and selects an available meeting room (e.g., using Microsoft Exchange).

[0120] Input: Visitor name and scheduled date and time of visit data sent to the server.

[0121] Output: Information about the reserved meeting room

[0122] Step 5:

[0123] After the server confirms that the meeting room reservation was successful, it generates an invitation email. The email will include the message, "Dear Visitor, we look forward to seeing you in the meeting room at your scheduled arrival time." The invitation email is then sent using an SMTP server (e.g., SendGrid).

[0124] Input: Information about the reserved meeting room, visitor's name, and scheduled date and time of visit.

[0125] Output: Generated notification email

[0126] Step 6:

[0127] The communication terminal receives a notification from the server that the reservation was successful and notifies the user that "the reservation was successful." This allows the user to confirm that the reservation was successful.

[0128] Input: Booking success notification

[0129] Output: Reservation success notification displayed on the communication terminal

[0130] In this way, each step is interconnected, allowing users to simply input and submit visitor information and scheduled visit date and time, and the system will automatically reserve a meeting room and send an invitation email.

[0131] (Application Example 1)

[0132] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0133] Traditional in-store visitor management systems often involve manual processes for scheduling appointments and guiding visitors, which is time-consuming and labor-intensive. Furthermore, managing customer information properly and responding quickly is difficult, hindering improvements in customer satisfaction. Manually entering business card information, in particular, is time-consuming and prone to errors.

[0134] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0135] In this invention, the server provides means for the user to input and transmit visitor information and scheduled date and time of visit using a messaging application on a communication terminal.

[0136] The aforementioned communication terminal includes means for analyzing the visitor information and scheduled date and time of visit using the messaging application,

[0137] The aforementioned communication terminal includes means for transmitting the analyzed visitor information and scheduled visit date and time to the server,

[0138] A means for making a reservation for a room based on the visitor information and scheduled arrival date and time received by the server,

[0139] The server provides means for generating and sending a notification email based on the reservation of the reserved room,

[0140] The server includes means for linking visitors to a specific system based on the sending of the notification email.

[0141] This will automate customer reservations and guidance at physical stores, leading to improved operational efficiency and increased customer satisfaction.

[0142] A "communication terminal" is an electronic device used by a user to send and receive messages.

[0143] A "messaging application" is software that runs on a communication terminal and allows users to send or receive text messages.

[0144] "Visitor information" refers to data that includes the visitor's name and other identifiable information.

[0145] "Scheduled visit date and time" refers to the date and time when the visitor is scheduled to visit.

[0146] A "server" is a computer system that receives, analyzes, and processes information transmitted from a communication terminal.

[0147] "Rooms available for reservation" refers to rooms used for purposes such as meetings and business negotiations.

[0148] A "confirmation email" is an email generated and sent by a server to notify users of their reservation and provide detailed information.

[0149] A "business card image" is a digital image file obtained by scanning or photographing a business card.

[0150] "Analysis" is the process of extracting necessary information from input data or images and converting it into an understandable format.

[0151] "Collaboration" refers to two or more systems or software programs sharing information with each other and working together in a coordinated manner.

[0152] Embodiments of the present invention will now be described. This system is designed to efficiently manage customer reservations and guidance in physical stores.

[0153] First, the user enters visitor information and the scheduled date and time of visit using the messaging application on their communication device and sends it. If necessary, the user can also attach an image of their business card.

[0154] Next, the communication terminal analyzes the visitor information and scheduled visit date and time received through the messaging application. This analysis process involves, for example, extracting text data using Python's standard library and reading text information from business card images using OpenCV and Tesseract.

[0155] The communication terminal sends the analyzed information to the server. The information is sent in a pre-processed form, and after receiving it, the server checks the database to see if a reservation is possible. If the reservation is successful, the server automatically generates a confirmation email and sends it to the user and visitors. SMTP and the Python email library can be used to generate and send the confirmation email. The server also connects visitors to specific systems based on the sending of the confirmation email.

[0156] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of the room to be reserved, and if the reservation is successful, it generates and sends an email with the message, "Mr. / Ms. Taro Yamada, you can visit us on December 1, 2023 at 10:00. We look forward to seeing you." The communication terminal then notifies the user of the successful reservation, streamlining operations.

[0157] This system is expected to automate customer reservations and guidance, significantly improving operational efficiency and customer satisfaction in physical stores.

[0158] An example of a prompt for a generating AI model is: "We want to build a system that automatically makes reservations and sends confirmation emails based on the customer's name and scheduled date and time. The system should also allow users to send business card images, recognize the information on the business card, confirm the reservation according to the date and time of visit, and send a confirmation email."

[0159] The above details describe the embodiments of the present invention.

[0160] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0161] Step 1:

[0162] Users enter and send their appointment information using a messaging application. For example, they might enter information such as "Taro Yamada, December 1, 2023, 10:00 AM" and press the send button. They can also attach a business card image if desired. The input is in text or image format and is sent to the device via the messaging application.

[0163] Step 2:

[0164] The terminal analyzes the received message. If the message is in text format, the terminal splits the string and extracts visitor information ("Taro Yamada") and scheduled visit date and time ("December 1, 2023, 10:00"). If the message is in image format, the terminal uses OpenCV and Tesseract to extract text information from the image. The analysis results are output in the format of visitor information and scheduled visit date and time.

[0165] Step 3:

[0166] The terminal sends the analyzed visitor information and scheduled visit date and time to the server. The data is sent in JSON format or other standard formats. The terminal uses a communication protocol (e.g., HTTP) to send the pre-processed data to the server.

[0167] Step 4:

[0168] The server stores the received customer information and scheduled visit date and time in storage. The stored data is used in subsequent processing and is therefore properly managed using a database management system (e.g., MySQL®, PostgreSQL). The server analyzes the received data and generates a query for reservation confirmation.

[0169] Step 5:

[0170] The server checks the availability of the room to be reserved. It retrieves existing reservation information from storage and determines whether a new reservation is possible. In this process, an algorithm is executed that uses SQL queries to retrieve the necessary information from the database and determines whether a reservation is possible.

[0171] Step 6:

[0172] The server executes the reservation for the room in question. If the reservation is successful, the server saves the reservation information as a new entry in the database. This ensures that the reservation information is recorded in a format that can be referenced later. The server then updates the reservation status to proceed.

[0173] Step 7:

[0174] The server generates and sends an invitation email to users and visitors. The invitation email might include content such as, "Mr. / Ms. Taro Yamada, you can visit us on December 1st, 2023 at 10:00 AM. We look forward to seeing you." The server uses the SMTP protocol and the Python email library to send the email.

[0175] Step 8:

[0176] The server integrates visitor information with specific systems. For example, it sends information to external systems such as CRM systems or visitor management systems to achieve centralized data management. API calls and database integrations are used here as well.

[0177] Step 9:

[0178] The device receives a reservation success notification from the server and notifies the user. The device notifies the user via a pop-up or in-app notification. This allows the user to immediately confirm that the reservation was successful.

[0179] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0180] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending a business card image and the scheduled date and time of visit. In addition, by combining this with an emotion engine that recognizes the user's emotions, more appropriate invitation emails can be generated and delivered.

[0181] 1. Enter and submit visitor information.

[0182] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. Alternatively, the user can attach an image of a business card and enter "January 15, 2024, 2:00 PM" and send it.

[0183] 2. Receiving and parsing messages

[0184] The communication terminal receives messages from the user and analyzes their content. For example, if the terminal receives a message such as "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time. In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Tanaka". The analyzed information is then sent to the server.

[0185] 3. Emotional analysis using an emotion engine

[0186] The emotion engine analyzes message text or audio data sent by the user to determine the user's emotional state. For example, from a message such as "Taro Tanaka, January 15, 2024, 2:00 PM," the emotion engine analyzes the user's emotions and identifies positive or negative emotions from the text.

[0187] 4. Meeting room reservations via server

[0188] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, the server receives data such as "Taro Tanaka, January 15, 2024, 2:00 PM" and sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0189] 5. Generating and sending the notification email.

[0190] After the server confirms that the meeting room reservation was successful, it generates a confirmation email based on the results of the emotion engine's analysis. For example, if the emotion engine's analysis indicates a positive emotion, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM." The content and format of the email will be adjusted according to the user's emotional state.

[0191] 6. Notification to the user

[0192] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal might display "Reservation successful" on the screen to inform the user. This notification may also include the results of the emotion engine's analysis.

[0193] Specific example

[0194] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The emotion engine analyzes the message and identifies that the user's emotional state is positive. The server checks the availability of meeting rooms and reserves meeting room A. A confirmation email is generated and sent with the content "Dear Taro Tanaka, We look forward to welcoming you to meeting room A on January 15, 2024 at 14:00." Finally, the communication terminal notifies the user that the reservation was successful.

[0195] Thus, the system of the present invention can efficiently handle visitor reception while minimizing the burden on the user, and further provides a more comfortable user experience by flexibly adjusting the response according to the user's emotional state.

[0196] The following describes the processing flow.

[0197] Step 1:

[0198] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it.

[0199] Step 2:

[0200] The communication terminal receives messages sent by the user and analyzes their contents. For example, if the terminal receives the message "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time.

[0201] Step 3:

[0202] The emotion engine analyzes the message text to determine the user's emotional state. For example, the emotion engine analyzes the sent message and identifies that the user is in a positive state.

[0203] Step 4:

[0204] The communication terminal sends the analyzed visitor's name, scheduled arrival date and time, and emotional state (determined by the emotion engine) to the server. For example, the terminal might send "Taro Tanaka," "January 15, 2024, 2:00 PM," and "Positive emotional state" to the server.

[0205] Step 5:

[0206] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "January 15, 2024, 14:00".

[0207] Step 6:

[0208] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room A is available.

[0209] Step 7:

[0210] The server reserves Conference Room A with the request "Taro Tanaka, January 15, 2024, 14:00" and saves the reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0211] Step 8:

[0212] The server confirms the successful reservation of the meeting room and generates a confirmation email based on the analysis results of the emotion engine. For example, if the user's emotional state is positive, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM."

[0213] Step 9:

[0214] The server generates an announcement email and sends it to the relevant users and visitors. For example, the server sends the above email to the user and Taro Tanaka.

[0215] Step 10:

[0216] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user. This notification may also include the results of the emotion engine's analysis.

[0217] (Example 2)

[0218] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0219] Traditional meeting room reservation systems had several drawbacks, including the need for users to manually enter visitor information and planned arrival dates and times, as well as check meeting room availability and make reservations. Furthermore, the generation of confirmation emails was often formulaic and lacked the flexibility to respond to user emotions, resulting in an unsatisfactory user experience. Additionally, manual entry of business card information was sometimes required, making efficient workflow difficult.

[0220] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0221] In this invention, the server includes means for a user to input and transmit visitor information and scheduled visit date and time using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor information and scheduled visit date and time using the messaging application; means for the communication terminal to transmit the analyzed visitor information and scheduled visit date and time to the server; means for the server to reserve a meeting room based on the received visitor information and scheduled visit date and time; means for the server to analyze the user's emotions using an emotion analysis engine; and means for the server to generate and send a notification email based on the meeting room reservation and emotion analysis results. As a result, users can easily reserve meeting rooms without hassle, and it is also possible to generate flexible notification emails that respond to emotions, resulting in a more comfortable user experience.

[0222] A "communication terminal" is a device used by users to input and transmit information, and includes smartphones, tablets, and personal computers.

[0223] A "messaging application" is software used by users to send text, images, and other data, and includes chat apps and messaging platforms.

[0224] "Visitor information" refers to data about the person scheduled to visit, including their name, job title, and affiliated organization.

[0225] "Scheduled visit date and time" refers to the specific date and time when the visitor plans to visit the company.

[0226] "Analyzing" refers to the process of analyzing transmitted data and extracting and classifying the necessary information.

[0227] A "server" is a computer system that receives, processes, and stores data transmitted from a communication terminal.

[0228] "Reserving a meeting room" refers to the process of securing a meeting room that is available at a specified date and time, and recording that information in a database.

[0229] An "emotion analysis engine" is software or an algorithm that identifies emotions from text or audio data and classifies them into emotional states such as positive, negative, or neutral.

[0230] A "confirmation email" is an email generated to notify visitors / users that their meeting room reservation has been successful, and it is sent to them.

[0231] "Business card image" refers to a photograph or scanned data of a business card containing the visitor's information.

[0232] "Extracting" refers to the process of extracting necessary data from images or text.

[0233] A "database" is a system for systematically managing collected and stored information, enabling rapid information retrieval through various queries.

[0234] A "reservation success notification" is a message or notification sent to inform the user that their reservation for a meeting room has been confirmed.

[0235] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user inputs and sends visitor information and the scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit. The system also has a function to generate and deliver flexible invitation emails that respond to the user's emotions by utilizing an emotion analysis engine.

[0236] Hardware and software to be used

[0237] The communication devices used by users include smartphones, tablets, and personal computers. Messaging applications such as LINE and Slack are used. Text analysis libraries such as NLTK and spaCy are used, and OCR technology such as Tesseract is employed. Servers are envisioned to be either cloud computing resources or on-premises servers, and database management systems such as MySQL and PostgreSQL are used. Sentiment analysis engines such as Google Cloud Natural Language and IBM Watson® are used. Template engines such as Jinja2 and Mustache are used to generate notification emails, and SMTP servers such as SendGrid and Amazon SES are used.

[0238] Process Overview

[0239] 1. Enter and submit visitor information.

[0240] Users use the messaging application on their communication terminal to enter visitor information and the scheduled date and time of their visit and send it. Specifically, the user would type a message such as "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. It is also possible to attach an image of a business card and type "January 15, 2024, 2:00 PM" and send it.

[0241] 2. Receiving and parsing messages

[0242] The communication terminal receives messages from users and analyzes their content. Specifically, the communication terminal analyzes text messages and separates and extracts names and dates. In the case of business card images, the communication terminal uses OCR technology to extract text information. The analyzed information is then sent to the server.

[0243] 3. Emotional analysis using an emotion engine

[0244] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state. Specifically, the sentiment engine identifies positive, negative, or neutral emotions.

[0245] 4. Meeting room reservations via server

[0246] Based on the visitor information and scheduled arrival date and time received by the server, it checks the availability of meeting rooms and makes reservations. Specifically, the server sends a query to the database management system, selects an appropriate meeting room, and makes a reservation. The reservation information is stored in the database.

[0247] 5. Generating and sending the notification email.

[0248] After the server confirms the meeting room reservation, it generates and sends a notification email based on the sentiment engine's analysis results. Specifically, it uses a template engine to generate a notification email according to the sentiment analysis results and sends it via the SMTP server.

[0249] 6. Notification to the user

[0250] The communication terminal receives a reservation success notification from the server and notifies the user. The communication terminal displays the message "Reservation successful." This notification may also include sentiment analysis results.

[0251] Specific example

[0252] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app, the communication device analyzes the information and sends it to the server. An emotion analysis engine analyzes this message and identifies that the user's emotion is positive. The server checks the availability of Conference Room A, makes a reservation, and generates and sends a confirmation email saying, "Mr. / Ms. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 14:00." Finally, the communication device notifies the user that "the reservation was successful."

[0253] Examples of prompts for generative AI models

[0254] The following is an example of a prompt message to the generative AI model used in this system.

[0255] The user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app. The communication terminal analyzes the information, and the sentiment analysis engine identifies positive emotions. The server sends a query to the conference room reservation system and reserves conference room A. It generates and sends a confirmation email, "Dear Taro Tanaka, We look forward to welcoming you to conference room A on January 15, 2024 at 14:00." The communication terminal notifies the user that "Reservation successful."

[0256] This system allows users to easily reserve meeting rooms without hassle, and enables the generation of flexible notification emails tailored to their emotions, resulting in a more comfortable user experience. It also supports information input using business card images, contributing to improved work efficiency.

[0257] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0258] Step 1:

[0259] The user enters visitor information and scheduled arrival date and time using the messaging application on their communication device and sends it.

[0260] Specifically, the user can either type and send a text message saying "Taro Tanaka January 15, 2024 14:00", or attach an image of a business card and type "January 15, 2024 14:00" and send it.

[0261] Input: User-entered text message and business card image

[0262] Output: Data sent via messaging application

[0263] Step 2:

[0264] The communication terminal receives a message from the user and analyzes its contents.

[0265] Specifically, the communication terminal receives the text message "Taro Tanaka, January 15, 2024, 14:00," and uses a text analysis library (e.g., NLTK or spaCy) to separate and extract visitor information and the scheduled date and time of visit. If the information is from a business card image, OCR technology (e.g., Tesseract) is used to extract the text information. The analyzed information is then sent to the server.

[0266] Input: Text messages and image data received from messaging applications.

[0267] Output: Analyzed visitor information and scheduled visit date and time.

[0268] Step 3:

[0269] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state.

[0270] Specifically, the server uses a sentiment analysis engine (e.g., Google Cloud Natural Language or IBM Watson) to identify positive, negative, or neutral sentiment from the text "Taro Tanaka January 15, 2024 14:00".

[0271] Input: Parsed message text

[0272] Output: Sentiment analysis results (positive, negative, neutral)

[0273] Step 4:

[0274] Based on the visitor information and scheduled arrival date and time received by the server, the server checks the availability of meeting rooms and makes reservations.

[0275] Specifically, the server sends a query to a database management system (e.g., MySQL or PostgreSQL), processes a query like "SELECT FROM rooms WHERE available = 1 AND date = '2024-01-15' AND time = '14:00'", selects and reserves the optimal meeting room. The reservation information is stored in the database.

[0276] Input: Analyzed visitor information and scheduled arrival date and time

[0277] Output: Meeting room reservation information

[0278] Step 5:

[0279] After the server confirms the meeting room reservation, it generates and sends a guidance email based on the sentiment analysis result.

[0280] Specifically, the server uses a template engine (e.g., Jinja2 or Mustache) to generate a guidance email with content corresponding to the sentiment, such as "Dear Mr. Taro Tanaka, We warmly welcome you to Meeting Room A at 14:00 on January 15, 2(24". This email is sent using an SMTP server (e.g., SendGrid or Amazon SES).

[0281] Input: Meeting room reservation information and sentiment analysis result

[0282] Output: Guidance email

[0283] Step 6:

[0284] The communication terminal receives a reservation success notification from the server and notifies the user.

[0285] Specifically, when the communication terminal receives a notification of "Reservation successful" from the server and uses a GUI library (e.g., Toast for ANDROID (registered trademark) or UIAlertController for iOS) to display it to the user. This notification may also include the result of sentiment analysis.

[0286] Input: Reservation success notification from the server

[0287] Output: Notification to the user

[0288] (Application Example 2)

[0289] Next, Application Example 2 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart device 14 is referred to as the "terminal".

[0290] In the conventional visitor management system, the user manually manages visitor information and responds without considering the emotional state, resulting in a large burden on the user and the response to visitors may not be prompt and appropriate. Also, in factories and large-scale facilities, there are many visitors and their management is complicated. This makes it difficult to respond efficiently and there is a risk of reducing the satisfaction of visitors. The purpose of the present invention is to solve these problems, automate visitor response, and provide an optimal response based on emotions.

[0291] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for making a reservation for a meeting place based on the visitor's name and the scheduled date and time of the visit, means for checking the availability of the meeting place and selecting an optimal meeting place, and means for optimizing the guidance communication based on the emotional state. As a result, the user can automatically manage and analyze visitor information, enabling an efficient and appropriate response. Specifically, by using a smart terminal to obtain visitor information by QR code (registered trademark) scanning or voice input, analyzing the emotional state with a situation recognition engine, and providing optimal guidance and response, it is possible to improve visitor satisfaction.

[0292] A "communication device" refers to a means of communication used by a user, such as a mobile phone, smartphone, or tablet device.

[0293] A "messaging application" is software that runs on a communication terminal and is used to send and receive messages.

[0294] "Visitor name" refers to the name of a visitor and is information used to identify an individual.

[0295] "Scheduled arrival date and time" refers to the date and time when the visitor is expected to arrive.

[0296] A "server" is a central computer system that interacts with communication terminals via a network to perform data analysis, storage, and transmission.

[0297] A "meeting place" refers to the room or area where a meeting or discussion takes place.

[0298] "Guidance and communication" refers to providing information and contacting visitors, and includes methods such as email and notifications.

[0299] A "situation recognition engine" is software that analyzes a user's emotional state from text and audio data.

[0300] "Emotional state" refers to the feelings of users or visitors, and includes states such as positive and negative.

[0301] A "smart device" refers to a communication device with advanced functions, such as smart glasses or a smartphone.

[0302] "QR code scanning" refers to the act of reading a QR code using the camera of a smart device.

[0303] "Voice input" refers to the process where a user enters information using their voice, employing speech recognition technology.

[0304] To implement this invention, a communication terminal, a server, a smart terminal, a situation recognition engine, and a message application are used.

[0305] First, the user uses a communication terminal such as smart glasses or a smartphone to input the information of the visitor. Specifically, the user can input the visitor's name and the scheduled date and time of the visit in the message application of the communication terminal and send it. Also, it is possible to scan the image of the business card using the camera of the communication terminal, input the scheduled date and time of the visit, and send it.

[0306] The communication terminal analyzes the input information and extracts the visitor's name and the scheduled date and time of the visit. Text analysis and image analysis technology (OCR) are used for this analysis. The analyzed information is sent to the server.

[0307] The server makes a reservation for the meeting place based on the received visitor's name and the scheduled date and time of the visit. It checks the availability of the meeting place and refers to the database to select the optimal meeting place. When the optimal meeting place is determined, the reservation information is saved in the database.

[0308] Also, the information sent from the user is analyzed by the situation recognition engine, and the emotional states of the user and the visitor are judged. The situation recognition engine identifies the emotional state from text or voice data to determine whether the user is in a positive or negative state.

[0309] The server generates guiding communication based on the emotional state. In the case of a positive emotional state, a friendly guiding email is generated, and in the case of a negative emotional state, a polite and calming guiding email is generated. This guiding email is sent to the user promptly, enabling the user to make an optimal response.

[0310] Through the above processes, the entire process regarding the automatic analysis of visitor information and the reservation of the meeting place is streamlined, enabling optimal responses based on emotions.

[0311] As a concrete example, when a user sends the message "Taro Yamada, January 20, 2024, 10:00" from their communication device, the device analyzes this information and sends it to the server. The server checks the availability of the meeting place, makes a reservation, and the situation recognition engine performs sentiment analysis. Finally, the user receives an email notification stating, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C on January 20, 2024 at 10:00."

[0312] Examples of prompts generated using a generative AI model are as follows:

[0313] Q: Please tell me about a system that uses smart glasses to extract information from business cards and generate meeting room reservations and confirmation emails.

[0314] A: This system scans business card images with smart glasses and reserves meeting rooms based on the extracted text information. It also uses an emotion engine to provide users with corresponding messages. Technologies used include OCR (Optical Character Recognition), QR code analysis, and RESTful API communication.

[0315] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0316] Step 1:

[0317] Users enter and send visitor information using the messaging application on their communication terminal. Specifically, they enter the visitor's name and scheduled visit date and time as a message and send it. They can also attach an image of a business card and enter the scheduled visit date and time and send it. The input data is in the format of "Taro Yamada January 20, 2024 10:00" or "Image of business card, January 20, 2024 10:00".

[0318] Step 2:

[0319] The communication terminal receives messages sent by the user and analyzes their content. For example, it analyzes the message "Taro Yamada January 20, 2024 10:00" and extracts the visitor's name "Taro Yamada" and the scheduled visit date and time "January 20, 2024 10:00". In the case of a business card image, the communication terminal uses OCR technology to extract the visitor's name from the image. The input data is a message or an image, and the output data is the text data of the analysis results.

[0320] Step 3:

[0321] The communication terminal analyzes the visitor's name and scheduled visit date and time and sends it to the server. The transmitted data is in text format and is sent to the server as "Taro Yamada, January 20, 2024, 10:00".

[0322] Step 4:

[0323] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server checks the availability of meeting rooms and consults a database to select the most suitable location. The input data is visitor information and the date and time, and the output data is the reservation information for the meeting room. For example, it might use a database query to confirm that "Meeting Room C is available" and then reserve this meeting room.

[0324] Step 5:

[0325] The server saves meeting venue reservation information to the database. The database stores data such as the reserved meeting venue and its date and time. The input data is the meeting venue reservation information, and the output data is the record stored in the database.

[0326] Step 6:

[0327] The situation recognition engine analyzes the message text sent by the user to determine the user's emotional state. For example, from the message "Taro Yamada, January 20, 2024, 10:00," the situation recognition engine identifies the emotion and determines that the user is experiencing a positive emotion. The input data is the message text, and the output data is an emotional state label (positive, negative, etc.).

[0328] Step 7:

[0329] The server generates a guidance message based on the emotion analysis results. If the emotion is positive, it generates a friendly message such as, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C at 10:00 on January 20, 2024." If the emotion is negative, it generates a polite message. The input data is the emotion state and the reservation information for the meeting place, and the output data is the text of the guidance message.

[0330] Step 8:

[0331] The server generates a guidance communication and sends it to the user. The guidance communication is notified to the user's communication terminal, allowing the user to confirm the successful reservation and the content of the guidance. The input data is the text of the guidance communication, and the output data is the notification sent to the user.

[0332] The above describes a specific embodiment of this invention, in which data is input, processed, and output at each step, thereby achieving optimal visitor handling.

[0333] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0334] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0335] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0336] [Second Embodiment]

[0337] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0338] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0339] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0340] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0341] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0342] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0343] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0344] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0345] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0346] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0347] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0348] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0349] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit.

[0350] 1. Enter and submit visitor information.

[0351] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user sends a message in the format of "Taro Yamada, December 1, 2023, 10:00". Alternatively, the user can attach an image of a business card and enter "December 1, 2023, 10:00" and send it.

[0352] 2. Receiving and parsing messages

[0353] The communication terminal receives messages from the user and analyzes their content. For example, the terminal might extract information such as "Taro Yamada" and "December 1, 2023, 10:00". In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Yamada". The analyzed information is then sent to the server.

[0354] 3. Booking a meeting room via the server

[0355] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, if the server receives data such as "Taro Yamada" and "December 1, 2023, 10:00," it sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0356] 4. Generating and sending the notification email

[0357] After the server confirms that the meeting room reservation was successful, it generates and sends an invitation email to the visitor and related users. For example, an email with the following content is generated and sent: "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1, 2023."

[0358] 5. Notification to the user

[0359] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal displays "Reservation successful" on the screen to inform the user. With this system, users only need to easily register visitor information and the scheduled date and time of visit, and the system will automatically reserve a meeting room and send out confirmation emails, improving work efficiency and reducing human error.

[0360] Specific example

[0361] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of meeting rooms, reserves meeting room B, and generates a confirmation email. The confirmation email is then sent with the message, "Dear Taro Yamada, We look forward to seeing you in meeting room B at 10:00 on December 1, 2023." Finally, the communication terminal notifies the user that the reservation was successful.

[0362] Thus, the system of the present invention enables efficient handling of visitors while minimizing the burden on the user.

[0363] The following describes the processing flow.

[0364] Step 1:

[0365] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Yamada, December 1, 2023, 10:00" and send it.

[0366] Step 2:

[0367] The communication terminal receives a message from the user and analyzes its contents. For example, if the terminal receives the message "Taro Yamada, December 1, 2023, 10:00", it separates and extracts the name and date / time.

[0368] Step 3:

[0369] The communication terminal sends the analyzed visitor's name and scheduled arrival date and time to the server. For example, the terminal sends the information "Taro Yamada" and "December 1, 2023, 10:00" to the server.

[0370] Step 4:

[0371] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "December 1, 2023, 10:00".

[0372] Step 5:

[0373] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room B is available.

[0374] Step 6:

[0375] The server reserves Conference Room B with the request "Taro Yamada" and "December 1, 2023, 10:00," and saves this reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0376] Step 7:

[0377] The server confirms the successful reservation of the meeting room and generates an invitation email. For example, it might generate an email with the message, "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1st, 2023."

[0378] Step 8:

[0379] The server sends invitation emails to the relevant users and visitors. For example, the server sends the above email to the user and Taro Yamada.

[0380] Step 9:

[0381] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user.

[0382] (Example 1)

[0383] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0384] Conventional meeting room reservation systems often required users to make reservations manually, which was time-consuming and cumbersome. Furthermore, errors were prone to occur during the reservation process, potentially leading to scheduling discrepancies and duplicate bookings. This invention aims to solve these problems, reduce the burden on users, and provide a system that efficiently automates meeting room reservations and the sending of confirmation emails.

[0385] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0386] In this invention, the server includes means for a user to input and send a visitor's name and scheduled date and time of visit using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor's name and scheduled date and time of visit using the messaging application; means for the communication terminal to send the analyzed visitor's name and scheduled date and time of visit to the server; means for the server to reserve a meeting room based on the received visitor's name and scheduled date and time of visit; means for the server to generate and send an information email based on the meeting room reservation; means for the communication terminal to receive a reservation success notification from the server and notify the user; means for the user to send an image of a business card and the scheduled date and time of visit to the communication terminal; means for the communication terminal to analyze the image of the business card and extract the visitor's name; means for the communication terminal to send the extracted visitor's name and scheduled date and time of visit to the server; means for the server to check the availability of meeting rooms and select the most suitable meeting room; and means for the server to store the meeting room reservation information in a database. This allows for easy registration of visitor information and scheduled arrival dates and times, automatically reserving meeting rooms and sending invitation emails. This improves operational efficiency and reduces human error.

[0387] A "communication terminal" is an electronic device used to send and receive data over a network.

[0388] A "messaging application" is software used to communicate with other users using data such as text and images.

[0389] "Visitor Name" refers to the full name of a visitor as specified by the user of the system.

[0390] "Scheduled visit date and time" refers to information indicating the specific date and time when the visitor is scheduled to visit the company.

[0391] "Analyzing" refers to the process of recognizing input data or information and understanding or extracting its content.

[0392] A "server" is a computer system that receives requests from communication terminals on a network and processes the data.

[0393] "Meeting room reservation" is the procedure for making a meeting room available for use at a specific date and time.

[0394] An "information email" is an email containing specific information, intended to notify or inform the recipient.

[0395] A "Reservation Success Notification" is a message that informs the user that the meeting room reservation process has been successfully completed.

[0396] A "business card image" is an image file containing the contents of a business card, saved in digital format.

[0397] "Analyzing an image" refers to the process of extracting text and other information from an image using image recognition technology.

[0398] "Meeting room availability" refers to information indicating whether a meeting room is available for use at a specific date and time.

[0399] "Saving to a database" means registering information in an electronic management system so that it can be accessed later.

[0400] The "optimal meeting room" is the one selected to best meet the specified conditions.

[0401] The present invention provides a system that automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled visit date and time using a messaging application on a communication terminal. It is also possible to perform the same process automatically simply by sending an image of a business card and the scheduled visit date and time.

[0402] First, the user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, then sends the message. At this stage, the user can either send a text message such as "Taro Yamada, December 1, 2023, 10:00," or attach an image of a business card with "December 1, 2023, 10:00" attached. This input data is processed by the messaging application installed on the communication device.

[0403] Text analysis and image recognition technologies (e.g., Google Cloud Vision API) are used to analyze messages received by the communication terminal. In the case of text messages, the communication terminal parses them and extracts the "visitor's name" and "scheduled date and time of visit." In the case of business card images, image recognition technology extracts text information from the business card and analyzes it as the "visitor's name." The analyzed information is sent to the server via the internet.

[0404] The server analyzes the received data and checks the availability of meeting rooms based on the visitor's name and scheduled arrival date and time provided by the user. The server sends a query to the database and uses the meeting room reservation system (e.g., Microsoft Exchange) to check the availability of meeting rooms. When the server finds an available meeting room, it reserves the room and saves the information to the database.

[0405] After a meeting room reservation is successfully completed, the server generates a confirmation email. The email will contain a message such as, "Dear Visitor, We look forward to seeing you in the meeting room at your scheduled arrival time." The confirmation email is sent via an SMTP server (for example, SendGrid).

[0406] Finally, the communication terminal receives a reservation success notification from the server and displays it to the user in the form of a notification saying "Reservation successful." This notification allows the user to confirm that the reservation has been successfully completed.

[0407] As a concrete example, when a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server then checks the availability of meeting rooms and reserves Meeting Room B. The server generates and sends an email with the content "Mr. / Ms. Taro Yamada, we will be waiting for you in Meeting Room B on December 1, 2023 at 10:00." Finally, the communication terminal notifies the user that the reservation was successful. This allows users to easily register visitor information and the planned date and time of visit, and the system will automatically reserve meeting rooms and send invitation emails, improving work efficiency and reducing human error.

[0408] (Example of prompts for a generative AI model)

[0409] Please send the message "Taro Yamada, December 1, 2023, 10:00" via a messaging application. Then, please describe the subsequent automated process.

[0410] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0411] Step 1:

[0412] The user enters the visitor's name and scheduled arrival date and time using the messaging application on their communication device and sends the message. For example, they might send a message in the format "Taro Yamada, December 1, 2023, 10:00". The input can be in text format or as an image of a business card.

[0413] Input: Visitor's name, scheduled date and time of visit

[0414] Output: Data sent to the messaging application

[0415] Step 2:

[0416] The communication terminal receives messages from users and analyzes their content. In the case of text messages, it parses them to extract the "visitor's name" and "scheduled date and time of visit." In the case of business card images, it uses image recognition technology (e.g., Google Cloud Vision API) to extract text information from the business card.

[0417] Input: Message sent by the user

[0418] Output: Analyzed visitor names and scheduled visit dates / times.

[0419] Step 3:

[0420] The communication terminal sends the analyzed visitor name and scheduled arrival date and time to the server. This allows the server to begin the next step in the reservation process.

[0421] Input: Analyzed visitor name and scheduled visit date / time data

[0422] Output: Visitor name and scheduled arrival date and time data sent to the server.

[0423] Step 4:

[0424] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server queries the database to check meeting room availability and selects an available meeting room (e.g., using Microsoft Exchange).

[0425] Input: Visitor name and scheduled date and time of visit data sent to the server.

[0426] Output: Information about the reserved meeting room

[0427] Step 5:

[0428] After the server confirms that the meeting room reservation was successful, it generates an invitation email. The email will include the message, "Dear Visitor, we look forward to seeing you in the meeting room at your scheduled arrival time." The invitation email is then sent using an SMTP server (e.g., SendGrid).

[0429] Input: Information about the reserved meeting room, visitor's name, and scheduled date and time of visit.

[0430] Output: Generated notification email

[0431] Step 6:

[0432] The communication terminal receives a notification from the server that the reservation was successful and notifies the user that "the reservation was successful." This allows the user to confirm that the reservation was successful.

[0433] Input: Booking success notification

[0434] Output: Reservation success notification displayed on the communication terminal

[0435] In this way, each step is interconnected, allowing users to simply input and submit visitor information and scheduled visit date and time, and the system will automatically reserve a meeting room and send an invitation email.

[0436] (Application Example 1)

[0437] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0438] Traditional in-store visitor management systems often involve manual processes for scheduling appointments and guiding visitors, which is time-consuming and labor-intensive. Furthermore, managing customer information properly and responding quickly is difficult, hindering improvements in customer satisfaction. Manually entering business card information, in particular, is time-consuming and prone to errors.

[0439] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0440] In this invention, the server provides means for the user to input and transmit visitor information and scheduled date and time of visit using a messaging application on a communication terminal.

[0441] The aforementioned communication terminal includes means for analyzing the visitor information and scheduled date and time of visit using the messaging application,

[0442] The aforementioned communication terminal includes means for transmitting the analyzed visitor information and scheduled visit date and time to the server,

[0443] A means for making a reservation for a room based on the visitor information and scheduled arrival date and time received by the server,

[0444] The server provides means for generating and sending a notification email based on the reservation of the reserved room,

[0445] The server includes means for linking visitors to a specific system based on the sending of the notification email.

[0446] This will automate customer reservations and guidance at physical stores, leading to improved operational efficiency and increased customer satisfaction.

[0447] A "communication terminal" is an electronic device used by a user to send and receive messages.

[0448] A "messaging application" is software that runs on a communication terminal and allows users to send or receive text messages.

[0449] "Visitor information" refers to data that includes the visitor's name and other identifiable information.

[0450] "Scheduled visit date and time" refers to the date and time when the visitor is scheduled to visit.

[0451] A "server" is a computer system that receives, analyzes, and processes information transmitted from a communication terminal.

[0452] "Rooms available for reservation" refers to rooms used for purposes such as meetings and business negotiations.

[0453] A "confirmation email" is an email generated and sent by a server to notify users of their reservation and provide detailed information.

[0454] A "business card image" is a digital image file obtained by scanning or photographing a business card.

[0455] "Analysis" is the process of extracting necessary information from input data or images and converting it into an understandable format.

[0456] "Collaboration" refers to two or more systems or software programs sharing information with each other and working together in a coordinated manner.

[0457] Embodiments of the present invention will now be described. This system is designed to efficiently manage customer reservations and guidance in physical stores.

[0458] First, the user enters visitor information and the scheduled date and time of visit using the messaging application on their communication device and sends it. If necessary, the user can also attach an image of their business card.

[0459] Next, the communication terminal analyzes the visitor information and scheduled visit date and time received through the messaging application. This analysis process involves, for example, extracting text data using Python's standard library and reading text information from business card images using OpenCV and Tesseract.

[0460] The communication terminal sends the analyzed information to the server. The information is sent in a pre-processed form, and after receiving it, the server checks the database to see if a reservation is possible. If the reservation is successful, the server automatically generates a confirmation email and sends it to the user and visitors. SMTP and the Python email library can be used to generate and send the confirmation email. The server also connects visitors to specific systems based on the sending of the confirmation email.

[0461] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of the room to be reserved, and if the reservation is successful, it generates and sends an email with the message, "Mr. / Ms. Taro Yamada, you can visit us on December 1, 2023 at 10:00. We look forward to seeing you." The communication terminal then notifies the user of the successful reservation, streamlining operations.

[0462] This system is expected to automate customer reservations and guidance, significantly improving operational efficiency and customer satisfaction in physical stores.

[0463] An example of a prompt for a generating AI model is: "We want to build a system that automatically makes reservations and sends confirmation emails based on the customer's name and scheduled date and time. The system should also allow users to send business card images, recognize the information on the business card, confirm the reservation according to the date and time of visit, and send a confirmation email."

[0464] The above details describe the embodiments of the present invention.

[0465] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0466] Step 1:

[0467] Users enter and send their appointment information using a messaging application. For example, they might enter information such as "Taro Yamada, December 1, 2023, 10:00 AM" and press the send button. They can also attach a business card image if desired. The input is in text or image format and is sent to the device via the messaging application.

[0468] Step 2:

[0469] The terminal analyzes the received message. If the message is in text format, the terminal splits the string and extracts visitor information ("Taro Yamada") and scheduled visit date and time ("December 1, 2023, 10:00"). If the message is in image format, the terminal uses OpenCV and Tesseract to extract text information from the image. The analysis results are output in the format of visitor information and scheduled visit date and time.

[0470] Step 3:

[0471] The terminal sends the analyzed visitor information and scheduled visit date and time to the server. The data is sent in JSON format or other standard formats. The terminal uses a communication protocol (e.g., HTTP) to send the pre-processed data to the server.

[0472] Step 4:

[0473] The server stores the received visitor information and scheduled visit date and time in storage. The stored data is used in subsequent processing and is therefore properly managed using a database management system (e.g., MySQL, PostgreSQL). The server analyzes the received data and generates a query for reservation confirmation.

[0474] Step 5:

[0475] The server checks the availability of the room to be reserved. It retrieves existing reservation information from storage and determines whether a new reservation is possible. In this process, an algorithm is executed that uses SQL queries to retrieve the necessary information from the database and determines whether a reservation is possible.

[0476] Step 6:

[0477] The server executes the reservation for the room in question. If the reservation is successful, the server saves the reservation information as a new entry in the database. This ensures that the reservation information is recorded in a format that can be referenced later. The server then updates the reservation status to proceed.

[0478] Step 7:

[0479] The server generates and sends an invitation email to users and visitors. The invitation email might include content such as, "Mr. / Ms. Taro Yamada, you can visit us on December 1st, 2023 at 10:00 AM. We look forward to seeing you." The server uses the SMTP protocol and the Python email library to send the email.

[0480] Step 8:

[0481] The server integrates visitor information with specific systems. For example, it sends information to external systems such as CRM systems or visitor management systems to achieve centralized data management. API calls and database integrations are used here as well.

[0482] Step 9:

[0483] The device receives a reservation success notification from the server and notifies the user. The device notifies the user via a pop-up or in-app notification. This allows the user to immediately confirm that the reservation was successful.

[0484] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0485] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending a business card image and the scheduled date and time of visit. In addition, by combining this with an emotion engine that recognizes the user's emotions, more appropriate invitation emails can be generated and delivered.

[0486] 1. Enter and submit visitor information.

[0487] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. Alternatively, the user can attach an image of a business card and enter "January 15, 2024, 2:00 PM" and send it.

[0488] 2. Receiving and parsing messages

[0489] The communication terminal receives messages from the user and analyzes their content. For example, if the terminal receives a message such as "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time. In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Tanaka". The analyzed information is then sent to the server.

[0490] 3. Emotional analysis using an emotion engine

[0491] The emotion engine analyzes message text or audio data sent by the user to determine the user's emotional state. For example, from a message such as "Taro Tanaka, January 15, 2024, 2:00 PM," the emotion engine analyzes the user's emotions and identifies positive or negative emotions from the text.

[0492] 4. Meeting room reservations via server

[0493] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, the server receives data such as "Taro Tanaka, January 15, 2024, 2:00 PM" and sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0494] 5. Generating and sending the notification email.

[0495] After the server confirms that the meeting room reservation was successful, it generates a confirmation email based on the results of the emotion engine's analysis. For example, if the emotion engine's analysis indicates a positive emotion, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM." The content and format of the email will be adjusted according to the user's emotional state.

[0496] 6. Notification to the user

[0497] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal might display "Reservation successful" on the screen to inform the user. This notification may also include the results of the emotion engine's analysis.

[0498] Specific example

[0499] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The emotion engine analyzes the message and identifies that the user's emotional state is positive. The server checks the availability of meeting rooms and reserves meeting room A. A confirmation email is generated and sent with the content "Dear Taro Tanaka, We look forward to welcoming you to meeting room A on January 15, 2024 at 14:00." Finally, the communication terminal notifies the user that the reservation was successful.

[0500] Thus, the system of the present invention can efficiently handle visitor reception while minimizing the burden on the user, and further provides a more comfortable user experience by flexibly adjusting the response according to the user's emotional state.

[0501] The following describes the processing flow.

[0502] Step 1:

[0503] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it.

[0504] Step 2:

[0505] The communication terminal receives messages sent by the user and analyzes their contents. For example, if the terminal receives the message "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time.

[0506] Step 3:

[0507] The emotion engine analyzes the message text to determine the user's emotional state. For example, the emotion engine analyzes the sent message and identifies that the user is in a positive state.

[0508] Step 4:

[0509] The communication terminal sends the analyzed visitor's name, scheduled arrival date and time, and emotional state (determined by the emotion engine) to the server. For example, the terminal might send "Taro Tanaka," "January 15, 2024, 2:00 PM," and "Positive emotional state" to the server.

[0510] Step 5:

[0511] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "January 15, 2024, 14:00".

[0512] Step 6:

[0513] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room A is available.

[0514] Step 7:

[0515] The server reserves Conference Room A with the request "Taro Tanaka, January 15, 2024, 14:00" and saves the reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0516] Step 8:

[0517] The server confirms the successful reservation of the meeting room and generates a confirmation email based on the analysis results of the emotion engine. For example, if the user's emotional state is positive, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM."

[0518] Step 9:

[0519] The server generates an announcement email and sends it to the relevant users and visitors. For example, the server sends the above email to the user and Taro Tanaka.

[0520] Step 10:

[0521] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user. This notification may also include the results of the emotion engine's analysis.

[0522] (Example 2)

[0523] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0524] Traditional meeting room reservation systems had several drawbacks, including the need for users to manually enter visitor information and planned arrival dates and times, as well as check meeting room availability and make reservations. Furthermore, the generation of confirmation emails was often formulaic and lacked the flexibility to respond to user emotions, resulting in an unsatisfactory user experience. Additionally, manual entry of business card information was sometimes required, making efficient workflow difficult.

[0525] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0526] In this invention, the server includes means for a user to input and transmit visitor information and scheduled visit date and time using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor information and scheduled visit date and time using the messaging application; means for the communication terminal to transmit the analyzed visitor information and scheduled visit date and time to the server; means for the server to reserve a meeting room based on the received visitor information and scheduled visit date and time; means for the server to analyze the user's emotions using an emotion analysis engine; and means for the server to generate and send a notification email based on the meeting room reservation and emotion analysis results. As a result, users can easily reserve meeting rooms without hassle, and it is also possible to generate flexible notification emails that respond to emotions, resulting in a more comfortable user experience.

[0527] A "communication terminal" is a device used by users to input and transmit information, and includes smartphones, tablets, and personal computers.

[0528] A "messaging application" is software used by users to send text, images, and other data, and includes chat apps and messaging platforms.

[0529] "Visitor information" refers to data about the person scheduled to visit, including their name, job title, and affiliated organization.

[0530] "Scheduled visit date and time" refers to the specific date and time when the visitor plans to visit the company.

[0531] "Analyzing" refers to the process of analyzing transmitted data and extracting and classifying the necessary information.

[0532] A "server" is a computer system that receives, processes, and stores data transmitted from a communication terminal.

[0533] "Reserving a meeting room" refers to the process of securing a meeting room that is available at a specified date and time, and recording that information in a database.

[0534] An "emotion analysis engine" is software or an algorithm that identifies emotions from text or audio data and classifies them into emotional states such as positive, negative, or neutral.

[0535] A "confirmation email" is an email generated to notify visitors / users that their meeting room reservation has been successful, and it is sent to them.

[0536] "Business card image" refers to a photograph or scanned data of a business card containing the visitor's information.

[0537] "Extracting" refers to the process of extracting necessary data from images or text.

[0538] A "database" is a system for systematically managing collected and stored information, enabling rapid information retrieval through various queries.

[0539] A "reservation success notification" is a message or notification sent to inform the user that their reservation for a meeting room has been confirmed.

[0540] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user inputs and sends visitor information and the scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit. The system also has a function to generate and deliver flexible invitation emails that respond to the user's emotions by utilizing an emotion analysis engine.

[0541] Hardware and software to be used

[0542] The communication devices used by users include smartphones, tablets, and personal computers. Messaging applications such as LINE and Slack are used. Text analysis libraries such as NLTK and spaCy are used, and OCR technology such as Tesseract is employed. Servers are envisioned to be either cloud computing resources or on-premises servers, and database management systems such as MySQL and PostgreSQL are used. Sentiment analysis engines such as Google Cloud Natural Language and IBM Watson are employed. Template engines such as Jinja2 and Mustache are used to generate notification emails, and SMTP servers such as SendGrid and Amazon SES are used.

[0543] Process Overview

[0544] 1. Enter and submit visitor information.

[0545] Users use the messaging application on their communication terminal to enter visitor information and the scheduled date and time of their visit and send it. Specifically, the user would type a message such as "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. It is also possible to attach an image of a business card and type "January 15, 2024, 2:00 PM" and send it.

[0546] 2. Receiving and parsing messages

[0547] The communication terminal receives messages from users and analyzes their content. Specifically, the communication terminal analyzes text messages and separates and extracts names and dates. In the case of business card images, the communication terminal uses OCR technology to extract text information. The analyzed information is then sent to the server.

[0548] 3. Emotional analysis using an emotion engine

[0549] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state. Specifically, the sentiment engine identifies positive, negative, or neutral emotions.

[0550] 4. Meeting room reservations via server

[0551] Based on the visitor information and scheduled arrival date and time received by the server, it checks the availability of meeting rooms and makes reservations. Specifically, the server sends a query to the database management system, selects an appropriate meeting room, and makes a reservation. The reservation information is stored in the database.

[0552] 5. Generating and sending the notification email.

[0553] After the server confirms the meeting room reservation, it generates and sends a notification email based on the sentiment engine's analysis results. Specifically, it uses a template engine to generate a notification email according to the sentiment analysis results and sends it via the SMTP server.

[0554] 6. Notification to the user

[0555] The communication terminal receives a reservation success notification from the server and notifies the user. The communication terminal displays the message "Reservation successful." This notification may also include sentiment analysis results.

[0556] Specific example

[0557] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app, the communication device analyzes the information and sends it to the server. An emotion analysis engine analyzes this message and identifies that the user's emotion is positive. The server checks the availability of Conference Room A, makes a reservation, and generates and sends a confirmation email saying, "Mr. / Ms. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 14:00." Finally, the communication device notifies the user that "the reservation was successful."

[0558] Examples of prompts for generative AI models

[0559] The following is an example of a prompt message to the generative AI model used in this system.

[0560] The user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app. The communication terminal analyzes the information, and the sentiment analysis engine identifies positive emotions. The server sends a query to the conference room reservation system and reserves conference room A. It generates and sends a confirmation email, "Dear Taro Tanaka, We look forward to welcoming you to conference room A on January 15, 2024 at 14:00." The communication terminal notifies the user that "Reservation successful."

[0561] This system allows users to easily reserve meeting rooms without hassle, and enables the generation of flexible notification emails tailored to their emotions, resulting in a more comfortable user experience. It also supports information input using business card images, contributing to improved work efficiency.

[0562] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0563] Step 1:

[0564] The user enters visitor information and scheduled arrival date and time using the messaging application on their communication device and sends it.

[0565] Specifically, the user can either type and send a text message saying "Taro Tanaka January 15, 2024 14:00", or attach an image of a business card and type "January 15, 2024 14:00" and send it.

[0566] Input: User-entered text message and business card image

[0567] Output: Data sent via messaging application

[0568] Step 2:

[0569] The communication terminal receives a message from the user and analyzes its contents.

[0570] Specifically, the communication terminal receives the text message "Taro Tanaka, January 15, 2024, 14:00," and uses a text analysis library (e.g., NLTK or spaCy) to separate and extract visitor information and the scheduled date and time of visit. If the information is from a business card image, OCR technology (e.g., Tesseract) is used to extract the text information. The analyzed information is then sent to the server.

[0571] Input: Text messages and image data received from messaging applications.

[0572] Output: Analyzed visitor information and scheduled visit date and time.

[0573] Step 3:

[0574] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state.

[0575] Specifically, the server uses a sentiment analysis engine (e.g., Google Cloud Natural Language or IBM Watson) to identify positive, negative, or neutral sentiment from the text "Taro Tanaka January 15, 2024 14:00".

[0576] Input: Parsed message text

[0577] Output: Sentiment analysis results (positive, negative, neutral)

[0578] Step 4:

[0579] Based on the visitor information and scheduled arrival date and time received by the server, the server checks the availability of meeting rooms and makes reservations.

[0580] Specifically, the server sends a query to a database management system (e.g., MySQL or PostgreSQL), processes a query like "SELECT FROM rooms WHERE available = 1 AND date = '2024-01-15' AND time = '14:00'", selects the most suitable meeting room, and reserves it. The reservation information is then stored in the database.

[0581] Input: Analyzed visitor information and scheduled visit date and time.

[0582] Output: Meeting room reservation information

[0583] Step 5:

[0584] After the server confirms the meeting room reservation, it generates and sends a confirmation email based on the sentiment analysis results.

[0585] Specifically, the server uses a template engine (e.g., Jinja2 or Mustache) to generate an invitation email with content tailored to the recipient's mood, such as "Mr. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 2:00 PM." This email is then sent using an SMTP server (e.g., SendGrid or Amazon SES).

[0586] Input: Meeting room reservation information and sentiment analysis results

[0587] Output: Notification email

[0588] Step 6:

[0589] The communication terminal receives a reservation success notification from the server and notifies the user.

[0590] Specifically, the communication terminal receives a "reservation successful" notification from the server and uses a GUI library (e.g., Android's Toast or iOS's UIAlertController) to display it to the user. This notification may also include sentiment analysis results.

[0591] Input: Reservation success notification from the server

[0592] Output: Notification to the user

[0593] (Application Example 2)

[0594] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0595] Conventional visitor management systems require users to manually manage visitor information and respond without considering emotional states, resulting in a heavy user burden and potentially inadequate visitor responses. Furthermore, factories and large facilities have a large number of visitors, making visitor management complex. This makes efficient responses difficult and risks reducing visitor satisfaction. The present invention aims to solve these problems by automating visitor responses and providing optimal responses based on emotions.

[0596] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for reserving a meeting place based on the visitor's name and scheduled date and time of visit, means for checking the availability of meeting places and selecting the optimal meeting place, and means for optimizing guidance communication based on emotional state. This allows the user to automatically manage and analyze visitor information, enabling efficient and appropriate responses. Specifically, it is possible to improve visitor satisfaction by acquiring visitor information using a smart terminal via QR code scanning or voice input, analyzing the emotional state with a situation recognition engine, and providing optimal guidance and responses.

[0597] A "communication device" refers to a means of communication used by a user, such as a mobile phone, smartphone, or tablet device.

[0598] A "messaging application" is software that runs on a communication terminal and is used to send and receive messages.

[0599] "Visitor name" refers to the name of a visitor and is information used to identify an individual.

[0600] "Scheduled arrival date and time" refers to the date and time when the visitor is expected to arrive.

[0601] A "server" is a central computer system that interacts with communication terminals via a network to perform data analysis, storage, and transmission.

[0602] A "meeting place" refers to the room or area where a meeting or discussion takes place.

[0603] "Guidance and communication" refers to providing information and contacting visitors, and includes methods such as email and notifications.

[0604] A "situation recognition engine" is software that analyzes a user's emotional state from text and audio data.

[0605] "Emotional state" refers to the feelings of users or visitors, and includes states such as positive and negative.

[0606] A "smart device" refers to a communication device with advanced functions, such as smart glasses or a smartphone.

[0607] "QR code scanning" refers to the act of reading a QR code using the camera of a smart device.

[0608] "Voice input" refers to the process where a user enters information using their voice, employing speech recognition technology.

[0609] To implement this invention, a communication terminal, a server, a smart terminal, a situation recognition engine, and a messaging application are used.

[0610] First, the user inputs visitor information using a communication device such as smart glasses or a smartphone. Specifically, the user can input the visitor's name and scheduled visit date and time using the messaging application on the communication device and send it. It is also possible to scan an image of a business card using the camera on the communication device, input the scheduled visit date and time, and send it.

[0611] The communication terminal analyzes the input information and extracts the visitor's name and scheduled visit date and time. This analysis uses text analysis and optical character recognition (OCR) technology. The analyzed information is then sent to the server.

[0612] The server reserves a meeting venue based on the received visitor name and scheduled arrival date and time. It checks the availability of meeting venues and consults the database to select the most suitable venue. Once the most suitable venue is determined, the reservation information is saved in the database.

[0613] Furthermore, information sent by users is analyzed by a situation recognition engine to determine the emotional state of the user or visitor. The situation recognition engine identifies emotional states from text and voice data, determining whether the user is in a positive or negative state.

[0614] The server generates guidance communications based on the user's emotional state. A friendly guidance email is generated for positive emotional states, while a polite and calm guidance email is generated for negative emotional states. This guidance email is sent promptly to the user, allowing them to take the most appropriate action.

[0615] Through the above processes, the entire process of automatically analyzing visitor information and booking meeting venues is streamlined, enabling optimal responses based on emotions.

[0616] As a concrete example, when a user sends the message "Taro Yamada, January 20, 2024, 10:00" from their communication device, the device analyzes this information and sends it to the server. The server checks the availability of the meeting place, makes a reservation, and the situation recognition engine performs sentiment analysis. Finally, the user receives an email notification stating, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C on January 20, 2024 at 10:00."

[0617] Examples of prompts generated using a generative AI model are as follows:

[0618] Q: Please tell me about a system that uses smart glasses to extract information from business cards and generate meeting room reservations and confirmation emails.

[0619] A: This system scans business card images with smart glasses and reserves meeting rooms based on the extracted text information. It also uses an emotion engine to provide users with corresponding messages. Technologies used include OCR (Optical Character Recognition), QR code analysis, and RESTful API communication.

[0620] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0621] Step 1:

[0622] Users enter and send visitor information using the messaging application on their communication terminal. Specifically, they enter the visitor's name and scheduled visit date and time as a message and send it. They can also attach an image of a business card and enter the scheduled visit date and time and send it. The input data is in the format of "Taro Yamada January 20, 2024 10:00" or "Image of business card, January 20, 2024 10:00".

[0623] Step 2:

[0624] The communication terminal receives messages sent by the user and analyzes their content. For example, it analyzes the message "Taro Yamada January 20, 2024 10:00" and extracts the visitor's name "Taro Yamada" and the scheduled visit date and time "January 20, 2024 10:00". In the case of a business card image, the communication terminal uses OCR technology to extract the visitor's name from the image. The input data is a message or an image, and the output data is the text data of the analysis results.

[0625] Step 3:

[0626] The communication terminal analyzes the visitor's name and scheduled visit date and time and sends it to the server. The transmitted data is in text format and is sent to the server as "Taro Yamada, January 20, 2024, 10:00".

[0627] Step 4:

[0628] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server checks the availability of meeting rooms and consults a database to select the most suitable location. The input data is visitor information and the date and time, and the output data is the reservation information for the meeting room. For example, it might use a database query to confirm that "Meeting Room C is available" and then reserve this meeting room.

[0629] Step 5:

[0630] The server saves meeting venue reservation information to the database. The database stores data such as the reserved meeting venue and its date and time. The input data is the meeting venue reservation information, and the output data is the record stored in the database.

[0631] Step 6:

[0632] The situation recognition engine analyzes the message text sent by the user to determine the user's emotional state. For example, from the message "Taro Yamada, January 20, 2024, 10:00," the situation recognition engine identifies the emotion and determines that the user is experiencing a positive emotion. The input data is the message text, and the output data is an emotional state label (positive, negative, etc.).

[0633] Step 7:

[0634] The server generates a guidance message based on the emotion analysis results. If the emotion is positive, it generates a friendly message such as, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C at 10:00 on January 20, 2024." If the emotion is negative, it generates a polite message. The input data is the emotion state and the reservation information for the meeting place, and the output data is the text of the guidance message.

[0635] Step 8:

[0636] The server generates a guidance communication and sends it to the user. The guidance communication is notified to the user's communication terminal, allowing the user to confirm the successful reservation and the content of the guidance. The input data is the text of the guidance communication, and the output data is the notification sent to the user.

[0637] The above describes a specific embodiment of this invention, in which data is input, processed, and output at each step, thereby achieving optimal visitor handling.

[0638] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0639] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0640] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0641] [Third Embodiment]

[0642] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0643] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0644] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0645] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0646] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0647] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0648] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0649] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0650] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0651] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0652] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0653] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0654] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit.

[0655] 1. Enter and submit visitor information.

[0656] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user sends a message in the format of "Taro Yamada, December 1, 2023, 10:00". Alternatively, the user can attach an image of a business card and enter "December 1, 2023, 10:00" and send it.

[0657] 2. Receiving and parsing messages

[0658] The communication terminal receives messages from the user and analyzes their content. For example, the terminal might extract information such as "Taro Yamada" and "December 1, 2023, 10:00". In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Yamada". The analyzed information is then sent to the server.

[0659] 3. Booking a meeting room via the server

[0660] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, if the server receives data such as "Taro Yamada" and "December 1, 2023, 10:00," it sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0661] 4. Generating and sending the notification email

[0662] After the server confirms that the meeting room reservation was successful, it generates and sends an invitation email to the visitor and related users. For example, an email with the following content is generated and sent: "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1, 2023."

[0663] 5. Notification to the user

[0664] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal displays "Reservation successful" on the screen to inform the user. With this system, users only need to easily register visitor information and the scheduled date and time of visit, and the system will automatically reserve a meeting room and send out confirmation emails, improving work efficiency and reducing human error.

[0665] Specific example

[0666] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of meeting rooms, reserves meeting room B, and generates a confirmation email. The confirmation email is then sent with the message, "Dear Taro Yamada, We look forward to seeing you in meeting room B at 10:00 on December 1, 2023." Finally, the communication terminal notifies the user that the reservation was successful.

[0667] Thus, the system of the present invention enables efficient handling of visitors while minimizing the burden on the user.

[0668] The following describes the processing flow.

[0669] Step 1:

[0670] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Yamada, December 1, 2023, 10:00" and send it.

[0671] Step 2:

[0672] The communication terminal receives a message from the user and analyzes its contents. For example, if the terminal receives the message "Taro Yamada, December 1, 2023, 10:00", it separates and extracts the name and date / time.

[0673] Step 3:

[0674] The communication terminal sends the analyzed visitor's name and scheduled arrival date and time to the server. For example, the terminal sends the information "Taro Yamada" and "December 1, 2023, 10:00" to the server.

[0675] Step 4:

[0676] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "December 1, 2023, 10:00".

[0677] Step 5:

[0678] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room B is available.

[0679] Step 6:

[0680] The server reserves Conference Room B with the request "Taro Yamada" and "December 1, 2023, 10:00," and saves this reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0681] Step 7:

[0682] The server confirms the successful reservation of the meeting room and generates an invitation email. For example, it might generate an email with the message, "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1st, 2023."

[0683] Step 8:

[0684] The server sends invitation emails to the relevant users and visitors. For example, the server sends the above email to the user and Taro Yamada.

[0685] Step 9:

[0686] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user.

[0687] (Example 1)

[0688] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0689] Conventional meeting room reservation systems often required users to make reservations manually, which was time-consuming and cumbersome. Furthermore, errors were prone to occur during the reservation process, potentially leading to scheduling discrepancies and duplicate bookings. This invention aims to solve these problems, reduce the burden on users, and provide a system that efficiently automates meeting room reservations and the sending of confirmation emails.

[0690] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0691] In this invention, the server includes means for a user to input and send a visitor's name and scheduled date and time of visit using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor's name and scheduled date and time of visit using the messaging application; means for the communication terminal to send the analyzed visitor's name and scheduled date and time of visit to the server; means for the server to reserve a meeting room based on the received visitor's name and scheduled date and time of visit; means for the server to generate and send an information email based on the meeting room reservation; means for the communication terminal to receive a reservation success notification from the server and notify the user; means for the user to send an image of a business card and the scheduled date and time of visit to the communication terminal; means for the communication terminal to analyze the image of the business card and extract the visitor's name; means for the communication terminal to send the extracted visitor's name and scheduled date and time of visit to the server; means for the server to check the availability of meeting rooms and select the most suitable meeting room; and means for the server to store the meeting room reservation information in a database. This allows for easy registration of visitor information and scheduled arrival dates and times, automatically reserving meeting rooms and sending invitation emails. This improves operational efficiency and reduces human error.

[0692] A "communication terminal" is an electronic device used to send and receive data over a network.

[0693] A "messaging application" is software used to communicate with other users using data such as text and images.

[0694] "Visitor Name" refers to the full name of a visitor as specified by the user of the system.

[0695] "Scheduled visit date and time" refers to information indicating the specific date and time when the visitor is scheduled to visit the company.

[0696] "Analyzing" refers to the process of recognizing input data or information and understanding or extracting its content.

[0697] A "server" is a computer system that receives requests from communication terminals on a network and processes the data.

[0698] "Meeting room reservation" is the procedure for making a meeting room available for use at a specific date and time.

[0699] An "information email" is an email containing specific information, intended to notify or inform the recipient.

[0700] A "Reservation Success Notification" is a message that informs the user that the meeting room reservation process has been successfully completed.

[0701] A "business card image" is an image file containing the contents of a business card, saved in digital format.

[0702] "Analyzing an image" refers to the process of extracting text and other information from an image using image recognition technology.

[0703] "Meeting room availability" refers to information indicating whether a meeting room is available for use at a specific date and time.

[0704] "Saving to a database" means registering information in an electronic management system so that it can be accessed later.

[0705] The "optimal meeting room" is the one selected to best meet the specified conditions.

[0706] The present invention provides a system that automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled visit date and time using a messaging application on a communication terminal. It is also possible to perform the same process automatically simply by sending an image of a business card and the scheduled visit date and time.

[0707] First, the user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, then sends the message. At this stage, the user can either send a text message such as "Taro Yamada, December 1, 2023, 10:00," or attach an image of a business card with "December 1, 2023, 10:00" attached. This input data is processed by the messaging application installed on the communication device.

[0708] Text analysis and image recognition technologies (e.g., Google Cloud Vision API) are used to analyze messages received by the communication terminal. In the case of text messages, the communication terminal parses them and extracts the "visitor's name" and "scheduled date and time of visit." In the case of business card images, image recognition technology extracts text information from the business card and analyzes it as the "visitor's name." The analyzed information is sent to the server via the internet.

[0709] The server analyzes the received data and checks the availability of meeting rooms based on the visitor's name and scheduled arrival date and time provided by the user. The server sends a query to the database and uses the meeting room reservation system (e.g., Microsoft Exchange) to check the availability of meeting rooms. When the server finds an available meeting room, it reserves the room and saves the information to the database.

[0710] After a meeting room reservation is successfully completed, the server generates a confirmation email. The email will contain a message such as, "Dear Visitor, We look forward to seeing you in the meeting room at your scheduled arrival time." The confirmation email is sent via an SMTP server (for example, SendGrid).

[0711] Finally, the communication terminal receives a reservation success notification from the server and displays it to the user in the form of a notification saying "Reservation successful." This notification allows the user to confirm that the reservation has been successfully completed.

[0712] As a concrete example, when a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server then checks the availability of meeting rooms and reserves Meeting Room B. The server generates and sends an email with the content "Mr. / Ms. Taro Yamada, we will be waiting for you in Meeting Room B on December 1, 2023 at 10:00." Finally, the communication terminal notifies the user that the reservation was successful. This allows users to easily register visitor information and the planned date and time of visit, and the system will automatically reserve meeting rooms and send invitation emails, improving work efficiency and reducing human error.

[0713] (Example of prompts for a generative AI model)

[0714] Please send the message "Taro Yamada, December 1, 2023, 10:00" via a messaging application. Then, please describe the subsequent automated process.

[0715] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0716] Step 1:

[0717] The user enters the visitor's name and scheduled arrival date and time using the messaging application on their communication device and sends the message. For example, they might send a message in the format "Taro Yamada, December 1, 2023, 10:00". The input can be in text format or as an image of a business card.

[0718] Input: Visitor's name, scheduled date and time of visit

[0719] Output: Data sent to the messaging application

[0720] Step 2:

[0721] The communication terminal receives messages from users and analyzes their content. In the case of text messages, it parses them to extract the "visitor's name" and "scheduled date and time of visit." In the case of business card images, it uses image recognition technology (e.g., Google Cloud Vision API) to extract text information from the business card.

[0722] Input: Message sent by the user

[0723] Output: Analyzed visitor names and scheduled visit dates / times.

[0724] Step 3:

[0725] The communication terminal sends the analyzed visitor name and scheduled arrival date and time to the server. This allows the server to begin the next step in the reservation process.

[0726] Input: Analyzed visitor name and scheduled visit date / time data

[0727] Output: Visitor name and scheduled arrival date and time data sent to the server.

[0728] Step 4:

[0729] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server queries the database to check meeting room availability and selects an available meeting room (e.g., using Microsoft Exchange).

[0730] Input: Visitor name and scheduled date and time of visit data sent to the server.

[0731] Output: Information about the reserved meeting room

[0732] Step 5:

[0733] After the server confirms that the meeting room reservation was successful, it generates an invitation email. The email will include the message, "Dear Visitor, we look forward to seeing you in the meeting room at your scheduled arrival time." The invitation email is then sent using an SMTP server (e.g., SendGrid).

[0734] Input: Information about the reserved meeting room, visitor's name, and scheduled date and time of visit.

[0735] Output: Generated notification email

[0736] Step 6:

[0737] The communication terminal receives a notification from the server that the reservation was successful and notifies the user that "the reservation was successful." This allows the user to confirm that the reservation was successful.

[0738] Input: Booking success notification

[0739] Output: Reservation success notification displayed on the communication terminal

[0740] In this way, each step is interconnected, allowing users to simply input and submit visitor information and scheduled visit date and time, and the system will automatically reserve a meeting room and send an invitation email.

[0741] (Application Example 1)

[0742] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0743] Traditional in-store visitor management systems often involve manual processes for scheduling appointments and guiding visitors, which is time-consuming and labor-intensive. Furthermore, managing customer information properly and responding quickly is difficult, hindering improvements in customer satisfaction. Manually entering business card information, in particular, is time-consuming and prone to errors.

[0744] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0745] In this invention, the server provides means for the user to input and transmit visitor information and scheduled date and time of visit using a messaging application on a communication terminal.

[0746] The aforementioned communication terminal includes means for analyzing the visitor information and scheduled date and time of visit using the messaging application,

[0747] The aforementioned communication terminal includes means for transmitting the analyzed visitor information and scheduled visit date and time to the server,

[0748] A means for making a reservation for a room based on the visitor information and scheduled arrival date and time received by the server,

[0749] The server provides means for generating and sending a notification email based on the reservation of the reserved room,

[0750] The server includes means for linking visitors to a specific system based on the sending of the notification email.

[0751] This will automate customer reservations and guidance at physical stores, leading to improved operational efficiency and increased customer satisfaction.

[0752] A "communication terminal" is an electronic device used by a user to send and receive messages.

[0753] A "messaging application" is software that runs on a communication terminal and allows users to send or receive text messages.

[0754] "Visitor information" refers to data that includes the visitor's name and other identifiable information.

[0755] "Scheduled visit date and time" refers to the date and time when the visitor is scheduled to visit.

[0756] A "server" is a computer system that receives, analyzes, and processes information transmitted from a communication terminal.

[0757] "Rooms available for reservation" refers to rooms used for purposes such as meetings and business negotiations.

[0758] A "confirmation email" is an email generated and sent by a server to notify users of their reservation and provide detailed information.

[0759] A "business card image" is a digital image file obtained by scanning or photographing a business card.

[0760] "Analysis" is the process of extracting necessary information from input data or images and converting it into an understandable format.

[0761] "Collaboration" refers to two or more systems or software programs sharing information with each other and working together in a coordinated manner.

[0762] Embodiments of the present invention will now be described. This system is designed to efficiently manage customer reservations and guidance in physical stores.

[0763] First, the user enters visitor information and the scheduled date and time of visit using the messaging application on their communication device and sends it. If necessary, the user can also attach an image of their business card.

[0764] Next, the communication terminal analyzes the visitor information and scheduled visit date and time received through the messaging application. This analysis process involves, for example, extracting text data using Python's standard library and reading text information from business card images using OpenCV and Tesseract.

[0765] The communication terminal sends the analyzed information to the server. The information is sent in a pre-processed form, and after receiving it, the server checks the database to see if a reservation is possible. If the reservation is successful, the server automatically generates a confirmation email and sends it to the user and visitors. SMTP and the Python email library can be used to generate and send the confirmation email. The server also connects visitors to specific systems based on the sending of the confirmation email.

[0766] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of the room to be reserved, and if the reservation is successful, it generates and sends an email with the message, "Mr. / Ms. Taro Yamada, you can visit us on December 1, 2023 at 10:00. We look forward to seeing you." The communication terminal then notifies the user of the successful reservation, streamlining operations.

[0767] This system is expected to automate customer reservations and guidance, significantly improving operational efficiency and customer satisfaction in physical stores.

[0768] An example of a prompt for a generating AI model is: "We want to build a system that automatically makes reservations and sends confirmation emails based on the customer's name and scheduled date and time. The system should also allow users to send business card images, recognize the information on the business card, confirm the reservation according to the date and time of visit, and send a confirmation email."

[0769] The above details describe the embodiments of the present invention.

[0770] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0771] Step 1:

[0772] Users enter and send their appointment information using a messaging application. For example, they might enter information such as "Taro Yamada, December 1, 2023, 10:00 AM" and press the send button. They can also attach a business card image if desired. The input is in text or image format and is sent to the device via the messaging application.

[0773] Step 2:

[0774] The terminal analyzes the received message. If the message is in text format, the terminal splits the string and extracts visitor information ("Taro Yamada") and scheduled visit date and time ("December 1, 2023, 10:00"). If the message is in image format, the terminal uses OpenCV and Tesseract to extract text information from the image. The analysis results are output in the format of visitor information and scheduled visit date and time.

[0775] Step 3:

[0776] The terminal sends the analyzed visitor information and scheduled visit date and time to the server. The data is sent in JSON format or other standard formats. The terminal uses a communication protocol (e.g., HTTP) to send the pre-processed data to the server.

[0777] Step 4:

[0778] The server stores the received visitor information and scheduled visit date and time in storage. The stored data is used in subsequent processing and is therefore properly managed using a database management system (e.g., MySQL, PostgreSQL). The server analyzes the received data and generates a query for reservation confirmation.

[0779] Step 5:

[0780] The server checks the availability of the room to be reserved. It retrieves existing reservation information from storage and determines whether a new reservation is possible. In this process, an algorithm is executed that uses SQL queries to retrieve the necessary information from the database and determines whether a reservation is possible.

[0781] Step 6:

[0782] The server executes the reservation for the room in question. If the reservation is successful, the server saves the reservation information as a new entry in the database. This ensures that the reservation information is recorded in a format that can be referenced later. The server then updates the reservation status to proceed.

[0783] Step 7:

[0784] The server generates and sends an invitation email to users and visitors. The invitation email might include content such as, "Mr. / Ms. Taro Yamada, you can visit us on December 1st, 2023 at 10:00 AM. We look forward to seeing you." The server uses the SMTP protocol and the Python email library to send the email.

[0785] Step 8:

[0786] The server integrates visitor information with specific systems. For example, it sends information to external systems such as CRM systems or visitor management systems to achieve centralized data management. API calls and database integrations are used here as well.

[0787] Step 9:

[0788] The device receives a reservation success notification from the server and notifies the user. The device notifies the user via a pop-up or in-app notification. This allows the user to immediately confirm that the reservation was successful.

[0789] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0790] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending a business card image and the scheduled date and time of visit. In addition, by combining this with an emotion engine that recognizes the user's emotions, more appropriate invitation emails can be generated and delivered.

[0791] 1. Enter and submit visitor information.

[0792] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. Alternatively, the user can attach an image of a business card and enter "January 15, 2024, 2:00 PM" and send it.

[0793] 2. Receiving and parsing messages

[0794] The communication terminal receives messages from the user and analyzes their content. For example, if the terminal receives a message such as "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time. In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Tanaka". The analyzed information is then sent to the server.

[0795] 3. Emotional analysis using an emotion engine

[0796] The emotion engine analyzes message text or audio data sent by the user to determine the user's emotional state. For example, from a message such as "Taro Tanaka, January 15, 2024, 2:00 PM," the emotion engine analyzes the user's emotions and identifies positive or negative emotions from the text.

[0797] 4. Meeting room reservations via server

[0798] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, the server receives data such as "Taro Tanaka, January 15, 2024, 2:00 PM" and sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0799] 5. Generating and sending the notification email.

[0800] After the server confirms that the meeting room reservation was successful, it generates a confirmation email based on the results of the emotion engine's analysis. For example, if the emotion engine's analysis indicates a positive emotion, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM." The content and format of the email will be adjusted according to the user's emotional state.

[0801] 6. Notification to the user

[0802] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal might display "Reservation successful" on the screen to inform the user. This notification may also include the results of the emotion engine's analysis.

[0803] Specific example

[0804] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The emotion engine analyzes the message and identifies that the user's emotional state is positive. The server checks the availability of meeting rooms and reserves meeting room A. A confirmation email is generated and sent with the content "Dear Taro Tanaka, We look forward to welcoming you to meeting room A on January 15, 2024 at 14:00." Finally, the communication terminal notifies the user that the reservation was successful.

[0805] Thus, the system of the present invention can efficiently handle visitor reception while minimizing the burden on the user, and further provides a more comfortable user experience by flexibly adjusting the response according to the user's emotional state.

[0806] The following describes the processing flow.

[0807] Step 1:

[0808] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it.

[0809] Step 2:

[0810] The communication terminal receives messages sent by the user and analyzes their contents. For example, if the terminal receives the message "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time.

[0811] Step 3:

[0812] The emotion engine analyzes the message text to determine the user's emotional state. For example, the emotion engine analyzes the sent message and identifies that the user is in a positive state.

[0813] Step 4:

[0814] The communication terminal sends the analyzed visitor's name, scheduled arrival date and time, and emotional state (determined by the emotion engine) to the server. For example, the terminal might send "Taro Tanaka," "January 15, 2024, 2:00 PM," and "Positive emotional state" to the server.

[0815] Step 5:

[0816] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "January 15, 2024, 14:00".

[0817] Step 6:

[0818] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room A is available.

[0819] Step 7:

[0820] The server reserves Conference Room A with the request "Taro Tanaka, January 15, 2024, 14:00" and saves the reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0821] Step 8:

[0822] The server confirms the successful reservation of the meeting room and generates a confirmation email based on the analysis results of the emotion engine. For example, if the user's emotional state is positive, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM."

[0823] Step 9:

[0824] The server generates an announcement email and sends it to the relevant users and visitors. For example, the server sends the above email to the user and Taro Tanaka.

[0825] Step 10:

[0826] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user. This notification may also include the results of the emotion engine's analysis.

[0827] (Example 2)

[0828] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0829] Traditional meeting room reservation systems had several drawbacks, including the need for users to manually enter visitor information and planned arrival dates and times, as well as check meeting room availability and make reservations. Furthermore, the generation of confirmation emails was often formulaic and lacked the flexibility to respond to user emotions, resulting in an unsatisfactory user experience. Additionally, manual entry of business card information was sometimes required, making efficient workflow difficult.

[0830] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0831] In this invention, the server includes means for a user to input and transmit visitor information and scheduled visit date and time using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor information and scheduled visit date and time using the messaging application; means for the communication terminal to transmit the analyzed visitor information and scheduled visit date and time to the server; means for the server to reserve a meeting room based on the received visitor information and scheduled visit date and time; means for the server to analyze the user's emotions using an emotion analysis engine; and means for the server to generate and send a notification email based on the meeting room reservation and emotion analysis results. As a result, users can easily reserve meeting rooms without hassle, and it is also possible to generate flexible notification emails that respond to emotions, resulting in a more comfortable user experience.

[0832] A "communication terminal" is a device used by users to input and transmit information, and includes smartphones, tablets, and personal computers.

[0833] A "messaging application" is software used by users to send text, images, and other data, and includes chat apps and messaging platforms.

[0834] "Visitor information" refers to data about the person scheduled to visit, including their name, job title, and affiliated organization.

[0835] "Scheduled visit date and time" refers to the specific date and time when the visitor plans to visit the company.

[0836] "Analyzing" refers to the process of analyzing transmitted data and extracting and classifying the necessary information.

[0837] A "server" is a computer system that receives, processes, and stores data transmitted from a communication terminal.

[0838] "Reserving a meeting room" refers to the process of securing a meeting room that is available at a specified date and time, and recording that information in a database.

[0839] An "emotion analysis engine" is software or an algorithm that identifies emotions from text or audio data and classifies them into emotional states such as positive, negative, or neutral.

[0840] A "confirmation email" is an email generated to notify visitors / users that their meeting room reservation has been successful, and it is sent to them.

[0841] "Business card image" refers to a photograph or scanned data of a business card containing the visitor's information.

[0842] "Extracting" refers to the process of extracting necessary data from images or text.

[0843] A "database" is a system for systematically managing collected and stored information, enabling rapid information retrieval through various queries.

[0844] A "reservation success notification" is a message or notification sent to inform the user that their reservation for a meeting room has been confirmed.

[0845] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user inputs and sends visitor information and the scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit. The system also has a function to generate and deliver flexible invitation emails that respond to the user's emotions by utilizing an emotion analysis engine.

[0846] Hardware and software to be used

[0847] The communication devices used by users include smartphones, tablets, and personal computers. Messaging applications such as LINE and Slack are used. Text analysis libraries such as NLTK and spaCy are used, and OCR technology such as Tesseract is employed. Servers are envisioned to be either cloud computing resources or on-premises servers, and database management systems such as MySQL and PostgreSQL are used. Sentiment analysis engines such as Google Cloud Natural Language and IBM Watson are employed. Template engines such as Jinja2 and Mustache are used to generate notification emails, and SMTP servers such as SendGrid and Amazon SES are used.

[0848] Process Overview

[0849] 1. Enter and submit visitor information.

[0850] Users use the messaging application on their communication terminal to enter visitor information and the scheduled date and time of their visit and send it. Specifically, the user would type a message such as "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. It is also possible to attach an image of a business card and type "January 15, 2024, 2:00 PM" and send it.

[0851] 2. Receiving and parsing messages

[0852] The communication terminal receives messages from users and analyzes their content. Specifically, the communication terminal analyzes text messages and separates and extracts names and dates. In the case of business card images, the communication terminal uses OCR technology to extract text information. The analyzed information is then sent to the server.

[0853] 3. Emotional analysis using an emotion engine

[0854] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state. Specifically, the sentiment engine identifies positive, negative, or neutral emotions.

[0855] 4. Meeting room reservations via server

[0856] Based on the visitor information and scheduled arrival date and time received by the server, it checks the availability of meeting rooms and makes reservations. Specifically, the server sends a query to the database management system, selects an appropriate meeting room, and makes a reservation. The reservation information is stored in the database.

[0857] 5. Generating and sending the notification email.

[0858] After the server confirms the meeting room reservation, it generates and sends a notification email based on the sentiment engine's analysis results. Specifically, it uses a template engine to generate a notification email according to the sentiment analysis results and sends it via the SMTP server.

[0859] 6. Notification to the user

[0860] The communication terminal receives a reservation success notification from the server and notifies the user. The communication terminal displays the message "Reservation successful." This notification may also include sentiment analysis results.

[0861] Specific example

[0862] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app, the communication device analyzes the information and sends it to the server. An emotion analysis engine analyzes this message and identifies that the user's emotion is positive. The server checks the availability of Conference Room A, makes a reservation, and generates and sends a confirmation email saying, "Mr. / Ms. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 14:00." Finally, the communication device notifies the user that "the reservation was successful."

[0863] Examples of prompts for generative AI models

[0864] The following is an example of a prompt message to the generative AI model used in this system.

[0865] The user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app. The communication terminal analyzes the information, and the sentiment analysis engine identifies positive emotions. The server sends a query to the conference room reservation system and reserves conference room A. It generates and sends a confirmation email, "Dear Taro Tanaka, We look forward to welcoming you to conference room A on January 15, 2024 at 14:00." The communication terminal notifies the user that "Reservation successful."

[0866] This system allows users to easily reserve meeting rooms without hassle, and enables the generation of flexible notification emails tailored to their emotions, resulting in a more comfortable user experience. It also supports information input using business card images, contributing to improved work efficiency.

[0867] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0868] Step 1:

[0869] The user enters visitor information and scheduled arrival date and time using the messaging application on their communication device and sends it.

[0870] Specifically, the user can either type and send a text message saying "Taro Tanaka January 15, 2024 14:00", or attach an image of a business card and type "January 15, 2024 14:00" and send it.

[0871] Input: User-entered text message and business card image

[0872] Output: Data sent via messaging application

[0873] Step 2:

[0874] The communication terminal receives a message from the user and analyzes its contents.

[0875] Specifically, the communication terminal receives the text message "Taro Tanaka, January 15, 2024, 14:00," and uses a text analysis library (e.g., NLTK or spaCy) to separate and extract visitor information and the scheduled date and time of visit. If the information is from a business card image, OCR technology (e.g., Tesseract) is used to extract the text information. The analyzed information is then sent to the server.

[0876] Input: Text messages and image data received from messaging applications.

[0877] Output: Analyzed visitor information and scheduled visit date and time.

[0878] Step 3:

[0879] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state.

[0880] Specifically, the server uses a sentiment analysis engine (e.g., Google Cloud Natural Language or IBM Watson) to identify positive, negative, or neutral sentiment from the text "Taro Tanaka January 15, 2024 14:00".

[0881] Input: Parsed message text

[0882] Output: Sentiment analysis results (positive, negative, neutral)

[0883] Step 4:

[0884] Based on the visitor information and scheduled arrival date and time received by the server, the server checks the availability of meeting rooms and makes reservations.

[0885] Specifically, the server sends a query to a database management system (e.g., MySQL or PostgreSQL), processes a query like "SELECT FROM rooms WHERE available = 1 AND date = '2024-01-15' AND time = '14:00'", selects the most suitable meeting room, and reserves it. The reservation information is then stored in the database.

[0886] Input: Analyzed visitor information and scheduled visit date and time.

[0887] Output: Meeting room reservation information

[0888] Step 5:

[0889] After the server confirms the meeting room reservation, it generates and sends a confirmation email based on the sentiment analysis results.

[0890] Specifically, the server uses a template engine (e.g., Jinja2 or Mustache) to generate an invitation email with content tailored to the recipient's mood, such as "Mr. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 2:00 PM." This email is then sent using an SMTP server (e.g., SendGrid or Amazon SES).

[0891] Input: Meeting room reservation information and sentiment analysis results

[0892] Output: Notification email

[0893] Step 6:

[0894] The communication terminal receives a reservation success notification from the server and notifies the user.

[0895] Specifically, the communication terminal receives a "reservation successful" notification from the server and uses a GUI library (e.g., Android's Toast or iOS's UIAlertController) to display it to the user. This notification may also include sentiment analysis results.

[0896] Input: Reservation success notification from the server

[0897] Output: Notification to the user

[0898] (Application Example 2)

[0899] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0900] Conventional visitor management systems require users to manually manage visitor information and respond without considering emotional states, resulting in a heavy user burden and potentially inadequate visitor responses. Furthermore, factories and large facilities have a large number of visitors, making visitor management complex. This makes efficient responses difficult and risks reducing visitor satisfaction. The present invention aims to solve these problems by automating visitor responses and providing optimal responses based on emotions.

[0901] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for reserving a meeting place based on the visitor's name and scheduled date and time of visit, means for checking the availability of meeting places and selecting the optimal meeting place, and means for optimizing guidance communication based on emotional state. This allows the user to automatically manage and analyze visitor information, enabling efficient and appropriate responses. Specifically, it is possible to improve visitor satisfaction by acquiring visitor information using a smart terminal via QR code scanning or voice input, analyzing the emotional state with a situation recognition engine, and providing optimal guidance and responses.

[0902] A "communication device" refers to a means of communication used by a user, such as a mobile phone, smartphone, or tablet device.

[0903] A "messaging application" is software that runs on a communication terminal and is used to send and receive messages.

[0904] "Visitor name" refers to the name of a visitor and is information used to identify an individual.

[0905] "Scheduled arrival date and time" refers to the date and time when the visitor is expected to arrive.

[0906] A "server" is a central computer system that interacts with communication terminals via a network to perform data analysis, storage, and transmission.

[0907] A "meeting place" refers to the room or area where a meeting or discussion takes place.

[0908] "Guidance and communication" refers to providing information and contacting visitors, and includes methods such as email and notifications.

[0909] A "situation recognition engine" is software that analyzes a user's emotional state from text and audio data.

[0910] "Emotional state" refers to the feelings of users or visitors, and includes states such as positive and negative.

[0911] A "smart device" refers to a communication device with advanced functions, such as smart glasses or a smartphone.

[0912] "QR code scanning" refers to the act of reading a QR code using the camera of a smart device.

[0913] "Voice input" refers to the process where a user enters information using their voice, employing speech recognition technology.

[0914] To implement this invention, a communication terminal, a server, a smart terminal, a situation recognition engine, and a messaging application are used.

[0915] First, the user inputs visitor information using a communication device such as smart glasses or a smartphone. Specifically, the user can input the visitor's name and scheduled visit date and time using the messaging application on the communication device and send it. It is also possible to scan an image of a business card using the camera on the communication device, input the scheduled visit date and time, and send it.

[0916] The communication terminal analyzes the input information and extracts the visitor's name and scheduled visit date and time. This analysis uses text analysis and optical character recognition (OCR) technology. The analyzed information is then sent to the server.

[0917] The server reserves a meeting venue based on the received visitor name and scheduled arrival date and time. It checks the availability of meeting venues and consults the database to select the most suitable venue. Once the most suitable venue is determined, the reservation information is saved in the database.

[0918] Furthermore, information sent by users is analyzed by a situation recognition engine to determine the emotional state of the user or visitor. The situation recognition engine identifies emotional states from text and voice data, determining whether the user is in a positive or negative state.

[0919] The server generates guidance communications based on the user's emotional state. A friendly guidance email is generated for positive emotional states, while a polite and calm guidance email is generated for negative emotional states. This guidance email is sent promptly to the user, allowing them to take the most appropriate action.

[0920] Through the above processes, the entire process of automatically analyzing visitor information and booking meeting venues is streamlined, enabling optimal responses based on emotions.

[0921] As a concrete example, when a user sends the message "Taro Yamada, January 20, 2024, 10:00" from their communication device, the device analyzes this information and sends it to the server. The server checks the availability of the meeting place, makes a reservation, and the situation recognition engine performs sentiment analysis. Finally, the user receives an email notification stating, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C on January 20, 2024 at 10:00."

[0922] Examples of prompts generated using a generative AI model are as follows:

[0923] Q: Please tell me about a system that uses smart glasses to extract information from business cards and generate meeting room reservations and confirmation emails.

[0924] A: This system scans business card images with smart glasses and reserves meeting rooms based on the extracted text information. It also uses an emotion engine to provide users with corresponding messages. Technologies used include OCR (Optical Character Recognition), QR code analysis, and RESTful API communication.

[0925] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0926] Step 1:

[0927] Users enter and send visitor information using the messaging application on their communication terminal. Specifically, they enter the visitor's name and scheduled visit date and time as a message and send it. They can also attach an image of a business card and enter the scheduled visit date and time and send it. The input data is in the format of "Taro Yamada January 20, 2024 10:00" or "Image of business card, January 20, 2024 10:00".

[0928] Step 2:

[0929] The communication terminal receives messages sent by the user and analyzes their content. For example, it analyzes the message "Taro Yamada January 20, 2024 10:00" and extracts the visitor's name "Taro Yamada" and the scheduled visit date and time "January 20, 2024 10:00". In the case of a business card image, the communication terminal uses OCR technology to extract the visitor's name from the image. The input data is a message or an image, and the output data is the text data of the analysis results.

[0930] Step 3:

[0931] The communication terminal analyzes the visitor's name and scheduled visit date and time and sends it to the server. The transmitted data is in text format and is sent to the server as "Taro Yamada, January 20, 2024, 10:00".

[0932] Step 4:

[0933] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server checks the availability of meeting rooms and consults a database to select the most suitable location. The input data is visitor information and the date and time, and the output data is the reservation information for the meeting room. For example, it might use a database query to confirm that "Meeting Room C is available" and then reserve this meeting room.

[0934] Step 5:

[0935] The server saves meeting venue reservation information to the database. The database stores data such as the reserved meeting venue and its date and time. The input data is the meeting venue reservation information, and the output data is the record stored in the database.

[0936] Step 6:

[0937] The situation recognition engine analyzes the message text sent by the user to determine the user's emotional state. For example, from the message "Taro Yamada, January 20, 2024, 10:00," the situation recognition engine identifies the emotion and determines that the user is experiencing a positive emotion. The input data is the message text, and the output data is an emotional state label (positive, negative, etc.).

[0938] Step 7:

[0939] The server generates a guidance message based on the emotion analysis results. If the emotion is positive, it generates a friendly message such as, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C at 10:00 on January 20, 2024." If the emotion is negative, it generates a polite message. The input data is the emotion state and the reservation information for the meeting place, and the output data is the text of the guidance message.

[0940] Step 8:

[0941] The server generates a guidance communication and sends it to the user. The guidance communication is notified to the user's communication terminal, allowing the user to confirm the successful reservation and the content of the guidance. The input data is the text of the guidance communication, and the output data is the notification sent to the user.

[0942] The above describes a specific embodiment of this invention, in which data is input, processed, and output at each step, thereby achieving optimal visitor handling.

[0943] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0944] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0945] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0946] [Fourth Embodiment]

[0947] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0948] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0949] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0950] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0951] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0952] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0953] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0954] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0955] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0956] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0957] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0958] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0959] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0960] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit.

[0961] 1. Enter and submit visitor information.

[0962] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user sends a message in the format of "Taro Yamada, December 1, 2023, 10:00". Alternatively, the user can attach an image of a business card and enter "December 1, 2023, 10:00" and send it.

[0963] 2. Receiving and parsing messages

[0964] The communication terminal receives messages from the user and analyzes their content. For example, the terminal might extract information such as "Taro Yamada" and "December 1, 2023, 10:00". In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Yamada". The analyzed information is then sent to the server.

[0965] 3. Booking a meeting room via the server

[0966] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, if the server receives data such as "Taro Yamada" and "December 1, 2023, 10:00," it sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[0967] 4. Generating and sending the notification email

[0968] After the server confirms that the meeting room reservation was successful, it generates and sends an invitation email to the visitor and related users. For example, an email with the following content is generated and sent: "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1, 2023."

[0969] 5. Notification to the user

[0970] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal displays "Reservation successful" on the screen to inform the user. With this system, users only need to easily register visitor information and the scheduled date and time of visit, and the system will automatically reserve a meeting room and send out confirmation emails, improving work efficiency and reducing human error.

[0971] Specific example

[0972] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of meeting rooms, reserves meeting room B, and generates a confirmation email. The confirmation email is then sent with the message, "Dear Taro Yamada, We look forward to seeing you in meeting room B at 10:00 on December 1, 2023." Finally, the communication terminal notifies the user that the reservation was successful.

[0973] Thus, the system of the present invention enables efficient handling of visitors while minimizing the burden on the user.

[0974] The following describes the processing flow.

[0975] Step 1:

[0976] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Yamada, December 1, 2023, 10:00" and send it.

[0977] Step 2:

[0978] The communication terminal receives a message from the user and analyzes its contents. For example, if the terminal receives the message "Taro Yamada, December 1, 2023, 10:00", it separates and extracts the name and date / time.

[0979] Step 3:

[0980] The communication terminal sends the analyzed visitor's name and scheduled arrival date and time to the server. For example, the terminal sends the information "Taro Yamada" and "December 1, 2023, 10:00" to the server.

[0981] Step 4:

[0982] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "December 1, 2023, 10:00".

[0983] Step 5:

[0984] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room B is available.

[0985] Step 6:

[0986] The server reserves Conference Room B with the request "Taro Yamada" and "December 1, 2023, 10:00," and saves this reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[0987] Step 7:

[0988] The server confirms the successful reservation of the meeting room and generates an invitation email. For example, it might generate an email with the message, "Mr. / Ms. Taro Yamada, we look forward to seeing you in Meeting Room B at 10:00 on December 1st, 2023."

[0989] Step 8:

[0990] The server sends invitation emails to the relevant users and visitors. For example, the server sends the above email to the user and Taro Yamada.

[0991] Step 9:

[0992] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user.

[0993] (Example 1)

[0994] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0995] Conventional meeting room reservation systems often required users to make reservations manually, which was time-consuming and cumbersome. Furthermore, errors were prone to occur during the reservation process, potentially leading to scheduling discrepancies and duplicate bookings. This invention aims to solve these problems, reduce the burden on users, and provide a system that efficiently automates meeting room reservations and the sending of confirmation emails.

[0996] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0997] In this invention, the server includes means for a user to input and send a visitor's name and scheduled date and time of visit using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor's name and scheduled date and time of visit using the messaging application; means for the communication terminal to send the analyzed visitor's name and scheduled date and time of visit to the server; means for the server to reserve a meeting room based on the received visitor's name and scheduled date and time of visit; means for the server to generate and send an information email based on the meeting room reservation; means for the communication terminal to receive a reservation success notification from the server and notify the user; means for the user to send an image of a business card and the scheduled date and time of visit to the communication terminal; means for the communication terminal to analyze the image of the business card and extract the visitor's name; means for the communication terminal to send the extracted visitor's name and scheduled date and time of visit to the server; means for the server to check the availability of meeting rooms and select the most suitable meeting room; and means for the server to store the meeting room reservation information in a database. This allows for easy registration of visitor information and scheduled arrival dates and times, automatically reserving meeting rooms and sending invitation emails. This improves operational efficiency and reduces human error.

[0998] A "communication terminal" is an electronic device used to send and receive data over a network.

[0999] A "messaging application" is software used to communicate with other users using data such as text and images.

[1000] "Visitor Name" refers to the full name of a visitor as specified by the user of the system.

[1001] "Scheduled visit date and time" refers to information indicating the specific date and time when the visitor is scheduled to visit the company.

[1002] "Analyzing" refers to the process of recognizing input data or information and understanding or extracting its content.

[1003] A "server" is a computer system that receives requests from communication terminals on a network and processes the data.

[1004] "Meeting room reservation" is the procedure for making a meeting room available for use at a specific date and time.

[1005] An "information email" is an email containing specific information, intended to notify or inform the recipient.

[1006] A "Reservation Success Notification" is a message that informs the user that the meeting room reservation process has been successfully completed.

[1007] A "business card image" is an image file containing the contents of a business card, saved in digital format.

[1008] "Analyzing an image" refers to the process of extracting text and other information from an image using image recognition technology.

[1009] "Meeting room availability" refers to information indicating whether a meeting room is available for use at a specific date and time.

[1010] "Saving to a database" means registering information in an electronic management system so that it can be accessed later.

[1011] The "optimal meeting room" is the one selected to best meet the specified conditions.

[1012] The present invention provides a system that automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled visit date and time using a messaging application on a communication terminal. It is also possible to perform the same process automatically simply by sending an image of a business card and the scheduled visit date and time.

[1013] First, the user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, then sends the message. At this stage, the user can either send a text message such as "Taro Yamada, December 1, 2023, 10:00," or attach an image of a business card with "December 1, 2023, 10:00" attached. This input data is processed by the messaging application installed on the communication device.

[1014] Text analysis and image recognition technologies (e.g., Google Cloud Vision API) are used to analyze messages received by the communication terminal. In the case of text messages, the communication terminal parses them and extracts the "visitor's name" and "scheduled date and time of visit." In the case of business card images, image recognition technology extracts text information from the business card and analyzes it as the "visitor's name." The analyzed information is sent to the server via the internet.

[1015] The server analyzes the received data and checks the availability of meeting rooms based on the visitor's name and scheduled arrival date and time provided by the user. The server sends a query to the database and uses the meeting room reservation system (e.g., Microsoft Exchange) to check the availability of meeting rooms. When the server finds an available meeting room, it reserves the room and saves the information to the database.

[1016] After a meeting room reservation is successfully completed, the server generates a confirmation email. The email will contain a message such as, "Dear Visitor, We look forward to seeing you in the meeting room at your scheduled arrival time." The confirmation email is sent via an SMTP server (for example, SendGrid).

[1017] Finally, the communication terminal receives a reservation success notification from the server and displays it to the user in the form of a notification saying "Reservation successful." This notification allows the user to confirm that the reservation has been successfully completed.

[1018] As a concrete example, when a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server then checks the availability of meeting rooms and reserves Meeting Room B. The server generates and sends an email with the content "Mr. / Ms. Taro Yamada, we will be waiting for you in Meeting Room B on December 1, 2023 at 10:00." Finally, the communication terminal notifies the user that the reservation was successful. This allows users to easily register visitor information and the planned date and time of visit, and the system will automatically reserve meeting rooms and send invitation emails, improving work efficiency and reducing human error.

[1019] (Example of prompts for a generative AI model)

[1020] Please send the message "Taro Yamada, December 1, 2023, 10:00" via a messaging application. Then, please describe the subsequent automated process.

[1021] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1022] Step 1:

[1023] The user enters the visitor's name and scheduled arrival date and time using the messaging application on their communication device and sends the message. For example, they might send a message in the format "Taro Yamada, December 1, 2023, 10:00". The input can be in text format or as an image of a business card.

[1024] Input: Visitor's name, scheduled date and time of visit

[1025] Output: Data sent to the messaging application

[1026] Step 2:

[1027] The communication terminal receives messages from users and analyzes their content. In the case of text messages, it parses them to extract the "visitor's name" and "scheduled date and time of visit." In the case of business card images, it uses image recognition technology (e.g., Google Cloud Vision API) to extract text information from the business card.

[1028] Input: Message sent by the user

[1029] Output: Analyzed visitor names and scheduled visit dates / times.

[1030] Step 3:

[1031] The communication terminal sends the analyzed visitor name and scheduled arrival date and time to the server. This allows the server to begin the next step in the reservation process.

[1032] Input: Analyzed visitor name and scheduled visit date / time data

[1033] Output: Visitor name and scheduled arrival date and time data sent to the server.

[1034] Step 4:

[1035] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server queries the database to check meeting room availability and selects an available meeting room (e.g., using Microsoft Exchange).

[1036] Input: Visitor name and scheduled date and time of visit data sent to the server.

[1037] Output: Information about the reserved meeting room

[1038] Step 5:

[1039] After the server confirms that the meeting room reservation was successful, it generates an invitation email. The email will include the message, "Dear Visitor, we look forward to seeing you in the meeting room at your scheduled arrival time." The invitation email is then sent using an SMTP server (e.g., SendGrid).

[1040] Input: Information about the reserved meeting room, visitor's name, and scheduled date and time of visit.

[1041] Output: Generated notification email

[1042] Step 6:

[1043] The communication terminal receives a notification from the server that the reservation was successful and notifies the user that "the reservation was successful." This allows the user to confirm that the reservation was successful.

[1044] Input: Booking success notification

[1045] Output: Reservation success notification displayed on the communication terminal

[1046] In this way, each step is interconnected, allowing users to simply input and submit visitor information and scheduled visit date and time, and the system will automatically reserve a meeting room and send an invitation email.

[1047] (Application Example 1)

[1048] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1049] Traditional in-store visitor management systems often involve manual processes for scheduling appointments and guiding visitors, which is time-consuming and labor-intensive. Furthermore, managing customer information properly and responding quickly is difficult, hindering improvements in customer satisfaction. Manually entering business card information, in particular, is time-consuming and prone to errors.

[1050] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1051] In this invention, the server provides means for the user to input and transmit visitor information and scheduled date and time of visit using a messaging application on a communication terminal.

[1052] The aforementioned communication terminal includes means for analyzing the visitor information and scheduled date and time of visit using the messaging application,

[1053] The aforementioned communication terminal includes means for transmitting the analyzed visitor information and scheduled visit date and time to the server,

[1054] A means for making a reservation for a room based on the visitor information and scheduled arrival date and time received by the server,

[1055] The server provides means for generating and sending a notification email based on the reservation of the reserved room,

[1056] The server includes means for linking visitors to a specific system based on the sending of the notification email.

[1057] This will automate customer reservations and guidance at physical stores, leading to improved operational efficiency and increased customer satisfaction.

[1058] A "communication terminal" is an electronic device used by a user to send and receive messages.

[1059] A "messaging application" is software that runs on a communication terminal and allows users to send or receive text messages.

[1060] "Visitor information" refers to data that includes the visitor's name and other identifiable information.

[1061] "Scheduled visit date and time" refers to the date and time when the visitor is scheduled to visit.

[1062] A "server" is a computer system that receives, analyzes, and processes information transmitted from a communication terminal.

[1063] "Rooms available for reservation" refers to rooms used for purposes such as meetings and business negotiations.

[1064] A "confirmation email" is an email generated and sent by a server to notify users of their reservation and provide detailed information.

[1065] A "business card image" is a digital image file obtained by scanning or photographing a business card.

[1066] "Analysis" is the process of extracting necessary information from input data or images and converting it into an understandable format.

[1067] "Collaboration" refers to two or more systems or software programs sharing information with each other and working together in a coordinated manner.

[1068] Embodiments of the present invention will now be described. This system is designed to efficiently manage customer reservations and guidance in physical stores.

[1069] First, the user enters visitor information and the scheduled date and time of visit using the messaging application on their communication device and sends it. If necessary, the user can also attach an image of their business card.

[1070] Next, the communication terminal analyzes the visitor information and scheduled visit date and time received through the messaging application. This analysis process involves, for example, extracting text data using Python's standard library and reading text information from business card images using OpenCV and Tesseract.

[1071] The communication terminal sends the analyzed information to the server. The information is sent in a pre-processed form, and after receiving it, the server checks the database to see if a reservation is possible. If the reservation is successful, the server automatically generates a confirmation email and sends it to the user and visitors. SMTP and the Python email library can be used to generate and send the confirmation email. The server also connects visitors to specific systems based on the sending of the confirmation email.

[1072] For example, if a user sends "Taro Yamada, December 1, 2023, 10:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The server checks the availability of the room to be reserved, and if the reservation is successful, it generates and sends an email with the message, "Mr. / Ms. Taro Yamada, you can visit us on December 1, 2023 at 10:00. We look forward to seeing you." The communication terminal then notifies the user of the successful reservation, streamlining operations.

[1073] This system is expected to automate customer reservations and guidance, significantly improving operational efficiency and customer satisfaction in physical stores.

[1074] An example of a prompt for a generating AI model is: "We want to build a system that automatically makes reservations and sends confirmation emails based on the customer's name and scheduled date and time. The system should also allow users to send business card images, recognize the information on the business card, confirm the reservation according to the date and time of visit, and send a confirmation email."

[1075] The above details describe the embodiments of the present invention.

[1076] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1077] Step 1:

[1078] Users enter and send their appointment information using a messaging application. For example, they might enter information such as "Taro Yamada, December 1, 2023, 10:00 AM" and press the send button. They can also attach a business card image if desired. The input is in text or image format and is sent to the device via the messaging application.

[1079] Step 2:

[1080] The terminal analyzes the received message. If the message is in text format, the terminal splits the string and extracts visitor information ("Taro Yamada") and scheduled visit date and time ("December 1, 2023, 10:00"). If the message is in image format, the terminal uses OpenCV and Tesseract to extract text information from the image. The analysis results are output in the format of visitor information and scheduled visit date and time.

[1081] Step 3:

[1082] The terminal sends the analyzed visitor information and scheduled visit date and time to the server. The data is sent in JSON format or other standard formats. The terminal uses a communication protocol (e.g., HTTP) to send the pre-processed data to the server.

[1083] Step 4:

[1084] The server stores the received visitor information and scheduled visit date and time in storage. The stored data is used in subsequent processing and is therefore properly managed using a database management system (e.g., MySQL, PostgreSQL). The server analyzes the received data and generates a query for reservation confirmation.

[1085] Step 5:

[1086] The server checks the availability of the room to be reserved. It retrieves existing reservation information from storage and determines whether a new reservation is possible. In this process, an algorithm is executed that uses SQL queries to retrieve the necessary information from the database and determines whether a reservation is possible.

[1087] Step 6:

[1088] The server executes the reservation for the room in question. If the reservation is successful, the server saves the reservation information as a new entry in the database. This ensures that the reservation information is recorded in a format that can be referenced later. The server then updates the reservation status to proceed.

[1089] Step 7:

[1090] The server generates and sends an invitation email to users and visitors. The invitation email might include content such as, "Mr. / Ms. Taro Yamada, you can visit us on December 1st, 2023 at 10:00 AM. We look forward to seeing you." The server uses the SMTP protocol and the Python email library to send the email.

[1091] Step 8:

[1092] The server integrates visitor information with specific systems. For example, it sends information to external systems such as CRM systems or visitor management systems to achieve centralized data management. API calls and database integrations are used here as well.

[1093] Step 9:

[1094] The device receives a reservation success notification from the server and notifies the user. The device notifies the user via a pop-up or in-app notification. This allows the user to immediately confirm that the reservation was successful.

[1095] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1096] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user enters and sends the visitor's name and scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending a business card image and the scheduled date and time of visit. In addition, by combining this with an emotion engine that recognizes the user's emotions, more appropriate invitation emails can be generated and delivered.

[1097] 1. Enter and submit visitor information.

[1098] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. Specifically, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. Alternatively, the user can attach an image of a business card and enter "January 15, 2024, 2:00 PM" and send it.

[1099] 2. Receiving and parsing messages

[1100] The communication terminal receives messages from the user and analyzes their content. For example, if the terminal receives a message such as "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time. In the case of a business card image, the communication terminal uses image recognition technology to extract text information from the business card, obtaining information such as "Taro Tanaka". The analyzed information is then sent to the server.

[1101] 3. Emotional analysis using an emotion engine

[1102] The emotion engine analyzes message text or audio data sent by the user to determine the user's emotional state. For example, from a message such as "Taro Tanaka, January 15, 2024, 2:00 PM," the emotion engine analyzes the user's emotions and identifies positive or negative emotions from the text.

[1103] 4. Meeting room reservations via server

[1104] The server receives visitor names and scheduled arrival times from communication terminals and checks the availability of meeting rooms. For example, the server receives data such as "Taro Tanaka, January 15, 2024, 2:00 PM" and sends a query to the meeting room reservation system. As a result, the server selects the most suitable meeting room and makes a reservation. The reservation information is stored in the database.

[1105] 5. Generating and sending the notification email.

[1106] After the server confirms that the meeting room reservation was successful, it generates a confirmation email based on the results of the emotion engine's analysis. For example, if the emotion engine's analysis indicates a positive emotion, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM." The content and format of the email will be adjusted according to the user's emotional state.

[1107] 6. Notification to the user

[1108] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the communication terminal might display "Reservation successful" on the screen to inform the user. This notification may also include the results of the emotion engine's analysis.

[1109] Specific example

[1110] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging application, the communication terminal analyzes this information and sends it to the server. The emotion engine analyzes the message and identifies that the user's emotional state is positive. The server checks the availability of meeting rooms and reserves meeting room A. A confirmation email is generated and sent with the content "Dear Taro Tanaka, We look forward to welcoming you to meeting room A on January 15, 2024 at 14:00." Finally, the communication terminal notifies the user that the reservation was successful.

[1111] Thus, the system of the present invention can efficiently handle visitor reception while minimizing the burden on the user, and further provides a more comfortable user experience by flexibly adjusting the response according to the user's emotional state.

[1112] The following describes the processing flow.

[1113] Step 1:

[1114] The user uses the messaging application on their communication device to enter the visitor's name and the scheduled date and time of their visit, and then sends the message. For example, the user might enter "Taro Tanaka, January 15, 2024, 2:00 PM" and send it.

[1115] Step 2:

[1116] The communication terminal receives messages sent by the user and analyzes their contents. For example, if the terminal receives the message "Taro Tanaka January 15, 2024 14:00", it separates and extracts the name and date / time.

[1117] Step 3:

[1118] The emotion engine analyzes the message text to determine the user's emotional state. For example, the emotion engine analyzes the sent message and identifies that the user is in a positive state.

[1119] Step 4:

[1120] The communication terminal sends the analyzed visitor's name, scheduled arrival date and time, and emotional state (determined by the emotion engine) to the server. For example, the terminal might send "Taro Tanaka," "January 15, 2024, 2:00 PM," and "Positive emotional state" to the server.

[1121] Step 5:

[1122] The server receives the transmitted information and checks the availability of meeting rooms. The server sends a query to the meeting room reservation system to check if there are any meeting rooms available on "January 15, 2024, 14:00".

[1123] Step 6:

[1124] The server receives the response from the meeting room reservation system and selects the most suitable meeting room. For example, the server confirms that meeting room A is available.

[1125] Step 7:

[1126] The server reserves Conference Room A with the request "Taro Tanaka, January 15, 2024, 14:00" and saves the reservation information to the database. By writing the reservation information to the database, the server shares the information with other users.

[1127] Step 8:

[1128] The server confirms the successful reservation of the meeting room and generates a confirmation email based on the analysis results of the emotion engine. For example, if the user's emotional state is positive, it will generate an email with content such as, "Mr. Taro Tanaka, we look forward to welcoming you to Meeting Room A on January 15, 2024 at 2:00 PM."

[1129] Step 9:

[1130] The server generates an announcement email and sends it to the relevant users and visitors. For example, the server sends the above email to the user and Taro Tanaka.

[1131] Step 10:

[1132] The communication terminal receives a reservation success notification from the server and notifies the user. For example, the terminal displays "Reservation successful" to inform the user. This notification may also include the results of the emotion engine's analysis.

[1133] (Example 2)

[1134] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1135] Traditional meeting room reservation systems had several drawbacks, including the need for users to manually enter visitor information and planned arrival dates and times, as well as check meeting room availability and make reservations. Furthermore, the generation of confirmation emails was often formulaic and lacked the flexibility to respond to user emotions, resulting in an unsatisfactory user experience. Additionally, manual entry of business card information was sometimes required, making efficient workflow difficult.

[1136] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1137] In this invention, the server includes means for a user to input and transmit visitor information and scheduled visit date and time using a messaging application on a communication terminal; means for the communication terminal to analyze the visitor information and scheduled visit date and time using the messaging application; means for the communication terminal to transmit the analyzed visitor information and scheduled visit date and time to the server; means for the server to reserve a meeting room based on the received visitor information and scheduled visit date and time; means for the server to analyze the user's emotions using an emotion analysis engine; and means for the server to generate and send a notification email based on the meeting room reservation and emotion analysis results. As a result, users can easily reserve meeting rooms without hassle, and it is also possible to generate flexible notification emails that respond to emotions, resulting in a more comfortable user experience.

[1138] A "communication terminal" is a device used by users to input and transmit information, and includes smartphones, tablets, and personal computers.

[1139] A "messaging application" is software used by users to send text, images, and other data, and includes chat apps and messaging platforms.

[1140] "Visitor information" refers to data about the person scheduled to visit, including their name, job title, and affiliated organization.

[1141] "Scheduled visit date and time" refers to the specific date and time when the visitor plans to visit the company.

[1142] "Analyzing" refers to the process of analyzing transmitted data and extracting and classifying the necessary information.

[1143] A "server" is a computer system that receives, processes, and stores data transmitted from a communication terminal.

[1144] "Reserving a meeting room" refers to the process of securing a meeting room that is available at a specified date and time, and recording that information in a database.

[1145] An "emotion analysis engine" is software or an algorithm that identifies emotions from text or audio data and classifies them into emotional states such as positive, negative, or neutral.

[1146] A "confirmation email" is an email generated to notify visitors / users that their meeting room reservation has been successful, and it is sent to them.

[1147] "Business card image" refers to a photograph or scanned data of a business card containing the visitor's information.

[1148] "Extracting" refers to the process of extracting necessary data from images or text.

[1149] A "database" is a system for systematically managing collected and stored information, enabling rapid information retrieval through various queries.

[1150] A "reservation success notification" is a message or notification sent to inform the user that their reservation for a meeting room has been confirmed.

[1151] Embodiments of the present invention will now be described. This system automatically reserves a meeting room and sends an invitation email when a user inputs and sends visitor information and the scheduled date and time of visit using a messaging application on a communication terminal. Furthermore, the same process can be performed automatically simply by sending an image of a business card and the scheduled date and time of visit. The system also has a function to generate and deliver flexible invitation emails that respond to the user's emotions by utilizing an emotion analysis engine.

[1152] Hardware and software to be used

[1153] The communication devices used by users include smartphones, tablets, and personal computers. Messaging applications such as LINE and Slack are used. Text analysis libraries such as NLTK and spaCy are used, and OCR technology such as Tesseract is employed. Servers are envisioned to be either cloud computing resources or on-premises servers, and database management systems such as MySQL and PostgreSQL are used. Sentiment analysis engines such as Google Cloud Natural Language and IBM Watson are employed. Template engines such as Jinja2 and Mustache are used to generate notification emails, and SMTP servers such as SendGrid and Amazon SES are used.

[1154] Process Overview

[1155] 1. Enter and submit visitor information.

[1156] Users use the messaging application on their communication terminal to enter visitor information and the scheduled date and time of their visit and send it. Specifically, the user would type a message such as "Taro Tanaka, January 15, 2024, 2:00 PM" and send it. It is also possible to attach an image of a business card and type "January 15, 2024, 2:00 PM" and send it.

[1157] 2. Receiving and parsing messages

[1158] The communication terminal receives messages from users and analyzes their content. Specifically, the communication terminal analyzes text messages and separates and extracts names and dates. In the case of business card images, the communication terminal uses OCR technology to extract text information. The analyzed information is then sent to the server.

[1159] 3. Emotional analysis using an emotion engine

[1160] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state. Specifically, the sentiment engine identifies positive, negative, or neutral emotions.

[1161] 4. Meeting room reservations via server

[1162] Based on the visitor information and scheduled arrival date and time received by the server, it checks the availability of meeting rooms and makes reservations. Specifically, the server sends a query to the database management system, selects an appropriate meeting room, and makes a reservation. The reservation information is stored in the database.

[1163] 5. Generating and sending the notification email.

[1164] After the server confirms the meeting room reservation, it generates and sends a notification email based on the sentiment engine's analysis results. Specifically, it uses a template engine to generate a notification email according to the sentiment analysis results and sends it via the SMTP server.

[1165] 6. Notification to the user

[1166] The communication terminal receives a reservation success notification from the server and notifies the user. The communication terminal displays the message "Reservation successful." This notification may also include sentiment analysis results.

[1167] Specific example

[1168] For example, if a user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app, the communication device analyzes the information and sends it to the server. An emotion analysis engine analyzes this message and identifies that the user's emotion is positive. The server checks the availability of Conference Room A, makes a reservation, and generates and sends a confirmation email saying, "Mr. / Ms. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 14:00." Finally, the communication device notifies the user that "the reservation was successful."

[1169] Examples of prompts for generative AI models

[1170] The following is an example of a prompt message to the generative AI model used in this system.

[1171] The user sends "Taro Tanaka January 15, 2024 14:00" via a messaging app. The communication terminal analyzes the information, and the sentiment analysis engine identifies positive emotions. The server sends a query to the conference room reservation system and reserves conference room A. It generates and sends a confirmation email, "Dear Taro Tanaka, We look forward to welcoming you to conference room A on January 15, 2024 at 14:00." The communication terminal notifies the user that "Reservation successful."

[1172] This system allows users to easily reserve meeting rooms without hassle, and enables the generation of flexible notification emails tailored to their emotions, resulting in a more comfortable user experience. It also supports information input using business card images, contributing to improved work efficiency.

[1173] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1174] Step 1:

[1175] The user enters visitor information and scheduled arrival date and time using the messaging application on their communication device and sends it.

[1176] Specifically, the user can either type and send a text message saying "Taro Tanaka January 15, 2024 14:00", or attach an image of a business card and type "January 15, 2024 14:00" and send it.

[1177] Input: User-entered text message and business card image

[1178] Output: Data sent via messaging application

[1179] Step 2:

[1180] The communication terminal receives a message from the user and analyzes its contents.

[1181] Specifically, the communication terminal receives the text message "Taro Tanaka, January 15, 2024, 14:00," and uses a text analysis library (e.g., NLTK or spaCy) to separate and extract visitor information and the scheduled date and time of visit. If the information is from a business card image, OCR technology (e.g., Tesseract) is used to extract the text information. The analyzed information is then sent to the server.

[1182] Input: Text messages and image data received from messaging applications.

[1183] Output: Analyzed visitor information and scheduled visit date and time.

[1184] Step 3:

[1185] The server passes the received message text to the sentiment analysis engine to determine the user's emotional state.

[1186] Specifically, the server uses a sentiment analysis engine (e.g., Google Cloud Natural Language or IBM Watson) to identify positive, negative, or neutral sentiment from the text "Taro Tanaka January 15, 2024 14:00".

[1187] Input: Parsed message text

[1188] Output: Sentiment analysis results (positive, negative, neutral)

[1189] Step 4:

[1190] Based on the visitor information and scheduled arrival date and time received by the server, the server checks the availability of meeting rooms and makes reservations.

[1191] Specifically, the server sends a query to a database management system (e.g., MySQL or PostgreSQL), processes a query like "SELECT FROM rooms WHERE available = 1 AND date = '2024-01-15' AND time = '14:00'", selects the most suitable meeting room, and reserves it. The reservation information is then stored in the database.

[1192] Input: Analyzed visitor information and scheduled visit date and time.

[1193] Output: Meeting room reservation information

[1194] Step 5:

[1195] After the server confirms the meeting room reservation, it generates and sends a confirmation email based on the sentiment analysis results.

[1196] Specifically, the server uses a template engine (e.g., Jinja2 or Mustache) to generate an invitation email with content tailored to the recipient's mood, such as "Mr. Taro Tanaka, we look forward to welcoming you to Conference Room A on January 15, 2024 at 2:00 PM." This email is then sent using an SMTP server (e.g., SendGrid or Amazon SES).

[1197] Input: Meeting room reservation information and sentiment analysis results

[1198] Output: Notification email

[1199] Step 6:

[1200] The communication terminal receives a reservation success notification from the server and notifies the user.

[1201] Specifically, the communication terminal receives a "reservation successful" notification from the server and uses a GUI library (e.g., Android's Toast or iOS's UIAlertController) to display it to the user. This notification may also include sentiment analysis results.

[1202] Input: Reservation success notification from the server

[1203] Output: Notification to the user

[1204] (Application Example 2)

[1205] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1206] Conventional visitor management systems require users to manually manage visitor information and respond without considering emotional states, resulting in a heavy user burden and potentially inadequate visitor responses. Furthermore, factories and large facilities have a large number of visitors, making visitor management complex. This makes efficient responses difficult and risks reducing visitor satisfaction. The present invention aims to solve these problems by automating visitor responses and providing optimal responses based on emotions.

[1207] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for reserving a meeting place based on the visitor's name and scheduled date and time of visit, means for checking the availability of meeting places and selecting the optimal meeting place, and means for optimizing guidance communication based on emotional state. This allows the user to automatically manage and analyze visitor information, enabling efficient and appropriate responses. Specifically, it is possible to improve visitor satisfaction by acquiring visitor information using a smart terminal via QR code scanning or voice input, analyzing the emotional state with a situation recognition engine, and providing optimal guidance and responses.

[1208] A "communication device" refers to a means of communication used by a user, such as a mobile phone, smartphone, or tablet device.

[1209] A "messaging application" is software that runs on a communication terminal and is used to send and receive messages.

[1210] "Visitor name" refers to the name of a visitor and is information used to identify an individual.

[1211] "Scheduled arrival date and time" refers to the date and time when the visitor is expected to arrive.

[1212] A "server" is a central computer system that interacts with communication terminals via a network to perform data analysis, storage, and transmission.

[1213] A "meeting place" refers to the room or area where a meeting or discussion takes place.

[1214] "Guidance and communication" refers to providing information and contacting visitors, and includes methods such as email and notifications.

[1215] A "situation recognition engine" is software that analyzes a user's emotional state from text and audio data.

[1216] "Emotional state" refers to the feelings of users or visitors, and includes states such as positive and negative.

[1217] A "smart device" refers to a communication device with advanced functions, such as smart glasses or a smartphone.

[1218] "QR code scanning" refers to the act of reading a QR code using the camera of a smart device.

[1219] "Voice input" refers to the process where a user enters information using their voice, employing speech recognition technology.

[1220] To implement this invention, a communication terminal, a server, a smart terminal, a situation recognition engine, and a messaging application are used.

[1221] First, the user inputs visitor information using a communication device such as smart glasses or a smartphone. Specifically, the user can input the visitor's name and scheduled visit date and time using the messaging application on the communication device and send it. It is also possible to scan an image of a business card using the camera on the communication device, input the scheduled visit date and time, and send it.

[1222] The communication terminal analyzes the input information and extracts the visitor's name and scheduled visit date and time. This analysis uses text analysis and optical character recognition (OCR) technology. The analyzed information is then sent to the server.

[1223] The server reserves a meeting venue based on the received visitor name and scheduled arrival date and time. It checks the availability of meeting venues and consults the database to select the most suitable venue. Once the most suitable venue is determined, the reservation information is saved in the database.

[1224] Furthermore, information sent by users is analyzed by a situation recognition engine to determine the emotional state of the user or visitor. The situation recognition engine identifies emotional states from text and voice data, determining whether the user is in a positive or negative state.

[1225] The server generates guidance communications based on the user's emotional state. A friendly guidance email is generated for positive emotional states, while a polite and calm guidance email is generated for negative emotional states. This guidance email is sent promptly to the user, allowing them to take the most appropriate action.

[1226] Through the above processes, the entire process of automatically analyzing visitor information and booking meeting venues is streamlined, enabling optimal responses based on emotions.

[1227] As a concrete example, when a user sends the message "Taro Yamada, January 20, 2024, 10:00" from their communication device, the device analyzes this information and sends it to the server. The server checks the availability of the meeting place, makes a reservation, and the situation recognition engine performs sentiment analysis. Finally, the user receives an email notification stating, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C on January 20, 2024 at 10:00."

[1228] Examples of prompts generated using a generative AI model are as follows:

[1229] Q: Please tell me about a system that uses smart glasses to extract information from business cards and generate meeting room reservations and confirmation emails.

[1230] A: This system scans business card images with smart glasses and reserves meeting rooms based on the extracted text information. It also uses an emotion engine to provide users with corresponding messages. Technologies used include OCR (Optical Character Recognition), QR code analysis, and RESTful API communication.

[1231] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1232] Step 1:

[1233] Users enter and send visitor information using the messaging application on their communication terminal. Specifically, they enter the visitor's name and scheduled visit date and time as a message and send it. They can also attach an image of a business card and enter the scheduled visit date and time and send it. The input data is in the format of "Taro Yamada January 20, 2024 10:00" or "Image of business card, January 20, 2024 10:00".

[1234] Step 2:

[1235] The communication terminal receives messages sent by the user and analyzes their content. For example, it analyzes the message "Taro Yamada January 20, 2024 10:00" and extracts the visitor's name "Taro Yamada" and the scheduled visit date and time "January 20, 2024 10:00". In the case of a business card image, the communication terminal uses OCR technology to extract the visitor's name from the image. The input data is a message or an image, and the output data is the text data of the analysis results.

[1236] Step 3:

[1237] The communication terminal analyzes the visitor's name and scheduled visit date and time and sends it to the server. The transmitted data is in text format and is sent to the server as "Taro Yamada, January 20, 2024, 10:00".

[1238] Step 4:

[1239] The server reserves a meeting room based on the visitor's name and scheduled arrival date and time received. The server checks the availability of meeting rooms and consults a database to select the most suitable location. The input data is visitor information and the date and time, and the output data is the reservation information for the meeting room. For example, it might use a database query to confirm that "Meeting Room C is available" and then reserve this meeting room.

[1240] Step 5:

[1241] The server saves meeting venue reservation information to the database. The database stores data such as the reserved meeting venue and its date and time. The input data is the meeting venue reservation information, and the output data is the record stored in the database.

[1242] Step 6:

[1243] The situation recognition engine analyzes the message text sent by the user to determine the user's emotional state. For example, from the message "Taro Yamada, January 20, 2024, 10:00," the situation recognition engine identifies the emotion and determines that the user is experiencing a positive emotion. The input data is the message text, and the output data is an emotional state label (positive, negative, etc.).

[1244] Step 7:

[1245] The server generates a guidance message based on the emotion analysis results. If the emotion is positive, it generates a friendly message such as, "Mr. / Ms. Taro Yamada, we will welcome you in Conference Room C at 10:00 on January 20, 2024." If the emotion is negative, it generates a polite message. The input data is the emotion state and the reservation information for the meeting place, and the output data is the text of the guidance message.

[1246] Step 8:

[1247] The server generates a guidance communication and sends it to the user. The guidance communication is notified to the user's communication terminal, allowing the user to confirm the successful reservation and the content of the guidance. The input data is the text of the guidance communication, and the output data is the notification sent to the user.

[1248] The above describes a specific embodiment of this invention, in which data is input, processed, and output at each step, thereby achieving optimal visitor handling.

[1249] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1250] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1251] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1252] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1253] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1254] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1255] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1256] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1257] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1258] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1259] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1260] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1261] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1262] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1263] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1264] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1265] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1266] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1267] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1268] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1269] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1270] The following is further disclosed regarding the embodiments described above.

[1271] (Claim 1)

[1272] A means by which the user enters and sends the visitor's name and scheduled date and time of visit using the messaging application on their communication terminal,

[1273] The aforementioned communication terminal includes means for analyzing the visitor's name and scheduled arrival date and time using the messaging application,

[1274] The communication terminal includes means for transmitting the analyzed visitor name and scheduled arrival date and time to the server,

[1275] A means for reserving a meeting room based on the visitor's name and scheduled arrival date and time received by the server,

[1276] A system including means for the server to generate and send an informational email based on the reservation of the meeting room.

[1277] (Claim 2)

[1278] A means by which the user sends an image of a business card and the scheduled date and time of their visit to the company to the aforementioned communication terminal,

[1279] The aforementioned communication terminal includes means for analyzing the image of the business card to extract the visitor's name,

[1280] The system according to claim 1, further comprising means for the communication terminal to transmit the extracted visitor name and the scheduled date and time of visit to the server.

[1281] (Claim 3)

[1282] The server checks the availability of meeting rooms and selects the most suitable meeting room.

[1283] The server provides means for storing the reservation information of the conference room in a database,

[1284] The system according to claim 1, further comprising means for the communication terminal to notify the user of the successful reservation of the meeting room.

[1285] "Example 1"

[1286] (Claim 1)

[1287] A means by which the user enters and sends the visitor's name and scheduled date and time of visit using the messaging application on their communication terminal,

[1288] The aforementioned communication terminal includes means for analyzing the visitor's name and scheduled arrival date and time using the messaging application,

[1289] The communication terminal includes means for transmitting the analyzed visitor name and scheduled arrival date and time to the server,

[1290] A means for reserving a meeting room based on the visitor's name and scheduled arrival date and time received by the server,

[1291] The server provides means for generating and sending an invitation email based on the reservation of the meeting room,

[1292] A system including means for receiving a reservation success notification from the server and notifying the user.

[1293] (Claim 2)

[1294] A means by which the user sends an image of a business card and the scheduled date and time of their visit to the company to the aforementioned communication terminal,

[1295] The aforementioned communication terminal includes means for analyzing the image of the business card to extract the visitor's name,

[1296] The system according to claim 1, wherein the communication terminal includes means for transmitting the extracted visitor name and the scheduled date and time of visit to the server.

[1297] (Claim 3)

[1298] The server checks the availability of meeting rooms and selects the most suitable meeting room.

[1299] The system according to claim 1, which includes means for the server to store the reservation information of the conference room in a database.

[1300] "Application Example 1"

[1301] (Claim 1)

[1302] A means for the user to input and send visitor information and scheduled arrival date and time using a messaging application on a communication terminal,

[1303] The aforementioned communication terminal includes means for analyzing the visitor information and scheduled date and time of visit using the messaging application,

[1304] The aforementioned communication terminal includes means for transmitting the analyzed visitor information and scheduled visit date and time to the server,

[1305] A means for making a reservation for a room based on the visitor information and scheduled arrival date and time received by the server,

[1306] The server provides means for generating and sending a notification email based on the reservation of the reserved room,

[1307] A system that includes means by which the server connects visitors to a specific system based on the sending of the notification email.

[1308] (Claim 2)

[1309] A means by which the user sends an image of a business card and the scheduled date and time of their visit to the company to the aforementioned communication terminal,

[1310] The aforementioned communication terminal includes means for analyzing the image of the business card and extracting visitor information,

[1311] The system according to claim 1, further comprising means for the communication terminal to transmit the extracted visitor information and the scheduled date and time of visit to the server.

[1312] (Claim 3)

[1313] The aforementioned server checks the availability of the rooms to be reserved and selects the most suitable room for reservation.

[1314] The server provides means for storing reservation information for the reserved room in a storage unit,

[1315] The system according to claim 1, further comprising means for the communication terminal to notify the user of the successful reservation of the reserved room.

[1316] "Example 2 of combining an emotion engine"

[1317] (Claim 1)

[1318] A means for the user to input and send visitor information and scheduled arrival date and time using a messaging application on a communication terminal,

[1319] The aforementioned communication terminal includes means for analyzing the visitor information and scheduled date and time of visit using the messaging application,

[1320] The aforementioned communication terminal includes means for transmitting the analyzed visitor information and scheduled visit date and time to the server,

[1321] A means for reserving a meeting room based on visitor information and scheduled arrival date and time received by the server,

[1322] The server includes means for analyzing the user's emotions using an emotion analysis engine,

[1323] A system including means for the server to generate and send an invitation email based on the reservation of the meeting room and the sentiment analysis results.

[1324] (Claim 2)

[1325] A means by which the user sends an image of a business card and the scheduled date and time of their visit to the company to the aforementioned communication terminal,

[1326] The aforementioned communication terminal includes means for analyzing the image of the business card and extracting visitor information,

[1327] The system according to claim 1, further comprising means for the communication terminal to transmit the extracted visitor information and the scheduled date and time of visit to the server.

[1328] (Claim 3)

[1329] The server checks the availability of meeting rooms and selects the most suitable meeting room.

[1330] The server provides means for storing the reservation information of the conference room in a database,

[1331] The system according to claim 1, further comprising means for the communication terminal to notify the user of the successful reservation of the meeting room.

[1332] "Application example 2 when combining with an emotional engine"

[1333] (Claim 1)

[1334] A means by which the user enters and sends the visitor's name and scheduled visit date and time using the messaging application on their communication terminal,

[1335] The communication terminal includes means for analyzing the visitor's name and scheduled visit date and time using the messaging application,

[1336] The communication terminal includes means for transmitting the analyzed visitor name and scheduled visit date and time to the server,

[1337] A means for reserving a meeting place based on the visitor's name and scheduled arrival date and time received by the server,

[1338] The server provides means for generating and transmitting guidance communications based on the reservation of the meeting place,

[1339] The aforementioned situation recognition engine includes means for analyzing the user's emotional state,

[1340] A system including means for optimizing guidance communication based on the aforementioned emotional state.

[1341] (Claim 2)

[1342] A means by which the user transmits an image of user information and the scheduled date and time of visit to the aforementioned communication terminal,

[1343] The aforementioned communication terminal includes means for analyzing the image of the user information to extract the visitor's name,

[1344] The system according to claim 1, further comprising means for the communication terminal to transmit the extracted visitor name and the scheduled date and time of visit to the server.

[1345] (Claim 3)

[1346] The server has a means for checking the availability of meeting locations and selecting the most suitable meeting location.

[1347] The server provides means for storing the reservation information of the meeting place in a database,

[1348] The aforementioned communication terminal provides means for notifying the user of the successful reservation of the meeting place,

[1349] The smart terminal has means for acquiring and transmitting visitor information by scanning and voice input,

[1350] The system according to claim 1, further comprising means by which the terminal indicates an appropriate response to the user based on visitor information and emotional state. [Explanation of Symbols]

[1351] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means by which the user enters and sends the visitor's name and scheduled date and time of visit using the messaging application on their communication terminal, The communication terminal includes means for analyzing the visitor's name and scheduled arrival date and time using the messaging application, The aforementioned communication terminal includes means for transmitting the analyzed visitor name and scheduled arrival date and time to the server, A means for reserving a meeting room based on the visitor's name and scheduled arrival date and time received by the server, A system including means for the server to generate and send an informational email based on the reservation of the conference room.

2. A means by which the user sends an image of a business card and the scheduled date and time of their visit to the company to the aforementioned communication terminal, The aforementioned communication terminal includes means for analyzing the image of the business card to extract the visitor's name, The system according to claim 1, further comprising means for the communication terminal to transmit the extracted visitor name and the scheduled date and time of visit to the server.

3. The server checks the availability of meeting rooms and selects the most suitable meeting room. The server provides means for storing the reservation information of the conference room in a database, The system according to claim 1, further comprising means for the communication terminal to notify the user of the successful reservation of the meeting room.

Images