system

Abstract

A system is provided.SOLUTION: The system includes a terminal for inputting specific information of a customer, a means for extracting a past request item from a database based on the specific information transmitted from the terminal, a means for automatically generating an estimate and an application form by using the extracted past request item information, a means for storing the generated estimate and application form in a PDF format, and a mail transmitting means for automatically transmitting the generated PDF file to the customer.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In today's business environment, quickly and accurately processing recurring customer requests is a critical issue. However, manually searching for past requests, creating estimates and application forms, and sending them by email is time-consuming, labor-intensive, and prone to human error. This can lead to reduced business efficiency and customer satisfaction. The present invention aims to provide a system that solves these problems. [Means for solving the problem]

[0005] The present invention is a system including a terminal for inputting specific information about a customer, means for extracting past requests from a database based on the specific information sent from the terminal, means for automatically generating quotations and application forms using the extracted information about the past requests, means for saving the generated quotations and application forms in PDF format, and means for automatically sending the generated PDF files to customers by email. Furthermore, by providing a means for embedding information required for the quotations and application forms into a template and a means for automatically generating an email body from the template and personalizing it based on the inserted customer information, the system can improve the efficiency and accuracy of operations.

[0006] "Specific information" refers to information for identifying a customer, such as a company number or customer ID.

[0007] "Terminal" refers to a device through which a user inputs information and communicates with the system, including, for example, a computer, tablet, or smartphone.

[0008] A "database" refers to a system that accumulates customer information and past requests and manages them in a searchable format.

[0009] "Extraction means" refers to a program or function for searching and retrieving data matching specific information from a database.

[0010] "Quotation" means a document that sets out a budget or cost estimate for the provision of goods or services.

[0011] "Application Form" means a document that officially requests the purchase or use of a product or service.

[0012] "Means for automatic generation" refers to a program or function that embeds data into a template and creates a document in a predetermined format.

[0013] "PDF format" stands for Portable Document Format and refers to a format for electronically storing and distributing documents.

[0014] "Email sending means" refers to a program or function for sending the generated document as an email.

[0015] A "template" refers to a format for presetting a standard format for an estimate or application form.

[0016] "Personalization tools" refers to programs or functions that insert specific information for each customer into templates to generate customized documents or emails. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. In this system, the server searches the database, generates documents, and sends emails based on the company number entered by the user on the terminal. The system's program processing is described in detail below.

[0039] Program processing overview

[0040] Enter and submit customer information

[0041] The user enters the company number into the input form on the terminal. After that, when the user clicks the "Send" button, the company number is sent to the server. The data sent from the terminal to the server may include user authentication information in addition to the company number.

[0042] Extraction of past requests

[0043] The server receives the company number sent from the terminal and accesses the database. It searches the database for past request information corresponding to this company number and extracts the relevant data. For example, for company number "12345," information on "Project A" and "Project B" is extracted from the database.

[0044] Creating quotes and application forms

[0045] The server automatically generates estimates and application forms based on the extracted information on past requests. Specifically, it embeds the necessary data into estimate and application form templates. The templates contain information such as the customer name, project name, request details, and price information, and this information is automatically inserted based on the extracted data. This generates estimates and application forms that are personalized for each customer.

[0046] Save as PDF

[0047] The generated estimates and application forms are saved in PDF format. The server saves these PDF files in a specific folder, and the file name is given the company number or project name. For example, they might be named "Estimate_12345_ProjectA.pdf" or "Application_12345_ProjectB.pdf."

[0048] Automatic email sending

[0049] The server automatically generates the email body to be sent to the customer from a template. The template includes a greeting and a summary of the request, and is customized based on the extracted customer information. The generated email body and the aforementioned PDF file are attached and automatically sent to the customer's email address. For example, an email with the subject "Information about the quotation and application form" is sent to "Customer name@domain.com."

[0050] Specific examples

[0051] The specific processing flow is shown below.

[0052] 1. Enter and submit customer information

[0053] The user enters the company number "12345" into the input form on the terminal and clicks the send button.

[0054] 2. Extraction of past requests

[0055] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[0056] 3. Creating a quote and application form

[0057] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[0058] Fill in the information for "Project B" into the application form template and automatically generate the application form.

[0059] 4. Save as PDF

[0060] The server saves the generated quotation and application form as "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0061] 5. Automated email sending

[0062] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[0063] As described above, the present invention makes it possible to improve the efficiency and accuracy of business operations and to improve the quality of customer service.

[0064] The processing flow will be explained below.

[0065] Step 1:

[0066] The user enters the company number "12345" into the input form on the terminal, then clicks the send button, and the entered company number is sent to the server.

[0067] Step 2:

[0068] The server receives the company number "12345" sent from the terminal. After receiving it, the server uses this company number to access the database.

[0069] Step 3:

[0070] The server searches the database for past requests that match the company number "12345." For example, it extracts information on "Project A" and "Project B."

[0071] Step 4:

[0072] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[0073] Step 5:

[0074] The server extracts the information for "Project A" and "Project B" and embeds it into the template. Individual estimates and application forms are generated, with the necessary information accurately inserted.

[0075] Step 6:

[0076] The server saves the generated quotation and application form in PDF format. The file names will be "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[0077] Step 7:

[0078] The server loads an email template to send to the customer, which includes a greeting and a summary of the request.

[0079] Step 8:

[0080] The server automatically inserts necessary information such as the customer name and request details into the email template and generates the email body. The specific content is adapted to the customer.

[0081] Step 9:

[0082] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[0083] Step 10:

[0084] The user receives a confirmation message on their device, confirming that the email was successfully sent to the customer.

[0085] Example 1

[0086] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0087] In conventional systems, creating quotes and application forms in response to repeated requests from customers is done manually, which is time-consuming and labor-intensive. It is also difficult to efficiently extract information about past requests, which increases the risk of manual input errors and omissions. Furthermore, the process of sending generated documents to customers is inefficient, and email transmission is cumbersome. To solve these problems, it is necessary to quickly extract information about past requests, accurately create automatically generated documents, and automate email transmission.

[0088] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0089] In this invention, the server includes a terminal for inputting customer identification information, means for extracting past requests from a database based on the identification information transmitted from the terminal, means for automatically generating a document using the extracted past request information, means for saving the generated document in PDF format, and means for automatically transmitting the generated PDF file to the customer by email. This enables the rapid and accurate extraction of past request information, the automatic generation of estimates and application forms, and the automation of email transmission.

[0090] "Customer" refers to the party that makes a request or places an order with a company or individual that provides a service or product.

[0091] "Identification information" refers to data such as numbers or codes that uniquely identify a particular customer.

[0092] "Terminal" refers to the device (such as a PC, tablet, or smartphone) that a user uses to enter information and communicate with the system.

[0093] A "database" is a system for systematically storing information and quickly and efficiently extracting data based on specific queries.

[0094] "Request" refers to an order or request made by a customer to a company or individual providing a service or product.

[0095] "Document" refers to documents or written documents that organize and describe information (e.g., estimates, application forms, etc.).

[0096] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing, displaying, and printing documents.

[0097] "Email delivery method" refers to the software or process used to create and send email.

[0098] A "template" refers to a document model that has a specific format and structure predefined.

[0099] "Filling" refers to the process of adding appropriate data to placeholders in a template.

[0100] "Personalization" refers to customizing the content of documents and emails based on specific customer information.

[0101] The present invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. Specific embodiments for carrying out the present invention are described below.

[0102] Hardware and software used

[0103] Hardware: Servers, user devices (PCs, tablets, smartphones, etc.)

[0104] Software: Database management system (e.g., MySQL (registered trademark)), PDF generation library (e.g., Apache (registered trademark) PDFBox), email sending library (e.g., Java (registered trademark) Mail)

[0105] Enter and submit customer information

[0106] The user enters the company number into the input form on the terminal and clicks the "Submit" button. This operation causes the terminal to send the company number and user authentication information to the server. An HTTP POST request is used to send data from the terminal to the server.

[0107] Extraction of past requests

[0108] The server accesses the database based on the received company number and searches for past order information related to that company number. The server executes an SQL query using a database management system (e.g., MySQL). For example, it issues a query such as "SELECT FROM orders WHERE company_number = '12345'".

[0109] Creating quotes and application forms

[0110] The server creates estimates and application forms based on past request information. At this time, it reads estimate and application form templates (e.g., template file estimate_template.docx) and embeds the necessary information into the template. During the embedding process, the appropriate data is inserted into placeholders by a program.

[0111] Save as PDF

[0112] The generated quotation and application forms are converted to PDF format. The server uses the Apache PDFBox library to convert the document files to PDF format and saves them in a specific folder (e.g., / var / docs / ). The saved files are assigned the company number and project name (e.g., "Quotation_12345_ProjectA.pdf").

[0113] Automatic email sending

[0114] The server automatically generates the email body from the template, attaches the generated quotation and application form PDF files, and sends them to the customer. The JavaMail library is used to send the email. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[0115] Specific examples

[0116] The specific processing flow is shown below.

[0117] 1. Enter and submit customer information

[0118] The user enters the company number "12345" into the input form on the terminal and clicks the "Submit" button.

[0119] 2. Extraction of past requests

[0120] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[0121] 3. Creating a quote and application form

[0122] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[0123] The server embeds the information for "Project B" into the application form template and automatically generates the application form.

[0124] 4. Save as PDF

[0125] The server saves the generated quotation and application form as "Quotation_12345_CaseA.pdf" and "Application_12345_CaseB.pdf".

[0126] 5. Automated email sending

[0127] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[0128] Prompt Sentence Examples

[0129] Below are some examples of prompts related to this system:

[0130] I entered the company number "12345". Please search past requests, generate quotes and application forms, and send them by email.

[0131] In this way, by entering the company number, users can quickly and accurately generate quotations and application forms based on past requests and automatically send them to customers. This system improves work efficiency and accuracy.

[0132] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0133] Program processing flow

[0134] Step 1: Enter and submit customer information

[0135] Specific explanation

[0136] 1.1. The user enters the company number into the input form on the terminal. For example, enter the company number "12345".

[0137] 1.2. When the user clicks the "Submit" button, JavaScript (registered trademark) on the terminal creates form data and sends the company number and user authentication information to the server as an HTTP POST request.

[0138] input

[0139] Company number (e.g. 12345)

[0140] User authentication information (e.g., user ID, password)

[0141] output

[0142] Company number and user authentication information sent to the server

[0143] Step 2: Extract past requests

[0144] Specific explanation

[0145] 2.1. The server receives the company number. For example, the company number "12345" is received.

[0146] The server queries the database to find past orders based on the company number, for example, by executing the SQL query "SELECT FROM orders WHERE company_number = '12345'".

[0147] 2.3. The server extracts the relevant data and stores it in memory. For example, it extracts information on "Project A" and "Project B" corresponding to company number "12345."

[0148] input

[0149] Company number (e.g. 12345)

[0150] User Credentials

[0151] output

[0152] Extracted request information (e.g., Case A, Case B)

[0153] Step 3: Create a quote and application

[0154] Specific explanation

[0155] The server loads the quotation and application form templates. For example, it loads the quotation template file "quote_template.docx."

[0156] 3.2. The server embeds the extracted data into a template and generates a document. For example, it embeds the data for "Project A" into the placeholder in the quotation template.

[0157] The server converts the generated document to PDF format. For example, it saves the generated quotation as "Quotation_12345_ProjectA.pdf".

[0158] input

[0159] Extracted request information (e.g., Case A, Case B)

[0160] Document template files

[0161] output

[0162] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0163] Step 4: Save as PDF

[0164] Specific explanation

[0165] 4.1. The server accesses a specific folder to save the generated PDF file, for example, the folder " / var / docs / ".

[0166] 4.2. The server saves the generated PDF file in a specific folder. The file name is given the company number and project name. For example, it is saved as "Quotation_12345_ProjectA.pdf".

[0167] input

[0168] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0169] output

[0170] PDF files saved in a folder

[0171] Step 5: Automated email sending

[0172] Specific explanation

[0173] The server loads the template file for sending email, for example, the email template file "email_template.html".

[0174] 5.2. The server generates the email body based on the template and embeds the extracted information.

[0175] The server attaches the generated PDF file to an email and sends it to the customer's email address. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[0176] input

[0177] Email template file

[0178] Customer email address (e.g. customername@domain.com)

[0179] Attached PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0180] output

[0181] Emails sent to customers

[0182] In this way, specific data processing and data calculations are performed at each processing step, and the overall system flow functions in coordination to respond to customer requests.

[0183] (Application example 1)

[0184] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0185] In conventional logistics centers, employees often manually input specific information and proceed with their work while checking paper-based instructions. This reduces work efficiency and increases the risk of input and confirmation errors. Furthermore, there is a lack of efficient ways to utilize past request data, which can sometimes prevent optimal work instructions from being provided. Therefore, there is a need for a system that utilizes voice input to provide optimal work instructions in real time.

[0186] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0187] In this invention, the server includes a means including a smart device that accepts customer specific information by voice input, a means for presenting work instructions in real time using voice guidance, and a means for automatically generating estimates and application forms using extracted past request information. This allows employees to efficiently input specific information using voice input, and enables them to proceed with work quickly and accurately thanks to real-time voice guidance.

[0188] "Customer specific information" is unique information for identifying a specific customer, such as a customer number or company number.

[0189] A "terminal" is an electronic device used to input customer information, such as a smartphone or tablet.

[0190] A "database" is an information management system for storing information on past requests and customer information.

[0191] "Quotation and application form" means a document that details the price and contract contents of the services or products to be provided to the customer.

[0192] "PDF format" is an abbreviation for Portable Document Format, a general-purpose file format for saving electronic documents.

[0193] "Email sending means" is a function for automatically creating and sending emails.

[0194] A "smart device" is an electronic device that allows voice input, such as smart glasses or a smart speaker.

[0195] "Voice guidance" is a function that conveys information and instructions to users by voice.

[0196] "Real-time" means processing and providing information immediately in the current time.

[0197] This invention realizes a system that improves work efficiency in a logistics center by using voice input and real-time work instructions. The system is composed of the following elements:

[0198] 1. Enter customer information

[0199] The user uses a smart device, specifically smart glasses, to input information by voice. By inputting the customer's customer number, which is the customer's specific information, and issuing a transmission command, the information is sent to the server. The smart glasses have a voice input function and a display that the user can see.

[0200] 2. Extraction of past requests

[0201] The server extracts past requests from the database based on the received customer number. At this stage, all past request data related to the relevant customer is extracted at high speed.

[0202] 3. Generate work instructions

[0203] The server automatically generates work instructions by embedding the necessary information in a template based on the extracted past request information. These work instructions are documents containing detailed information such as a cargo list and work procedures, and are saved in PDF format on the server.

[0204] 4. Real-time work instructions

[0205] The server sends the generated work instructions to the smart glasses in real time, and provides voice reminders and display information to the user, allowing the user to receive instructions both visually and audibly, reducing errors and enabling efficient work.

[0206] Examples of hardware and software used

[0207] Smart glasses (devices with voice input and display capabilities)

[0208] Server (running the database management system)

[0209] Software (automatic work instruction generation, template auto-filling, real-time voice and display control software)

[0210] Specific examples

[0211] When a logistics center employee receives a new order, they voice-input "customer number 12345" into the smart glasses. The server then extracts past order data from the database and automatically generates work instructions based on that data. The generated instructions are sent to the smart glasses in real time and are read aloud and displayed on the screen, providing employees with quick and accurate instructions.

[0212] Example prompts for generative AI models

[0213] Please create a program that generates loading instructions based on past logistics requests for customer number 12345 and displays them on the smart glasses of logistics center employees. Please include voice input and real-time display, or voice reading functionality.

[0214] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0215] Step 1:

[0216] Using the voice input function of the device (smart glasses), the user voice-inputs "Customer number 12345." This voice data is converted into text data and sent to the server as specific information. The input data is the customer number, and the output is the transmission of the specific information to the server.

[0217] Step 2:

[0218] The server accesses the database based on the received specific information (customer number 12345). It performs a database search and extracts past request information related to the corresponding customer number. The input data is the customer number, and the output is past request information. The server executes the database query and obtains the results.

[0219] Step 3:

[0220] The server uses the extracted information about past requests to automatically fill in the necessary information in the quotation and application form templates. Specifically, it inserts the customer name, project name, request details, price information, etc. into the template. The input data is the past request information, and the output is the automatically generated quotation and application form. The server uses a template engine.

[0221] Step 4:

[0222] The server saves the generated quotations and application forms in PDF format. The saved PDF files are stored in a specific folder, and the company number and project name are added to the file name. The input data is the quotation and application form data, and the output is a PDF file. The server uses a PDF generation library.

[0223] Step 5:

[0224] The server automatically generates the body of the email to be sent to the customer from a template based on the PDF file. The template includes a greeting and a summary of the request, and is customized based on the customer information. The input data is the customer information and the PDF file, and the output is the automatically generated email body. The server uses an email template engine.

[0225] Step 6:

[0226] The server attaches the generated email body and PDF file and automatically sends it to the customer's email address. The input data is the email body and PDF file, and the output is the sent email. The server uses an email sending library.

[0227] Step 7:

[0228] The server also transmits the generated work instructions to the smart device (smart glasses) in real time, and simultaneously provides voice guidance and display information to the user. The input data is the work instructions, and the output is voice guidance and display information. The server uses a speech synthesis engine and display control software.

[0229] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0230] This invention combines an emotion engine with a system that quickly processes past requests based on repeated customer requests and automates the creation of estimates and application forms and the sending of emails, thereby realizing responses based on the recognition of user emotions.In this invention, the server performs database searches, document generation, emotion recognition, and email sending based on the company number entered by the user on a terminal.

[0231] Program processing overview

[0232] Enter and submit customer information

[0233] The user enters the company number into the input form on the terminal and clicks the "Send" button, which sends the company number to the server. In this step, the interface installed on the terminal accurately sends the data entered by the user to the server.

[0234] Extraction of past requests

[0235] The server receives the company number sent from the terminal and accesses the database to search for past requests. For example, for company number "12345," it extracts information on "Project A" and "Project B."

[0236] Creating quotes and application forms

[0237] The server automatically generates quotes and application forms based on the templates, embedding the extracted information about past requests into the templates, thereby creating documents that are personalized for each customer.

[0238] Save as PDF

[0239] The server saves the automatically generated quotation and application form in PDF format. The generated files are named "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0240] Recognizing and Responding to Emotions

[0241] When a user enters and submits a company number, the terminal collects the user's emotional information and sends it to the server. The emotion engine analyzes this data and recognizes the user's emotion. Based on the recognized emotion, the server adjusts the content of the quote and application form. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[0242] Automatic email sending

[0243] The server generates the email body using an email template, and adjusts the tone and content of the email based on the user's emotions as recognized by the emotion engine. For example, if the user is feeling stressed, the email body can include words of comfort.

[0244] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the customer's email address. This procedure enables personalized responses and improves customer satisfaction.

[0245] Specific examples

[0246] 1. User operations

[0247] When a user enters the company number "12345" into the input form on the device and submits it, the device collects the user's facial expression and tone of voice as emotional data.

[0248] 2. Server data search

[0249] The server extracts from the database the past request cases "Case A" and "Case B" that correspond to the company number "12345".

[0250] 3. Generate quotes and application forms

[0251] The server embeds the information for "Project A" into the quotation template and automatically generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and automatically generates "Application_12345_ProjectB.pdf".

[0252] 4. Emotional Recognition and Regulation

[0253] The emotion engine recognizes the user's emotions and adjusts the quote content and email body accordingly. For example, if the user is unhappy, it will include polite language along with a discount offer.

[0254] 5. Automated email sending

[0255] The server generates the email body, adjusts it based on the sentiment, and automatically sends it to "customer name@domain.com" with the quote and application form PDF attached.

[0256] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[0257] The processing flow will be explained below.

[0258] Step 1:

[0259] The user enters the company number "12345" into the input form on the device. Then, they click the send button, and the company number is sent to the server. At this stage, the device collects emotional information such as the user's facial expression and tone of voice.

[0260] Step 2:

[0261] The server receives the company number "12345" sent from the device, and also receives the user's emotion data from the device at the same time.

[0262] Step 3:

[0263] The server accesses the database and searches for past requests related to the company number "12345." For example, it extracts information on "Project A" and "Project B."

[0264] Step 4:

[0265] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[0266] Step 5:

[0267] The server extracts information about "Project A" and "Project B" and embeds it into a template. Data is inserted into the required fields of each quotation and application form, and they are automatically generated.

[0268] Step 6:

[0269] The server saves the generated quotation and application form in PDF format. The file names are "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[0270] Step 7:

[0271] The server analyzes the received user emotion data using an emotion engine. For example, it recognizes that the user is feeling "anxiety."

[0272] Step 8:

[0273] The server tailors quotes and applications based on the emotion it detects, including special discounts and additional support information if the customer is feeling "anxious."

[0274] Step 9:

[0275] The server loads an email template to be sent to the customer, which already contains a greeting and a summary of the request.

[0276] Step 10:

[0277] The server then adjusts the tone and content of the email based on the results of the sentiment analysis, adding, for example, "If you have any concerns, please feel free to contact us."

[0278] Step 11:

[0279] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[0280] Step 12:

[0281] The user receives a confirmation message at the terminal confirming that the email was successfully sent to the customer, and the confirmation message sent to the terminal also includes a summary of the email sent and the elements that were adjusted.

[0282] Example 2

[0283] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0284] Conventional customer support systems have difficulty in providing quick and personalized responses to repeated requests from customers, making it difficult to improve customer satisfaction. Furthermore, they are unable to respond in a way that takes into account the user's emotions, resulting in insufficient support for dissatisfied or stressed customers.

[0285] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0286] In this invention, the server

[0287] a terminal for inputting customer specific information;

[0288] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[0289] A means for automatically generating estimates and application forms using the extracted past request information;

[0290] A means to save the generated estimate and application form in PDF format,

[0291] An email sending method to automatically send the generated PDF file to the customer,

[0292] A means for collecting and analyzing user emotion information;

[0293] means for adjusting the contents of the quotation and application form based on the result of the user's sentiment analysis;

[0294] a means for adjusting the email body based on the sentiment analysis results;

[0295] This allows for a fast, personalized response and a response that takes into account the user's emotions.

[0296] The "terminal for inputting specific customer information" is a device that allows a customer to input specific information (for example, a company number) and has the function of transmitting that information to the server.

[0297] "Specific information" refers to information that identifies a customer, such as a company number or customer ID.

[0298] A "database" is an information repository for storing and searching past requests and customer information.

[0299] "Past requests" refers to information about requests previously made by a customer, including the request content, date and time, etc.

[0300] "Quotation and Application Form" means a document required for price quotation and contract to be provided to a Customer.

[0301] "Means for automatic generation" refers to the process of automatically creating estimates and application forms using programs or software.

[0302] "Means for saving in PDF format" refers to a method for saving the generated estimate and application form in PDF format, which is a type of electronic file format.

[0303] The "email sending means" is a function for automatically sending an email containing the generated PDF file to the customer.

[0304] "Emotion information" is data related to emotions collected through the user's facial expressions, tone of voice, etc.

[0305] "Means of analysis" refers to the algorithms and engines that analyze the collected emotional information and understand its content.

[0306] "Sentiment analysis results" are the results of analyzed emotional information, based on which the system's behavior is adjusted.

[0307] "Means for tailoring email content" refers to the process of changing the content and tone of an email based on the results of user sentiment analysis.

[0308] The present invention combines an emotion engine with a system that quickly and individually processes past requests based on repeated customer requests, and automates the creation and email sending of estimates and application forms, thereby realizing responses based on user emotion recognition. Specific embodiments are described below.

[0309] 1. Enter and submit customer information

[0310] The user enters the company number into the input form on the device and clicks the "Send" button. The device is equipped with a user interface that can accurately transmit the data entered by the user to the server. At that time, the device collects the user's facial expressions and tone of voice along with the company number using a camera and microphone, and also transmits emotional data to the server.

[0311] 2. Submitting the company number and searching the database

[0312] The server receives the company number sent from the terminal. The server then accesses the MySQL database and searches for past requests based on the company number. For example, if the company number "12345" is entered, the server will extract information on "Project A" and "Project B" from the database.

[0313] 3. Automatic generation of quotes and application forms

[0314] The server retrieves quotation and application form templates using the Google® Docs API. Next, it automatically embeds the extracted past request information into the template and generates the quotation and application form in PDF format. The generated files are saved as, for example, "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[0315] 4. Emotion recognition and content regulation

[0316] The server receives the emotion data submitted by the user and analyzes it with an emotion engine such as IBM Watson® Tone Analyzer. Based on the results, the server can adjust the content of the quote and application form. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[0317] 5. Automated email sending

[0318] The server generates the email body using an email template. The tone and content of the email are adjusted based on the emotion engine's recognition results. For example, if the user is feeling stressed, the email body can include words of comfort. The generated email and PDF file are attached and automatically sent to the customer's email address using an SMTP server (e.g., SendGrid).

[0319] Specific examples

[0320] 1. User operations

[0321] The user enters the company number "12345" into the input form on the device and clicks the send button. The device then uses the camera and microphone to collect the user's facial expressions and tone of voice, and sends them to the server as emotional data.

[0322] 2. Server data search

[0323] The server extracts from the database the past requests "Project A" and "Project B" that correspond to the company number "12345."

[0324] 3. Generate quotes and application forms

[0325] The server embeds the information for "Project A" into the quotation template and generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and generates "Application_12345_ProjectB.pdf".

[0326] 4. Emotional Recognition and Regulation

[0327] The emotion engine recognizes the user's emotions and adds a discount offer to the quote if they are dissatisfied, and includes polite language in the email body.

[0328] 5. Automated email sending

[0329] The server generates the email body, adjusts the content based on the sentiment, and then attaches "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf" and sends the email to "customer12345@domain.com".

[0330] Prompt Sentence Examples

[0331] "Extract past requests from company number 12345 and generate quotes and application forms. Add appropriate content based on user sentiment."

[0332] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[0333] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0334] Step 1:

[0335] The user enters the company number into the input form on the terminal and clicks the "Submit" button.

[0336] Input: Company number (e.g. "12345")

[0337] Output: Request with company number sent to server

[0338] Specific operation: The user enters the company number "12345", and the terminal generates an HTTP request to send the company number to the server.

[0339] Step 2:

[0340] The device sends the company number to the server, and at the same time, collects the user's facial expressions and tone of voice and sends emotional data to the server.

[0341] Input: Company number, user facial expression data, voice data

[0342] Output: A request with company number and emotion data sent to the server

[0343] Specific operation: The device sends the company number "12345" and the emotion data collected using the camera and microphone to the server as an HTTP request.

[0344] Step 3:

[0345] The server receives the company number and accesses the database to search and extract past requests.

[0346] Input: Company Number

[0347] Output: Data of past requests (e.g. "Project A" and "Project B")

[0348] Specific operation: The server extracts the company number "12345" from the HTTP request and queries the MySQL database to retrieve past requests "Project A" and "Project B."

[0349] Step 4:

[0350] The server retrieves quotation and application form templates, embeds the extracted request information, and automatically generates them in PDF format.

[0351] Input: Data of past request cases ("Case A" and "Case B")

[0352] Output: PDF file (quote and application form)

[0353] Specific operation: The server retrieves the template using the Google Docs API, fills in the project details, and generates "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0354] Step 5:

[0355] The server analyzes the received emotion data and adjusts the contents of the estimate and application form.

[0356] Input: Emotion data, PDF files (quote and application form)

[0357] Output: Adjusted PDF file

[0358] What it does: The server analyzes the emotion data with IBM Watson Tone Analyzer, and if dissatisfaction is detected, it adds a special discount to the quote and regenerates the PDF file.

[0359] Step 6:

[0360] The server generates the email body using an email template, adjusts it based on the results of sentiment analysis, and automatically sends the adjusted email body and PDF file to the customer.

[0361] Input: Modified PDF file, emotion data

[0362] Output: Sent email (PDF file attached)

[0363] What happens: The server retrieves the email template, adjusts the content and tone based on the sentiment analysis, and sends the email to "customer12345@domain.com" using the SMTP server.

[0364] This allows the user to input specific information, and the system automatically processes and adjusts past requests, and then efficiently completes the entire process, from sending the generated document as a PDF file to the customer.

[0365] (Application example 2)

[0366] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0367] While the conventional system was functionally capable of automatically generating and sending estimates and application forms to customers, it was unable to provide individualized responses that took into account the customer's emotions. This limited its ability to improve customer satisfaction and service quality. Furthermore, even when a customer was feeling stressed or dissatisfied, the system would send similar documents or emails without noticing their emotions, which created an issue where it was not possible to improve the customer experience.

[0368] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting specific information about the customer, means for extracting past requests from a database based on the specific information transmitted from the terminal, means for automatically generating an estimate and an application form using the extracted information about the past requests, means for saving the generated estimate and application form in PDF format, email sending means for automatically sending the generated PDF file to the customer, emotion analysis means for collecting and analyzing user emotion data, means for adjusting the content of the estimate and application form based on the emotion analysis results, and means for adjusting the tone of the email body based on the emotion analysis results. This enables individualized responses that take customer emotions into consideration, thereby increasing customer satisfaction and improving service quality.

[0369] The "terminal for inputting customer specific information" is an electronic device for the customer to input specific information such as a company number.

[0370] The "means for extracting past requests from a database" is a method for reading relevant data from a database that records previous transaction information and request details based on specific information about the customer.

[0371] The "means for automatically generating estimates and application forms" is a function for automatically creating estimates and application forms based on the extracted past request information.

[0372] "Means of saving in PDF format" refers to a method of saving the generated estimate or application form as a PDF file, which is an electronic document format.

[0373] "An email sending method for automatically sending PDF files to customers" is a function that automatically sends saved PDF files to customers via email.

[0374] The "emotion analysis means" is a system that analyzes a user's emotions based on the user's input data and the device's sensor information.

[0375] The "means for adjusting the contents of the estimate and application form based on the results of the emotion analysis" is a function for changing and adjusting the contents of the estimate and application form based on the analyzed emotion data.

[0376] "Means for adjusting the tone of the email body based on the results of sentiment analysis" refers to a function that changes or adjusts the tone and content of an email based on the results obtained from sentiment analysis.

[0377] This invention combines a sentiment analysis engine with a system that quickly processes past requests based on repeated customer requests and automates the creation and email sending of estimates and application forms, thereby enabling responses based on user emotion recognition.

[0378] System Configuration

[0379] Hardware and Software

[0380] 1. Device:

[0381] A device used to input customer-specific information. Generally, it is assumed to be an electronic device such as a PC, smartphone, or tablet.

[0382] 2. Server:

[0383] It is a high-performance computer that performs various functions such as databases, emotion recognition, document generation, and email sending.

[0384] The software used includes a Python program, smtplib (an email sending function), FPDF (a PDF generation library), and a sentiment analysis module.

[0385] Data processing and calculation

[0386] 1. Enter and submit customer information:

[0387] The user enters specific information such as a company number into an input form on the terminal, and the entered information is sent to the server.

[0388] 2. Extraction of past requests:

[0389] The server extracts the relevant past request information from the database based on the specific information received from the terminal.

[0390] 3. Generate quotes and applications:

[0391] The server automatically generates estimates and application forms by embedding the extracted request information into templates, and the generated documents are saved in PDF format.

[0392] 4. Recognizing and responding to emotions:

[0393] When a user inputs specific information, the device collects the user's emotional data (such as facial expressions and tone of voice) and sends it to the server, where the server's emotion analysis engine analyzes the data and evaluates the user's emotions.

[0394] 5. Adjusting documents and email content:

[0395] Based on the results of emotion recognition, quotes and application forms can be tailored—for example, a special discount can be added if the user is feeling stressed—and emails can also be tailored in tone and content based on the user's emotion.

[0396] 6. Automated emails:

[0397] The adjusted quote and application PDF files are automatically sent to the customer's email address along with a personalized email message, improving customer satisfaction through personalized service.

[0398] Specific examples

[0399] The user enters the company number "12345" into the input form and submits it. At this time, the device collects data on the user's facial expressions and tone of voice.

[0400] The server extracts information on past request cases "Case A" and "Case B" that correspond to the company number "12345" from the database.

[0401] The server automatically generates an estimate for "Project A" and an application form for "Project B" based on the template, and saves them as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf", respectively.

[0402] The emotion engine recognizes the user's emotions (e.g., dissatisfaction) and adds special discount offers to the quote.

[0403] The server generates the email body, adjusts the content based on the sentiment, and automatically sends it to "customer name@domain.com" with PDF files of the quotation and application form attached.

[0404] Prompt Sentence Examples

[0405] My company (Company ID: 12345) has done some business with you in the past. We are currently experiencing issues with late payments for the most recent transaction. We would like to resolve this issue as soon as possible. Please generate a quote and application form to address this issue and send them along with relevant emails.

[0406] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0407] Step 1:

[0408] The user enters specific information (such as a company number) into an input form on the device and submits it. The device collects the input data along with emotional data such as the user's facial expression and tone of voice. This data is then sent to the server, which measures the user's emotional state.

[0409] Step 2:

[0410] The server searches the database based on the specific information received from the terminal. Specifically, it uses the company number as a key to extract past requests (e.g., "Project A" and "Project B"). This retrieves the details of transactions the user has made in the past.

[0411] Step 3:

[0412] The server automatically generates an estimate and application form based on the extracted request information. It embeds the relevant information into a template and creates the estimate and application form. This generates PDF files such as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[0413] Step 4:

[0414] The server saves the generated PDF files of the quote and application form, making the documents available for future reference.

[0415] Step 5:

[0416] The server receives the emotion data sent from the device and analyzes the emotion using an emotion analysis engine. Specifically, it determines whether the user is feeling dissatisfied, stressed, happy, etc. This allows the server to recognize the user's current emotional state.

[0417] Step 6:

[0418] The server adjusts quote and application forms based on the results of sentiment analysis, for example adding a special discount to a quote if the user is dissatisfied, resulting in documents that are personalized to the customer.

[0419] Step 7:

[0420] The server generates the email body based on the results of the sentiment analysis. Based on a template, the tone and content are adjusted according to the emotion. For example, if the user is feeling stressed, comforting words are included. This process creates an email body that takes the user's emotions into consideration.

[0421] Step 8:

[0422] The server automatically sends the generated quote and application form PDF files to the customer's email address along with the adjusted email body, providing users with fast and considerate service.

[0423] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0424] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0425] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0426] [Second embodiment]

[0427] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0428] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0429] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0430] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0431] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0432] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0433] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0434] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0435] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0436] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0437] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0438] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0439] This invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. In this system, the server searches the database, generates documents, and sends emails based on the company number entered by the user on the terminal. The system's program processing is described in detail below.

[0440] Program processing overview

[0441] Enter and submit customer information

[0442] The user enters the company number into the input form on the terminal. After that, when the user clicks the "Send" button, the company number is sent to the server. The data sent from the terminal to the server may include user authentication information in addition to the company number.

[0443] Extraction of past requests

[0444] The server receives the company number sent from the terminal and accesses the database. It searches the database for past request information corresponding to this company number and extracts the relevant data. For example, for company number "12345," information on "Project A" and "Project B" is extracted from the database.

[0445] Creating quotes and application forms

[0446] The server automatically generates estimates and application forms based on the extracted information on past requests. Specifically, it embeds the necessary data into estimate and application form templates. The templates contain information such as the customer name, project name, request details, and price information, and this information is automatically inserted based on the extracted data. This generates estimates and application forms that are personalized for each customer.

[0447] Save as PDF

[0448] The generated estimates and application forms are saved in PDF format. The server saves these PDF files in a specific folder, and the file name is given the company number or project name. For example, they might be named "Estimate_12345_ProjectA.pdf" or "Application_12345_ProjectB.pdf."

[0449] Automatic email sending

[0450] The server automatically generates the email body to be sent to the customer from a template. The template includes a greeting and a summary of the request, and is customized based on the extracted customer information. The generated email body and the aforementioned PDF file are attached and automatically sent to the customer's email address. For example, an email with the subject "Information about the quotation and application form" is sent to "Customer name@domain.com."

[0451] Specific examples

[0452] The specific processing flow is shown below.

[0453] 1. Enter and submit customer information

[0454] The user enters the company number "12345" into the input form on the terminal and clicks the send button.

[0455] 2. Extraction of past requests

[0456] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[0457] 3. Creating a quote and application form

[0458] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[0459] Fill in the information for "Project B" into the application form template and automatically generate the application form.

[0460] 4. Save as PDF

[0461] The server saves the generated quotation and application form as "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0462] 5. Automated email sending

[0463] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[0464] As described above, the present invention makes it possible to improve the efficiency and accuracy of business operations and to improve the quality of customer service.

[0465] The processing flow will be explained below.

[0466] Step 1:

[0467] The user enters the company number "12345" into the input form on the terminal, then clicks the send button, and the entered company number is sent to the server.

[0468] Step 2:

[0469] The server receives the company number "12345" sent from the terminal. After receiving it, the server uses this company number to access the database.

[0470] Step 3:

[0471] The server searches the database for past requests that match the company number "12345." For example, it extracts information on "Project A" and "Project B."

[0472] Step 4:

[0473] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[0474] Step 5:

[0475] The server extracts the information for "Project A" and "Project B" and embeds it into the template. Individual estimates and application forms are generated, with the necessary information accurately inserted.

[0476] Step 6:

[0477] The server saves the generated quotation and application form in PDF format. The file names will be "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[0478] Step 7:

[0479] The server loads an email template to send to the customer, which includes a greeting and a summary of the request.

[0480] Step 8:

[0481] The server automatically inserts necessary information such as the customer name and request details into the email template and generates the email body. The specific content is adapted to the customer.

[0482] Step 9:

[0483] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[0484] Step 10:

[0485] The user receives a confirmation message on their device confirming that the email was successfully sent to the customer.

[0486] Example 1

[0487] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0488] In conventional systems, creating quotes and application forms in response to repeated requests from customers is done manually, which is time-consuming and labor-intensive. It is also difficult to efficiently extract information about past requests, which increases the risk of manual input errors and omissions. Furthermore, the process of sending generated documents to customers is inefficient, and email transmission is cumbersome. To solve these problems, it is necessary to quickly extract information about past requests, accurately create automatically generated documents, and automate email transmission.

[0489] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0490] In this invention, the server includes a terminal for inputting customer identification information, means for extracting past requests from a database based on the identification information transmitted from the terminal, means for automatically generating a document using the extracted past request information, means for saving the generated document in PDF format, and means for automatically transmitting the generated PDF file to the customer by email. This enables the rapid and accurate extraction of past request information, the automatic generation of estimates and application forms, and the automation of email transmission.

[0491] "Customer" refers to the party that makes a request or places an order with a company or individual that provides a service or product.

[0492] "Identification information" refers to data such as numbers or codes that uniquely identify a particular customer.

[0493] "Terminal" refers to the device (such as a PC, tablet, or smartphone) that a user uses to enter information and communicate with the system.

[0494] A "database" is a system for systematically storing information and quickly and efficiently extracting data based on specific queries.

[0495] "Request" refers to an order or request made by a customer to a company or individual providing a service or product.

[0496] "Document" refers to documents or written documents that organize and describe information (e.g., estimates, application forms, etc.).

[0497] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing, displaying, and printing documents.

[0498] "Email delivery method" refers to the software or process used to create and send email.

[0499] A "template" refers to a document model that has a specific format and structure predefined.

[0500] "Filling" refers to the process of adding appropriate data to placeholders in a template.

[0501] "Personalization" refers to customizing the content of documents and emails based on specific customer information.

[0502] The present invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. Specific embodiments for carrying out the present invention are described below.

[0503] Hardware and software used

[0504] Hardware: Servers, user devices (PCs, tablets, smartphones, etc.)

[0505] Software: Database management system (e.g., MySQL), PDF generation library (e.g., Apache PDFBox), email sending library (e.g., JavaMail)

[0506] Enter and submit customer information

[0507] The user enters the company number into the input form on the terminal and clicks the "Submit" button. This operation causes the terminal to send the company number and user authentication information to the server. An HTTP POST request is used to send data from the terminal to the server.

[0508] Extraction of past requests

[0509] The server accesses the database based on the received company number and searches for past order information related to that company number. The server executes an SQL query using a database management system (e.g., MySQL). For example, it issues a query such as "SELECT FROM orders WHERE company_number = '12345'".

[0510] Creating quotes and application forms

[0511] The server creates estimates and application forms based on past request information. At this time, it reads estimate and application form templates (e.g., template file estimate_template.docx) and embeds the necessary information into the template. During the embedding process, the appropriate data is inserted into placeholders by a program.

[0512] Save as PDF

[0513] The generated quotation and application forms are converted to PDF format. The server uses the Apache PDFBox library to convert the document files to PDF format and saves them in a specific folder (e.g., / var / docs / ). The saved files are assigned the company number and project name (e.g., "Quotation_12345_ProjectA.pdf").

[0514] Automatic email sending

[0515] The server automatically generates the email body from the template, attaches the generated quotation and application form PDF files, and sends them to the customer. The JavaMail library is used to send the email. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[0516] Specific examples

[0517] The specific processing flow is shown below.

[0518] 1. Enter and submit customer information

[0519] The user enters the company number "12345" into the input form on the terminal and clicks the "Submit" button.

[0520] 2. Extraction of past requests

[0521] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[0522] 3. Creating a quote and application form

[0523] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[0524] The server embeds the information for "Project B" into the application form template and automatically generates the application form.

[0525] 4. Save as PDF

[0526] The server saves the generated quotation and application form as "Quotation_12345_CaseA.pdf" and "Application_12345_CaseB.pdf".

[0527] 5. Automated email sending

[0528] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[0529] Prompt Sentence Examples

[0530] Below are some examples of prompts related to this system:

[0531] I entered the company number "12345". Please search past requests, generate quotes and application forms, and send them by email.

[0532] In this way, by entering the company number, users can quickly and accurately generate quotations and application forms based on past requests and automatically send them to customers. This system improves work efficiency and accuracy.

[0533] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0534] Program processing flow

[0535] Step 1: Enter and submit customer information

[0536] Specific explanation

[0537] 1.1. The user enters the company number into the input form on the terminal. For example, enter the company number "12345".

[0538] 1.2. When the user clicks the "Submit" button, JavaScript on the terminal constructs form data and sends the company number and user authentication information to the server as an HTTP POST request.

[0539] input

[0540] Company number (e.g. 12345)

[0541] User authentication information (e.g., user ID, password)

[0542] output

[0543] Company number and user authentication information sent to the server

[0544] Step 2: Extract past requests

[0545] Specific explanation

[0546] 2.1. The server receives the company number. For example, the company number "12345" is received.

[0547] The server queries the database to find past orders based on the company number, for example by executing the SQL query "SELECT FROM orders WHERE company_number = '12345'".

[0548] 2.3. The server extracts the relevant data and stores it in memory. For example, it extracts information on "Project A" and "Project B" corresponding to company number "12345."

[0549] input

[0550] Company number (e.g. 12345)

[0551] User Credentials

[0552] output

[0553] Extracted request information (e.g., Case A, Case B)

[0554] Step 3: Create a quote and application

[0555] Specific explanation

[0556] The server loads the quotation and application form templates. For example, it loads the quotation template file "quote_template.docx."

[0557] 3.2. The server embeds the extracted data into a template and generates a document. For example, it embeds the data for "Project A" into the placeholder in the quotation template.

[0558] The server converts the generated document to PDF format. For example, it saves the generated quotation as "Quotation_12345_ProjectA.pdf".

[0559] input

[0560] Extracted request information (e.g., Case A, Case B)

[0561] Document template files

[0562] output

[0563] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0564] Step 4: Save as PDF

[0565] Specific explanation

[0566] 4.1. The server accesses a specific folder to save the generated PDF file, for example, the folder " / var / docs / ".

[0567] 4.2. The server saves the generated PDF file in a specific folder. The file name is given the company number and project name. For example, it is saved as "Quotation_12345_ProjectA.pdf".

[0568] input

[0569] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0570] output

[0571] PDF files saved in a folder

[0572] Step 5: Automated email sending

[0573] Specific explanation

[0574] The server loads the template file for sending email, for example, the email template file "email_template.html".

[0575] 5.2. The server generates the email body based on the template and embeds the extracted information.

[0576] The server attaches the generated PDF file to an email and sends it to the customer's email address. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[0577] input

[0578] Email template file

[0579] Customer email address (e.g. customername@domain.com)

[0580] Attached PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0581] output

[0582] Emails sent to customers

[0583] In this way, specific data processing and data calculations are performed at each processing step, and the overall system flow functions in coordination to respond to customer requests.

[0584] (Application example 1)

[0585] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0586] In conventional logistics centers, employees often manually input specific information and proceed with their work while checking paper-based instructions. This reduces work efficiency and increases the risk of input and confirmation errors. Furthermore, there is a lack of efficient ways to utilize past request data, which can sometimes prevent optimal work instructions from being provided. Therefore, there is a need for a system that utilizes voice input to provide optimal work instructions in real time.

[0587] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0588] In this invention, the server includes a means including a smart device that accepts customer specific information by voice input, a means for presenting work instructions in real time using voice guidance, and a means for automatically generating estimates and application forms using extracted past request information. This allows employees to efficiently input specific information using voice input, and enables them to proceed with work quickly and accurately thanks to real-time voice guidance.

[0589] "Customer specific information" is unique information for identifying a specific customer, such as a customer number or company number.

[0590] A "terminal" is an electronic device used to input customer information, such as a smartphone or tablet.

[0591] A "database" is an information management system for storing information on past requests and customer information.

[0592] "Quotation and application form" means a document that details the price and contract contents of the services or products to be provided to the customer.

[0593] "PDF format" is an abbreviation for Portable Document Format, a general-purpose file format for saving electronic documents.

[0594] "Email sending means" is a function for automatically creating and sending emails.

[0595] A "smart device" is an electronic device that allows voice input, such as smart glasses or a smart speaker.

[0596] "Voice guidance" is a function that conveys information and instructions to users by voice.

[0597] "Real-time" means processing and providing information immediately in the current time.

[0598] This invention realizes a system that improves work efficiency in a logistics center by using voice input and real-time work instructions. The system is composed of the following elements:

[0599] 1. Enter customer information

[0600] The user uses a smart device, specifically smart glasses, to input information by voice. By inputting the customer's customer number, which is the customer's specific information, and issuing a transmission command, the information is sent to the server. The smart glasses have a voice input function and a display that the user can see.

[0601] 2. Extraction of past requests

[0602] The server extracts past requests from the database based on the received customer number. At this stage, all past request data related to the relevant customer is extracted at high speed.

[0603] 3. Generate work instructions

[0604] The server automatically generates work instructions by embedding the necessary information in a template based on the extracted past request information. These work instructions are documents containing detailed information such as a cargo list and work procedures, and are saved in PDF format on the server.

[0605] 4. Real-time work instructions

[0606] The server sends the generated work instructions to the smart glasses in real time, and provides voice reminders and display information to the user, allowing the user to receive instructions both visually and audibly, reducing errors and enabling efficient work.

[0607] Examples of hardware and software used

[0608] Smart glasses (devices with voice input and display capabilities)

[0609] Server (running the database management system)

[0610] Software (automatic work instruction generation, template auto-filling, real-time voice and display control software)

[0611] Specific examples

[0612] When a logistics center employee receives a new order, they voice-input "customer number 12345" into the smart glasses. The server then extracts past order data from the database and automatically generates work instructions based on that data. The generated instructions are sent to the smart glasses in real time and are read aloud and displayed on the screen, providing employees with quick and accurate instructions.

[0613] Example prompts for generative AI models

[0614] Please create a program that generates loading instructions based on past logistics requests for customer number 12345 and displays them on the smart glasses of logistics center employees. Please include voice input and real-time display, or voice reading functionality.

[0615] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0616] Step 1:

[0617] Using the voice input function of the device (smart glasses), the user voice-inputs "Customer number 12345." This voice data is converted into text data and sent to the server as specific information. The input data is the customer number, and the output is the transmission of the specific information to the server.

[0618] Step 2:

[0619] The server accesses the database based on the received specific information (customer number 12345). It performs a database search and extracts past request information related to the corresponding customer number. The input data is the customer number, and the output is past request information. The server executes the database query and obtains the results.

[0620] Step 3:

[0621] The server uses the extracted information about past requests to automatically fill in the necessary information in the quotation and application form templates. Specifically, it inserts the customer name, project name, request details, price information, etc. into the template. The input data is the past request information, and the output is the automatically generated quotation and application form. The server uses a template engine.

[0622] Step 4:

[0623] The server saves the generated quotations and application forms in PDF format. The saved PDF files are stored in a specific folder, and the company number and project name are added to the file name. The input data is the quotation and application form data, and the output is a PDF file. The server uses a PDF generation library.

[0624] Step 5:

[0625] The server automatically generates the body of the email to be sent to the customer from a template based on the PDF file. The template includes a greeting and a summary of the request, and is customized based on the customer information. The input data is the customer information and the PDF file, and the output is the automatically generated email body. The server uses an email template engine.

[0626] Step 6:

[0627] The server attaches the generated email body and PDF file and automatically sends it to the customer's email address. The input data is the email body and PDF file, and the output is the sent email. The server uses an email sending library.

[0628] Step 7:

[0629] The server also transmits the generated work instructions to the smart device (smart glasses) in real time, and simultaneously provides voice guidance and display information to the user. The input data is the work instructions, and the output is voice guidance and display information. The server uses a speech synthesis engine and display control software.

[0630] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0631] This invention combines an emotion engine with a system that quickly processes past requests based on repeated customer requests and automates the creation of estimates and application forms and the sending of emails, thereby realizing responses based on the recognition of user emotions.In this invention, the server performs database searches, document generation, emotion recognition, and email sending based on the company number entered by the user on a terminal.

[0632] Program processing overview

[0633] Enter and submit customer information

[0634] The user enters the company number into the input form on the terminal and clicks the "Send" button, which sends the company number to the server. In this step, the interface installed on the terminal accurately sends the data entered by the user to the server.

[0635] Extraction of past requests

[0636] The server receives the company number sent from the terminal and accesses the database to search for past requests. For example, for company number "12345," it extracts information on "Project A" and "Project B."

[0637] Creating quotes and application forms

[0638] The server automatically generates quotes and application forms based on the templates, embedding the extracted information about past requests into the templates, thereby creating documents that are personalized for each customer.

[0639] Save as PDF

[0640] The server saves the automatically generated quotation and application form in PDF format. The generated files are named "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0641] Recognizing and Responding to Emotions

[0642] When a user enters and submits a company number, the terminal collects the user's emotional information and sends it to the server. The emotion engine analyzes this data and recognizes the user's emotion. Based on the recognized emotion, the server adjusts the content of the quote and application form. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[0643] Automatic email sending

[0644] The server generates the email body using an email template, and adjusts the tone and content of the email based on the user's emotions as recognized by the emotion engine. For example, if the user is feeling stressed, the email body can include words of comfort.

[0645] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the customer's email address. This procedure enables personalized responses and improves customer satisfaction.

[0646] Specific examples

[0647] 1. User operations

[0648] When a user enters the company number "12345" into the input form on the device and submits it, the device collects the user's facial expression and tone of voice as emotional data.

[0649] 2. Server data search

[0650] The server extracts from the database the past request cases "Case A" and "Case B" that correspond to the company number "12345".

[0651] 3. Generate quotes and application forms

[0652] The server embeds the information for "Project A" into the quotation template and automatically generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and automatically generates "Application_12345_ProjectB.pdf".

[0653] 4. Emotional Recognition and Regulation

[0654] The emotion engine recognizes the user's emotions and adjusts the quote content and email body accordingly. For example, if the user is unhappy, it will include polite language along with a discount offer.

[0655] 5. Automated email sending

[0656] The server generates the email body, adjusts it based on the sentiment, and automatically sends it to "customer name@domain.com" with the quote and application form PDF attached.

[0657] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[0658] The processing flow will be explained below.

[0659] Step 1:

[0660] The user enters the company number "12345" into the input form on the device. Then, they click the send button, and the company number is sent to the server. At this stage, the device collects emotional information such as the user's facial expression and tone of voice.

[0661] Step 2:

[0662] The server receives the company number "12345" sent from the device, and also receives the user's emotion data from the device at the same time.

[0663] Step 3:

[0664] The server accesses the database and searches for past requests related to the company number "12345." For example, it extracts information on "Project A" and "Project B."

[0665] Step 4:

[0666] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[0667] Step 5:

[0668] The server extracts information about "Project A" and "Project B" and embeds it into a template. Data is inserted into the required fields of each quotation and application form, and they are automatically generated.

[0669] Step 6:

[0670] The server saves the generated quotation and application form in PDF format. The file names are "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[0671] Step 7:

[0672] The server analyzes the received user emotion data using an emotion engine. For example, it recognizes that the user is feeling "anxiety."

[0673] Step 8:

[0674] The server tailors quotes and applications based on the emotion it detects, including special discounts and additional support information if the customer is feeling "anxious."

[0675] Step 9:

[0676] The server loads an email template to be sent to the customer, which already contains a greeting and a summary of the request.

[0677] Step 10:

[0678] The server then adjusts the tone and content of the email based on the results of the sentiment analysis, adding, for example, "If you have any concerns, please feel free to contact us."

[0679] Step 11:

[0680] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[0681] Step 12:

[0682] The user receives a confirmation message at the terminal confirming that the email was successfully sent to the customer, and the confirmation message sent to the terminal also includes a summary of the email sent and the elements that were adjusted.

[0683] Example 2

[0684] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0685] Conventional customer support systems have difficulty in providing quick and personalized responses to repeated requests from customers, making it difficult to improve customer satisfaction. Furthermore, they are unable to respond in a way that takes into account the user's emotions, resulting in insufficient support for dissatisfied or stressed customers.

[0686] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0687] In this invention, the server

[0688] a terminal for inputting customer specific information;

[0689] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[0690] A means for automatically generating estimates and application forms using the extracted past request information;

[0691] A means to save the generated estimate and application form in PDF format,

[0692] An email sending method to automatically send the generated PDF file to the customer,

[0693] A means for collecting and analyzing user emotion information;

[0694] means for adjusting the contents of the quotation and application form based on the result of the user's sentiment analysis;

[0695] a means for adjusting the email body based on the sentiment analysis results;

[0696] This allows for a fast, personalized response and a response that takes into account the user's emotions.

[0697] The "terminal for inputting specific customer information" is a device that allows a customer to input specific information (for example, a company number) and has the function of transmitting that information to the server.

[0698] "Specific information" refers to information that identifies a customer, such as a company number or customer ID.

[0699] A "database" is an information repository for storing and searching past requests and customer information.

[0700] "Past requests" refers to information about requests previously made by a customer, including the request content, date and time, etc.

[0701] "Quotation and Application Form" means a document required for price quotation and contract to be provided to a Customer.

[0702] "Means for automatic generation" refers to the process of automatically creating estimates and application forms using programs or software.

[0703] "Means for saving in PDF format" refers to a method for saving the generated estimate and application form in PDF format, which is a type of electronic file format.

[0704] The "email sending means" is a function for automatically sending an email containing the generated PDF file to the customer.

[0705] "Emotion information" is data related to emotions collected through the user's facial expressions, tone of voice, etc.

[0706] "Means of analysis" refers to the algorithms and engines that analyze the collected emotional information and understand its content.

[0707] "Sentiment analysis results" are the results of analyzed emotional information, based on which the system's behavior is adjusted.

[0708] "Means for tailoring email content" refers to the process of changing the content and tone of an email based on the results of user sentiment analysis.

[0709] The present invention combines an emotion engine with a system that quickly and individually processes past requests based on repeated customer requests, and automates the creation and email sending of estimates and application forms, thereby realizing responses based on user emotion recognition. Specific embodiments are described below.

[0710] 1. Enter and submit customer information

[0711] The user enters the company number into the input form on the device and clicks the "Send" button. The device is equipped with a user interface that can accurately transmit the data entered by the user to the server. At that time, the device collects the user's facial expressions and tone of voice along with the company number using a camera and microphone, and also transmits emotional data to the server.

[0712] 2. Submitting the company number and searching the database

[0713] The server receives the company number sent from the terminal. The server then accesses the MySQL database and searches for past requests based on the company number. For example, if the company number "12345" is entered, the server will extract information on "Project A" and "Project B" from the database.

[0714] 3. Automatic generation of quotes and application forms

[0715] The server retrieves quotation and application form templates using the Google Docs API. Next, it automatically embeds the extracted past request information into the template and generates the quotation and application form in PDF format. The generated files are saved as, for example, "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[0716] 4. Emotion recognition and content regulation

[0717] The server receives the emotion data submitted by the user and analyzes it using an emotion engine such as IBM Watson Tone Analyzer. Based on the results, the server can adjust the content of quotes and applications. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[0718] 5. Automated email sending

[0719] The server generates the email body using an email template. The tone and content of the email are adjusted based on the emotion engine's recognition results. For example, if the user is feeling stressed, the email body can include words of comfort. The generated email and PDF file are attached and automatically sent to the customer's email address using an SMTP server (e.g., SendGrid).

[0720] Specific examples

[0721] 1. User operations

[0722] The user enters the company number "12345" into the input form on the device and clicks the send button. The device then uses the camera and microphone to collect the user's facial expressions and tone of voice, and sends them to the server as emotional data.

[0723] 2. Server data search

[0724] The server extracts from the database the past requests "Project A" and "Project B" that correspond to the company number "12345."

[0725] 3. Generate quotes and application forms

[0726] The server embeds the information for "Project A" into the quotation template and generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and generates "Application_12345_ProjectB.pdf".

[0727] 4. Emotional Recognition and Regulation

[0728] The emotion engine recognizes the user's emotions and adds a discount offer to the quote if they are dissatisfied, and includes polite language in the email body.

[0729] 5. Automated email sending

[0730] The server generates the email body, adjusts the content based on the sentiment, and then attaches "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf" and sends the email to "customer12345@domain.com".

[0731] Prompt Sentence Examples

[0732] "Please extract past requests from company number 12345 and generate quotes and application forms. Please add appropriate content based on user sentiment."

[0733] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[0734] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0735] Step 1:

[0736] The user enters the company number into the input form on the terminal and clicks the "Submit" button.

[0737] Input: Company number (e.g. "12345")

[0738] Output: Request with company number sent to server

[0739] Specific operation: The user enters the company number "12345", and the terminal generates an HTTP request to send the company number to the server.

[0740] Step 2:

[0741] The device sends the company number to the server, and at the same time, collects the user's facial expressions and tone of voice and sends emotional data to the server.

[0742] Input: Company number, user facial expression data, voice data

[0743] Output: A request with company number and emotion data sent to the server

[0744] Specific operation: The device sends the company number "12345" and the emotion data collected using the camera and microphone to the server as an HTTP request.

[0745] Step 3:

[0746] The server receives the company number and accesses the database to search and extract past requests.

[0747] Input: Company Number

[0748] Output: Data of past requests (e.g. "Project A" and "Project B")

[0749] Specific operation: The server extracts the company number "12345" from the HTTP request and queries the MySQL database to retrieve past requests "Project A" and "Project B."

[0750] Step 4:

[0751] The server retrieves quotation and application form templates, embeds the extracted request information, and automatically generates them in PDF format.

[0752] Input: Data of past request cases ("Case A" and "Case B")

[0753] Output: PDF file (quote and application form)

[0754] Specific operation: The server retrieves the template using the Google Docs API, fills in the project details, and generates "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0755] Step 5:

[0756] The server analyzes the received emotion data and adjusts the contents of the estimate and application form.

[0757] Input: Emotion data, PDF files (quote and application form)

[0758] Output: Adjusted PDF file

[0759] What it does: The server analyzes the emotion data with IBM Watson Tone Analyzer, and if dissatisfaction is detected, it adds a special discount to the quote and regenerates the PDF file.

[0760] Step 6:

[0761] The server generates the email body using an email template, adjusts it based on the results of sentiment analysis, and automatically sends the adjusted email body and PDF file to the customer.

[0762] Input: Modified PDF file, emotion data

[0763] Output: Sent email (PDF file attached)

[0764] What happens: The server retrieves the email template, adjusts the content and tone based on the sentiment analysis, and sends the email to "customer12345@domain.com" using the SMTP server.

[0765] This allows the user to input specific information, and the system automatically processes and adjusts past requests, and then efficiently completes the entire process, from sending the generated document as a PDF file to the customer.

[0766] (Application example 2)

[0767] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0768] While the conventional system was functionally capable of automatically generating and sending estimates and application forms to customers, it was unable to provide individualized responses that took into account the customer's emotions. This limited its ability to improve customer satisfaction and service quality. Furthermore, even when a customer was feeling stressed or dissatisfied, the system would send similar documents or emails without noticing their emotions, which created an issue where it was not possible to improve the customer experience.

[0769] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting specific information about the customer, means for extracting past requests from a database based on the specific information transmitted from the terminal, means for automatically generating an estimate and an application form using the extracted information about the past requests, means for saving the generated estimate and application form in PDF format, email sending means for automatically sending the generated PDF file to the customer, emotion analysis means for collecting and analyzing user emotion data, means for adjusting the content of the estimate and application form based on the emotion analysis results, and means for adjusting the tone of the email body based on the emotion analysis results. This enables individualized responses that take customer emotions into consideration, thereby increasing customer satisfaction and improving service quality.

[0770] The "terminal for inputting customer specific information" is an electronic device for the customer to input specific information such as a company number.

[0771] The "means for extracting past requests from a database" is a method for reading relevant data from a database that records previous transaction information and request details based on specific information about the customer.

[0772] The "means for automatically generating estimates and application forms" is a function for automatically creating estimates and application forms based on the extracted past request information.

[0773] "Means of saving in PDF format" refers to a method of saving the generated estimate or application form as a PDF file, which is an electronic document format.

[0774] "An email sending method for automatically sending PDF files to customers" is a function that automatically sends saved PDF files to customers via email.

[0775] The "emotion analysis means" is a system that analyzes a user's emotions based on the user's input data and the device's sensor information.

[0776] The "means for adjusting the contents of the estimate and application form based on the results of the emotion analysis" is a function for changing and adjusting the contents of the estimate and application form based on the analyzed emotion data.

[0777] "Means for adjusting the tone of the email body based on the results of sentiment analysis" refers to a function that changes or adjusts the tone and content of an email based on the results obtained from sentiment analysis.

[0778] This invention combines a sentiment analysis engine with a system that quickly processes past requests based on repeated customer requests and automates the creation and email sending of estimates and application forms, thereby enabling responses based on user emotion recognition.

[0779] System Configuration

[0780] Hardware and Software

[0781] 1. Device:

[0782] A device used to input customer-specific information. Generally, it is assumed to be an electronic device such as a PC, smartphone, or tablet.

[0783] 2. Server:

[0784] It is a high-performance computer that performs various functions such as databases, emotion recognition, document generation, and email sending.

[0785] The software used includes a Python program, smtplib (an email sending function), FPDF (a PDF generation library), and a sentiment analysis module.

[0786] Data processing and calculation

[0787] 1. Enter and submit customer information:

[0788] The user enters specific information such as a company number into an input form on the terminal, and the entered information is sent to the server.

[0789] 2. Extraction of past requests:

[0790] The server extracts the relevant past request information from the database based on the specific information received from the terminal.

[0791] 3. Generate quotes and applications:

[0792] The server automatically generates estimates and application forms by embedding the extracted request information into templates, and the generated documents are saved in PDF format.

[0793] 4. Recognizing and responding to emotions:

[0794] When a user inputs specific information, the device collects the user's emotional data (such as facial expressions and tone of voice) and sends it to the server, where the server's emotion analysis engine analyzes the data and evaluates the user's emotions.

[0795] 5. Adjusting documents and email content:

[0796] Based on the results of emotion recognition, quotes and application forms can be tailored—for example, a special discount can be added if the user is feeling stressed—and emails can also be tailored in tone and content depending on the user's emotion.

[0797] 6. Automated emails:

[0798] The adjusted quote and application PDF files are automatically sent to the customer's email address along with a personalized email message, improving customer satisfaction through personalized service.

[0799] Specific examples

[0800] The user enters the company number "12345" into the input form and submits it. At this time, the device collects data on the user's facial expressions and tone of voice.

[0801] The server extracts information on past request cases "Case A" and "Case B" that correspond to the company number "12345" from the database.

[0802] The server automatically generates an estimate for "Project A" and an application form for "Project B" based on the template, and saves them as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf", respectively.

[0803] The emotion engine recognizes the user's emotions (e.g., dissatisfaction) and adds special discount offers to the quote.

[0804] The server generates the email body, adjusts the content based on the sentiment, and automatically sends it to "customer name@domain.com" with PDF files of the quotation and application form attached.

[0805] Prompt Sentence Examples

[0806] My company (Company ID: 12345) has done some business with you in the past. We are currently experiencing issues with late payments for the most recent transaction. We would like to resolve this issue as soon as possible. Please generate a quote and application form to address this issue and send them along with relevant emails.

[0807] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0808] Step 1:

[0809] The user enters specific information (such as a company number) into an input form on the device and submits it. The device collects the input data along with emotional data such as the user's facial expression and tone of voice. This data is then sent to the server, which measures the user's emotional state.

[0810] Step 2:

[0811] The server searches the database based on the specific information received from the terminal. Specifically, it uses the company number as a key to extract past requests (e.g., "Project A" and "Project B"). This retrieves the details of transactions the user has made in the past.

[0812] Step 3:

[0813] The server automatically generates an estimate and application form based on the extracted request information. It embeds the relevant information into a template and creates the estimate and application form. This generates PDF files such as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[0814] Step 4:

[0815] The server saves the generated PDF files of the quote and application form, making the documents available for future reference.

[0816] Step 5:

[0817] The server receives the emotion data sent from the device and analyzes the emotion using an emotion analysis engine. Specifically, it determines whether the user is feeling dissatisfied, stressed, happy, etc. This allows the server to recognize the user's current emotional state.

[0818] Step 6:

[0819] The server adjusts quote and application forms based on the results of sentiment analysis, for example adding a special discount to a quote if the user is dissatisfied, resulting in documents that are tailored to the customer.

[0820] Step 7:

[0821] The server generates the email body based on the results of the sentiment analysis. Based on a template, the tone and content are adjusted according to the emotion. For example, if the user is feeling stressed, comforting words are included. This process creates an email body that takes the user's emotions into consideration.

[0822] Step 8:

[0823] The server automatically sends the generated quote and application form PDF files to the customer's email address along with the adjusted email body, providing users with fast and considerate service.

[0824] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0825] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0826] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0827] [Third embodiment]

[0828] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0829] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0830] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0831] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0832] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0833] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0834] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0835] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0836] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0837] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0838] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0839] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0840] This invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. In this system, the server searches the database, generates documents, and sends emails based on the company number entered by the user on the terminal. The system's program processing is described in detail below.

[0841] Program processing overview

[0842] Enter and submit customer information

[0843] The user enters the company number into the input form on the terminal. After that, when the user clicks the "Send" button, the company number is sent to the server. The data sent from the terminal to the server may include user authentication information in addition to the company number.

[0844] Extraction of past requests

[0845] The server receives the company number sent from the terminal and accesses the database. It searches the database for past request information corresponding to this company number and extracts the relevant data. For example, for company number "12345," information on "Project A" and "Project B" is extracted from the database.

[0846] Creating quotes and application forms

[0847] The server automatically generates estimates and application forms based on the extracted information on past requests. Specifically, it embeds the necessary data into estimate and application form templates. The templates contain information such as the customer name, project name, request details, and price information, and this information is automatically inserted based on the extracted data. This generates estimates and application forms that are personalized for each customer.

[0848] Save as PDF

[0849] The generated estimates and application forms are saved in PDF format. The server saves these PDF files in a specific folder, and the file name is given the company number or project name. For example, they might be named "Estimate_12345_ProjectA.pdf" or "Application_12345_ProjectB.pdf."

[0850] Automatic email sending

[0851] The server automatically generates the email body to be sent to the customer from a template. The template includes a greeting and a summary of the request, and is customized based on the extracted customer information. The generated email body and the aforementioned PDF file are attached and automatically sent to the customer's email address. For example, an email with the subject "Information about the quotation and application form" is sent to "Customer name@domain.com."

[0852] Specific examples

[0853] The specific processing flow is shown below.

[0854] 1. Enter and submit customer information

[0855] The user enters the company number "12345" into the input form on the terminal and clicks the send button.

[0856] 2. Extraction of past requests

[0857] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[0858] 3. Creating a quote and application form

[0859] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[0860] Fill in the information for "Project B" into the application form template and automatically generate the application form.

[0861] 4. Save as PDF

[0862] The server saves the generated quotation and application form as "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[0863] 5. Automated email sending

[0864] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[0865] As described above, the present invention makes it possible to improve the efficiency and accuracy of business operations and to improve the quality of customer service.

[0866] The processing flow will be explained below.

[0867] Step 1:

[0868] The user enters the company number "12345" into the input form on the terminal, then clicks the send button, and the entered company number is sent to the server.

[0869] Step 2:

[0870] The server receives the company number "12345" sent from the terminal. After receiving it, the server uses this company number to access the database.

[0871] Step 3:

[0872] The server searches the database for past requests that match the company number "12345." For example, it extracts information on "Project A" and "Project B."

[0873] Step 4:

[0874] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[0875] Step 5:

[0876] The server extracts the information for "Project A" and "Project B" and embeds it into the template. Individual estimates and application forms are generated, with the necessary information accurately inserted.

[0877] Step 6:

[0878] The server saves the generated quotation and application form in PDF format. The file names will be "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[0879] Step 7:

[0880] The server loads an email template to send to the customer, which includes a greeting and a summary of the request.

[0881] Step 8:

[0882] The server automatically inserts necessary information such as the customer name and request details into the email template and generates the email body. The specific content is adapted to the customer.

[0883] Step 9:

[0884] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[0885] Step 10:

[0886] The user receives a confirmation message on their device confirming that the email was successfully sent to the customer.

[0887] Example 1

[0888] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0889] In conventional systems, creating quotes and application forms in response to repeated requests from customers is done manually, which is time-consuming and labor-intensive. It is also difficult to efficiently extract information about past requests, which increases the risk of manual input errors and omissions. Furthermore, the process of sending generated documents to customers is inefficient, and email transmission is cumbersome. To solve these problems, it is necessary to quickly extract information about past requests, accurately create automatically generated documents, and automate email transmission.

[0890] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0891] In this invention, the server includes a terminal for inputting customer identification information, means for extracting past requests from a database based on the identification information transmitted from the terminal, means for automatically generating a document using the extracted past request information, means for saving the generated document in PDF format, and means for automatically transmitting the generated PDF file to the customer by email. This enables the rapid and accurate extraction of past request information, the automatic generation of estimates and application forms, and the automation of email transmission.

[0892] "Customer" refers to the party that makes a request or places an order with a company or individual that provides a service or product.

[0893] "Identification information" refers to data such as numbers or codes that uniquely identify a particular customer.

[0894] "Terminal" refers to the device (such as a PC, tablet, or smartphone) that a user uses to enter information and communicate with the system.

[0895] A "database" is a system for systematically storing information and quickly and efficiently extracting data based on specific queries.

[0896] "Request" refers to an order or request made by a customer to a company or individual providing a service or product.

[0897] "Document" refers to documents or written documents that organize and describe information (e.g., estimates, application forms, etc.).

[0898] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing, displaying, and printing documents.

[0899] "Email delivery method" refers to the software or process used to create and send email.

[0900] A "template" refers to a document model that has a specific format and structure predefined.

[0901] "Filling" refers to the process of adding appropriate data to placeholders in a template.

[0902] "Personalization" refers to customizing the content of documents and emails based on specific customer information.

[0903] The present invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. Specific embodiments for carrying out the present invention are described below.

[0904] Hardware and software used

[0905] Hardware: Servers, user devices (PCs, tablets, smartphones, etc.)

[0906] Software: Database management system (e.g., MySQL), PDF generation library (e.g., Apache PDFBox), email sending library (e.g., JavaMail)

[0907] Enter and submit customer information

[0908] The user enters the company number into the input form on the terminal and clicks the "Submit" button. This operation causes the terminal to send the company number and user authentication information to the server. An HTTP POST request is used to send data from the terminal to the server.

[0909] Extraction of past requests

[0910] The server accesses the database based on the received company number and searches for past order information related to that company number. The server executes an SQL query using a database management system (e.g., MySQL). For example, it issues a query such as "SELECT FROM orders WHERE company_number = '12345'".

[0911] Creating quotes and application forms

[0912] The server creates estimates and application forms based on past request information. At this time, it reads estimate and application form templates (e.g., template file estimate_template.docx) and embeds the necessary information into the template. During the embedding process, the appropriate data is inserted into placeholders by a program.

[0913] Save as PDF

[0914] The generated quotation and application forms are converted to PDF format. The server uses the Apache PDFBox library to convert the document files to PDF format and saves them in a specific folder (e.g., / var / docs / ). The saved files are assigned the company number and project name (e.g., "Quotation_12345_ProjectA.pdf").

[0915] Automatic email sending

[0916] The server automatically generates the email body from the template, attaches the generated quotation and application form PDF files, and sends them to the customer. The JavaMail library is used to send the email. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[0917] Specific examples

[0918] The specific processing flow is shown below.

[0919] 1. Enter and submit customer information

[0920] The user enters the company number "12345" into the input form on the terminal and clicks the "Submit" button.

[0921] 2. Extraction of past requests

[0922] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[0923] 3. Creating a quote and application form

[0924] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[0925] The server embeds the information for "Project B" into the application form template and automatically generates the application form.

[0926] 4. Save as PDF

[0927] The server saves the generated quotation and application form as "Quotation_12345_CaseA.pdf" and "Application_12345_CaseB.pdf".

[0928] 5. Automated email sending

[0929] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[0930] Prompt Sentence Examples

[0931] Below are some examples of prompts related to this system:

[0932] I entered the company number "12345". Please search past requests, generate quotes and application forms, and send them by email.

[0933] In this way, by entering the company number, users can quickly and accurately generate quotations and application forms based on past requests and automatically send them to customers. This system improves work efficiency and accuracy.

[0934] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0935] Program processing flow

[0936] Step 1: Enter and submit customer information

[0937] Specific explanation

[0938] 1.1. The user enters the company number into the input form on the terminal. For example, enter the company number "12345".

[0939] 1.2. When the user clicks the "Submit" button, JavaScript on the terminal constructs form data and sends the company number and user authentication information to the server as an HTTP POST request.

[0940] input

[0941] Company number (e.g. 12345)

[0942] User authentication information (e.g., user ID, password)

[0943] output

[0944] Company number and user authentication information sent to the server

[0945] Step 2: Extract past requests

[0946] Specific explanation

[0947] 2.1. The server receives the company number. For example, the company number "12345" is received.

[0948] The server queries the database to find past orders based on the company number, for example by executing the SQL query "SELECT FROM orders WHERE company_number = '12345'".

[0949] 2.3. The server extracts the relevant data and stores it in memory. For example, it extracts information on "Project A" and "Project B" corresponding to company number "12345."

[0950] input

[0951] Company number (e.g. 12345)

[0952] User Credentials

[0953] output

[0954] Extracted request information (e.g., Case A, Case B)

[0955] Step 3: Create a quote and application

[0956] Specific explanation

[0957] The server loads the quotation and application form templates. For example, it loads the quotation template file "quote_template.docx."

[0958] 3.2. The server embeds the extracted data into a template and generates a document. For example, it embeds the data for "Project A" into the placeholder in the quotation template.

[0959] The server converts the generated document to PDF format. For example, it saves the generated quotation as "Quotation_12345_ProjectA.pdf".

[0960] input

[0961] Extracted request information (e.g., Case A, Case B)

[0962] Document template files

[0963] output

[0964] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0965] Step 4: Save as PDF

[0966] Specific explanation

[0967] 4.1. The server accesses a specific folder to save the generated PDF file, for example, the folder " / var / docs / ".

[0968] 4.2. The server saves the generated PDF file in a specific folder. The file name is given the company number and project name. For example, it is saved as "Quotation_12345_ProjectA.pdf".

[0969] input

[0970] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0971] output

[0972] PDF files saved in a folder

[0973] Step 5: Automated email sending

[0974] Specific explanation

[0975] The server loads the template file for sending email, for example, the email template file "email_template.html".

[0976] 5.2. The server generates the email body based on the template and embeds the extracted information.

[0977] The server attaches the generated PDF file to an email and sends it to the customer's email address. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[0978] input

[0979] Email template file

[0980] Customer email address (e.g. customername@domain.com)

[0981] Attached PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[0982] output

[0983] Emails sent to customers

[0984] In this way, specific data processing and data calculations are performed at each processing step, and the overall system flow functions in coordination to respond to customer requests.

[0985] (Application example 1)

[0986] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0987] In conventional logistics centers, employees often manually input specific information and proceed with their work while checking paper-based instructions. This reduces work efficiency and increases the risk of input and confirmation errors. Furthermore, there is a lack of efficient ways to utilize past request data, which can sometimes prevent optimal work instructions from being provided. Therefore, there is a need for a system that utilizes voice input to provide optimal work instructions in real time.

[0988] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0989] In this invention, the server includes a means including a smart device that accepts customer specific information by voice input, a means for presenting work instructions in real time using voice guidance, and a means for automatically generating estimates and application forms using extracted past request information. This allows employees to efficiently input specific information using voice input, and enables them to proceed with work quickly and accurately thanks to real-time voice guidance.

[0990] "Customer specific information" is unique information for identifying a specific customer, such as a customer number or company number.

[0991] A "terminal" is an electronic device used to input customer information, such as a smartphone or tablet.

[0992] A "database" is an information management system for storing information on past requests and customer information.

[0993] "Quotation and application form" means a document that details the price and contract contents of the services or products to be provided to the customer.

[0994] "PDF format" is an abbreviation for Portable Document Format, a general-purpose file format for saving electronic documents.

[0995] "Email sending means" is a function for automatically creating and sending emails.

[0996] A "smart device" is an electronic device that allows voice input, such as smart glasses or a smart speaker.

[0997] "Voice guidance" is a function that conveys information and instructions to users by voice.

[0998] "Real-time" means processing and providing information immediately in the current time.

[0999] This invention realizes a system that improves work efficiency in a logistics center by using voice input and real-time work instructions. The system is composed of the following elements:

[1000] 1. Enter customer information

[1001] The user uses a smart device, specifically smart glasses, to input information by voice. By inputting the customer's customer number, which is the customer's specific information, and issuing a transmission command, the information is sent to the server. The smart glasses have a voice input function and a display that the user can see.

[1002] 2. Extraction of past requests

[1003] The server extracts past requests from the database based on the received customer number. At this stage, all past request data related to the relevant customer is extracted at high speed.

[1004] 3. Generate work instructions

[1005] The server automatically generates work instructions by embedding the necessary information in a template based on the extracted past request information. These work instructions are documents containing detailed information such as a cargo list and work procedures, and are saved in PDF format on the server.

[1006] 4. Real-time work instructions

[1007] The server sends the generated work instructions to the smart glasses in real time, and provides voice reminders and display information to the user, allowing the user to receive instructions both visually and audibly, reducing errors and enabling efficient work.

[1008] Examples of hardware and software used

[1009] Smart glasses (devices with voice input and display capabilities)

[1010] Server (running the database management system)

[1011] Software (automatic work instruction generation, template auto-filling, real-time voice and display control software)

[1012] Specific examples

[1013] When a logistics center employee receives a new order, they voice-input "customer number 12345" into the smart glasses. The server then extracts past order data from the database and automatically generates work instructions based on that data. The generated instructions are sent to the smart glasses in real time and are read aloud and displayed on the screen, providing employees with quick and accurate instructions.

[1014] Example prompts for generative AI models

[1015] Please create a program that generates loading instructions based on past logistics requests for customer number 12345 and displays them on the smart glasses of logistics center employees. Please include voice input and real-time display, or voice reading functionality.

[1016] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1017] Step 1:

[1018] Using the voice input function of the device (smart glasses), the user voice-inputs "Customer number 12345." This voice data is converted into text data and sent to the server as specific information. The input data is the customer number, and the output is the transmission of the specific information to the server.

[1019] Step 2:

[1020] The server accesses the database based on the received specific information (customer number 12345). It performs a database search and extracts past request information related to the corresponding customer number. The input data is the customer number, and the output is past request information. The server executes the database query and obtains the results.

[1021] Step 3:

[1022] The server uses the extracted information about past requests to automatically fill in the necessary information in the quotation and application form templates. Specifically, it inserts the customer name, project name, request details, price information, etc. into the template. The input data is the past request information, and the output is the automatically generated quotation and application form. The server uses a template engine.

[1023] Step 4:

[1024] The server saves the generated quotations and application forms in PDF format. The saved PDF files are stored in a specific folder, and the company number and project name are added to the file name. The input data is the quotation and application form data, and the output is a PDF file. The server uses a PDF generation library.

[1025] Step 5:

[1026] The server automatically generates the body of the email to be sent to the customer from a template based on the PDF file. The template includes a greeting and a summary of the request, and is customized based on the customer information. The input data is the customer information and the PDF file, and the output is the automatically generated email body. The server uses an email template engine.

[1027] Step 6:

[1028] The server attaches the generated email body and PDF file and automatically sends it to the customer's email address. The input data is the email body and PDF file, and the output is the sent email. The server uses an email sending library.

[1029] Step 7:

[1030] The server also transmits the generated work instructions to the smart device (smart glasses) in real time, and simultaneously provides voice guidance and display information to the user. The input data is the work instructions, and the output is voice guidance and display information. The server uses a speech synthesis engine and display control software.

[1031] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1032] This invention combines an emotion engine with a system that quickly processes past requests based on repeated customer requests and automates the creation of estimates and application forms and the sending of emails, thereby realizing responses based on the recognition of user emotions.In this invention, the server performs database searches, document generation, emotion recognition, and email sending based on the company number entered by the user on a terminal.

[1033] Program processing overview

[1034] Enter and submit customer information

[1035] The user enters the company number into the input form on the terminal and clicks the "Send" button, which sends the company number to the server. In this step, the interface installed on the terminal accurately sends the data entered by the user to the server.

[1036] Extraction of past requests

[1037] The server receives the company number sent from the terminal and accesses the database to search for past requests. For example, for company number "12345," it extracts information on "Project A" and "Project B."

[1038] Creating quotes and application forms

[1039] The server automatically generates quotes and application forms based on the templates, embedding the extracted information about past requests into the templates, thereby creating documents that are personalized for each customer.

[1040] Save as PDF

[1041] The server saves the automatically generated quotation and application form in PDF format. The generated files are named "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[1042] Recognizing and Responding to Emotions

[1043] When a user enters and submits a company number, the terminal collects the user's emotional information and sends it to the server. The emotion engine analyzes this data and recognizes the user's emotion. Based on the recognized emotion, the server adjusts the content of the quote and application form. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[1044] Automatic email sending

[1045] The server generates the email body using an email template, and adjusts the tone and content of the email based on the user's emotions as recognized by the emotion engine. For example, if the user is feeling stressed, the email body can include words of comfort.

[1046] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the customer's email address. This procedure enables personalized responses and improves customer satisfaction.

[1047] Specific examples

[1048] 1. User operations

[1049] When a user enters the company number "12345" into the input form on the device and submits it, the device collects the user's facial expression and tone of voice as emotional data.

[1050] 2. Server data search

[1051] The server extracts from the database the past request cases "Case A" and "Case B" that correspond to the company number "12345".

[1052] 3. Generate quotes and application forms

[1053] The server embeds the information for "Project A" into the quotation template and automatically generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and automatically generates "Application_12345_ProjectB.pdf".

[1054] 4. Emotional Recognition and Regulation

[1055] The emotion engine recognizes the user's emotions and adjusts the quote content and email body accordingly. For example, if the user is unhappy, it will include polite language along with a discount offer.

[1056] 5. Automated email sending

[1057] The server generates the email body, adjusts it based on the sentiment, and automatically sends it to "customer name@domain.com" with the quote and application form PDF attached.

[1058] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[1059] The processing flow will be explained below.

[1060] Step 1:

[1061] The user enters the company number "12345" into the input form on the device. Then, they click the send button, and the company number is sent to the server. At this stage, the device collects emotional information such as the user's facial expression and tone of voice.

[1062] Step 2:

[1063] The server receives the company number "12345" sent from the device, and also receives the user's emotion data from the device at the same time.

[1064] Step 3:

[1065] The server accesses the database and searches for past requests related to the company number "12345." For example, it extracts information on "Project A" and "Project B."

[1066] Step 4:

[1067] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[1068] Step 5:

[1069] The server extracts information about "Project A" and "Project B" and embeds it into a template. Data is inserted into the required fields of each quotation and application form, and they are automatically generated.

[1070] Step 6:

[1071] The server saves the generated quotation and application form in PDF format. The file names are "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[1072] Step 7:

[1073] The server analyzes the received user emotion data using an emotion engine. For example, it recognizes that the user is feeling "anxiety."

[1074] Step 8:

[1075] The server tailors quotes and applications based on the emotion it detects, including special discounts and additional support information if the customer is feeling "anxious."

[1076] Step 9:

[1077] The server loads an email template to be sent to the customer, which already contains a greeting and a summary of the request.

[1078] Step 10:

[1079] The server then adjusts the tone and content of the email based on the results of the sentiment analysis, adding, for example, "If you have any concerns, please feel free to contact us."

[1080] Step 11:

[1081] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[1082] Step 12:

[1083] The user receives a confirmation message at the terminal confirming that the email was successfully sent to the customer, and the confirmation message sent to the terminal also includes a summary of the email sent and the elements that were adjusted.

[1084] Example 2

[1085] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1086] Conventional customer support systems have difficulty in providing quick and personalized responses to repeated requests from customers, making it difficult to improve customer satisfaction. Furthermore, they are unable to respond in a way that takes into account the user's emotions, resulting in insufficient support for dissatisfied or stressed customers.

[1087] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1088] In this invention, the server

[1089] a terminal for inputting customer specific information;

[1090] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[1091] A means for automatically generating estimates and application forms using the extracted past request information;

[1092] A means to save the generated estimate and application form in PDF format,

[1093] An email sending method to automatically send the generated PDF file to the customer,

[1094] A means for collecting and analyzing user emotion information;

[1095] means for adjusting the contents of the quotation and application form based on the result of the user's sentiment analysis;

[1096] a means for adjusting the email body based on the sentiment analysis results;

[1097] This allows for a fast, personalized response and a response that takes into account the user's emotions.

[1098] The "terminal for inputting specific customer information" is a device that allows a customer to input specific information (for example, a company number) and has the function of transmitting that information to the server.

[1099] "Specific information" refers to information that identifies a customer, such as a company number or customer ID.

[1100] A "database" is an information repository for storing and searching past requests and customer information.

[1101] "Past requests" refers to information about requests previously made by a customer, including the request content, date and time, etc.

[1102] "Quotation and Application Form" means a document required for price quotation and contract to be provided to a Customer.

[1103] "Means for automatic generation" refers to the process of automatically creating estimates and application forms using programs or software.

[1104] "Means for saving in PDF format" refers to a method for saving the generated estimate and application form in PDF format, which is a type of electronic file format.

[1105] The "email sending means" is a function for automatically sending an email containing the generated PDF file to the customer.

[1106] "Emotion information" is data related to emotions collected through the user's facial expressions, tone of voice, etc.

[1107] "Means of analysis" refers to the algorithms and engines that analyze the collected emotional information and understand its content.

[1108] "Sentiment analysis results" are the results of analyzed emotional information, based on which the system's behavior is adjusted.

[1109] "Means for tailoring email content" refers to the process of changing the content and tone of an email based on the results of user sentiment analysis.

[1110] The present invention combines an emotion engine with a system that quickly and individually processes past requests based on repeated customer requests, and automates the creation and email sending of estimates and application forms, thereby realizing responses based on user emotion recognition. Specific embodiments are described below.

[1111] 1. Enter and submit customer information

[1112] The user enters the company number into the input form on the device and clicks the "Send" button. The device is equipped with a user interface that can accurately transmit the data entered by the user to the server. At that time, the device collects the user's facial expressions and tone of voice along with the company number using a camera and microphone, and also transmits emotional data to the server.

[1113] 2. Submitting the company number and searching the database

[1114] The server receives the company number sent from the terminal. The server then accesses the MySQL database and searches for past requests based on the company number. For example, if the company number "12345" is entered, the server will extract information on "Project A" and "Project B" from the database.

[1115] 3. Automatic generation of quotes and application forms

[1116] The server retrieves quotation and application form templates using the Google Docs API. Next, it automatically embeds the extracted past request information into the template and generates the quotation and application form in PDF format. The generated files are saved as, for example, "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[1117] 4. Emotion recognition and content regulation

[1118] The server receives the emotion data submitted by the user and analyzes it using an emotion engine such as IBM Watson Tone Analyzer. Based on the results, the server can adjust the content of quotes and applications. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[1119] 5. Automated email sending

[1120] The server generates the email body using an email template. The tone and content of the email are adjusted based on the emotion engine's recognition results. For example, if the user is feeling stressed, the email body can include words of comfort. The generated email and PDF file are attached and automatically sent to the customer's email address using an SMTP server (e.g., SendGrid).

[1121] Specific examples

[1122] 1. User operations

[1123] The user enters the company number "12345" into the input form on the device and clicks the send button. The device then uses the camera and microphone to collect the user's facial expressions and tone of voice, and sends them to the server as emotional data.

[1124] 2. Server data search

[1125] The server extracts from the database the past requests "Project A" and "Project B" that correspond to the company number "12345."

[1126] 3. Generate quotes and application forms

[1127] The server embeds the information for "Project A" into the quotation template and generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and generates "Application_12345_ProjectB.pdf".

[1128] 4. Emotional Recognition and Regulation

[1129] The emotion engine recognizes the user's emotions and adds a discount offer to the quote if they are dissatisfied, and includes polite language in the email body.

[1130] 5. Automated email sending

[1131] The server generates the email body, adjusts the content based on the sentiment, and then attaches "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf" and sends the email to "customer12345@domain.com".

[1132] Prompt Sentence Examples

[1133] "Please extract past requests from company number 12345 and generate quotes and application forms. Please add appropriate content based on user sentiment."

[1134] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[1135] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1136] Step 1:

[1137] The user enters the company number into the input form on the terminal and clicks the "Submit" button.

[1138] Input: Company number (e.g. "12345")

[1139] Output: Request with company number sent to server

[1140] Specific operation: The user enters the company number "12345", and the terminal generates an HTTP request to send the company number to the server.

[1141] Step 2:

[1142] The device sends the company number to the server, and at the same time, collects the user's facial expressions and tone of voice and sends emotional data to the server.

[1143] Input: Company number, user facial expression data, voice data

[1144] Output: A request with company number and emotion data sent to the server

[1145] Specific operation: The device sends the company number "12345" and the emotion data collected using the camera and microphone to the server as an HTTP request.

[1146] Step 3:

[1147] The server receives the company number and accesses the database to search and extract past requests.

[1148] Input: Company Number

[1149] Output: Data of past requests (e.g. "Project A" and "Project B")

[1150] Specific operation: The server extracts the company number "12345" from the HTTP request and queries the MySQL database to retrieve past requests "Project A" and "Project B."

[1151] Step 4:

[1152] The server retrieves quotation and application form templates, embeds the extracted request information, and automatically generates them in PDF format.

[1153] Input: Data of past request cases ("Case A" and "Case B")

[1154] Output: PDF file (quote and application form)

[1155] Specific operation: The server retrieves the template using the Google Docs API, fills in the project details, and generates "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[1156] Step 5:

[1157] The server analyzes the received emotion data and adjusts the contents of the estimate and application form.

[1158] Input: Emotion data, PDF files (quote and application form)

[1159] Output: Adjusted PDF file

[1160] What it does: The server analyzes the emotion data with IBM Watson Tone Analyzer, and if dissatisfaction is detected, it adds a special discount to the quote and regenerates the PDF file.

[1161] Step 6:

[1162] The server generates the email body using an email template, adjusts it based on the results of sentiment analysis, and automatically sends the adjusted email body and PDF file to the customer.

[1163] Input: Modified PDF file, emotion data

[1164] Output: Sent email (PDF file attached)

[1165] What happens: The server retrieves the email template, adjusts the content and tone based on the sentiment analysis, and sends the email to "customer12345@domain.com" using the SMTP server.

[1166] This allows the user to input specific information, and the system automatically processes and adjusts past requests, and then efficiently completes the entire process, from sending the generated document as a PDF file to the customer.

[1167] (Application example 2)

[1168] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1169] While the conventional system was functionally capable of automatically generating and sending estimates and application forms to customers, it was unable to provide individualized responses that took into account the customer's emotions. This limited its ability to improve customer satisfaction and service quality. Furthermore, even when a customer was feeling stressed or dissatisfied, the system would send similar documents or emails without noticing their emotions, which created an issue where it was not possible to improve the customer experience.

[1170] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting specific information about the customer, means for extracting past requests from a database based on the specific information transmitted from the terminal, means for automatically generating an estimate and an application form using the extracted information about the past requests, means for saving the generated estimate and application form in PDF format, email sending means for automatically sending the generated PDF file to the customer, emotion analysis means for collecting and analyzing user emotion data, means for adjusting the content of the estimate and application form based on the emotion analysis results, and means for adjusting the tone of the email body based on the emotion analysis results. This enables individualized responses that take customer emotions into consideration, thereby increasing customer satisfaction and improving service quality.

[1171] The "terminal for inputting customer specific information" is an electronic device for the customer to input specific information such as a company number.

[1172] The "means for extracting past requests from a database" is a method for reading relevant data from a database that records previous transaction information and request details based on specific information about the customer.

[1173] The "means for automatically generating estimates and application forms" is a function for automatically creating estimates and application forms based on the extracted past request information.

[1174] "Means of saving in PDF format" refers to a method of saving the generated estimate or application form as a PDF file, which is an electronic document format.

[1175] "An email sending method for automatically sending PDF files to customers" is a function that automatically sends saved PDF files to customers via email.

[1176] The "emotion analysis means" is a system that analyzes a user's emotions based on the user's input data and the device's sensor information.

[1177] The "means for adjusting the contents of the estimate and application form based on the results of the emotion analysis" is a function for changing and adjusting the contents of the estimate and application form based on the analyzed emotion data.

[1178] "Means for adjusting the tone of the email body based on the results of sentiment analysis" refers to a function that changes or adjusts the tone and content of an email based on the results obtained from sentiment analysis.

[1179] This invention combines a sentiment analysis engine with a system that quickly processes past requests based on repeated customer requests and automates the creation and email sending of estimates and application forms, thereby enabling responses based on user emotion recognition.

[1180] System Configuration

[1181] Hardware and Software

[1182] 1. Device:

[1183] A device used to input customer-specific information. Generally, it is assumed to be an electronic device such as a PC, smartphone, or tablet.

[1184] 2. Server:

[1185] It is a high-performance computer that performs various functions such as databases, emotion recognition, document generation, and email sending.

[1186] The software used includes a Python program, smtplib (an email sending function), FPDF (a PDF generation library), and a sentiment analysis module.

[1187] Data processing and calculation

[1188] 1. Enter and submit customer information:

[1189] The user enters specific information such as a company number into an input form on the terminal, and the entered information is sent to the server.

[1190] 2. Extraction of past requests:

[1191] The server extracts the relevant past request information from the database based on the specific information received from the terminal.

[1192] 3. Generate quotes and applications:

[1193] The server automatically generates estimates and application forms by embedding the extracted request information into templates, and the generated documents are saved in PDF format.

[1194] 4. Recognizing and responding to emotions:

[1195] When a user inputs specific information, the device collects the user's emotional data (such as facial expressions and tone of voice) and sends it to the server, where the server's emotion analysis engine analyzes the data and evaluates the user's emotions.

[1196] 5. Adjusting documents and email content:

[1197] Based on the results of emotion recognition, quotes and application forms can be tailored—for example, a special discount can be added if the user is feeling stressed—and emails can also be tailored in tone and content depending on the user's emotion.

[1198] 6. Automated emails:

[1199] The adjusted quote and application PDF files are automatically sent to the customer's email address along with a personalized email message, improving customer satisfaction through personalized service.

[1200] Specific examples

[1201] The user enters the company number "12345" into the input form and submits it. At this time, the device collects data on the user's facial expressions and tone of voice.

[1202] The server extracts information on past request cases "Case A" and "Case B" that correspond to the company number "12345" from the database.

[1203] The server automatically generates an estimate for "Project A" and an application form for "Project B" based on the template, and saves them as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf", respectively.

[1204] The emotion engine recognizes the user's emotions (e.g., dissatisfaction) and adds special discount offers to the quote.

[1205] The server generates the email body, adjusts the content based on the sentiment, and automatically sends it to "customer name@domain.com" with PDF files of the quotation and application form attached.

[1206] Prompt Sentence Examples

[1207] My company (Company ID: 12345) has done some business with you in the past. We are currently experiencing issues with late payments for the most recent transaction. We would like to resolve this issue as soon as possible. Please generate a quote and application form to address this issue and send them along with relevant emails.

[1208] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1209] Step 1:

[1210] The user enters specific information (such as a company number) into an input form on the device and submits it. The device collects the input data along with emotional data such as the user's facial expression and tone of voice. This data is then sent to the server, which measures the user's emotional state.

[1211] Step 2:

[1212] The server searches the database based on the specific information received from the terminal. Specifically, it uses the company number as a key to extract past requests (e.g., "Project A" and "Project B"). This retrieves the details of transactions the user has made in the past.

[1213] Step 3:

[1214] The server automatically generates an estimate and application form based on the extracted request information. It embeds the relevant information into a template and creates the estimate and application form. This generates PDF files such as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[1215] Step 4:

[1216] The server saves the generated PDF files of the quote and application form, making the documents available for future reference.

[1217] Step 5:

[1218] The server receives the emotion data sent from the device and analyzes the emotion using an emotion analysis engine. Specifically, it determines whether the user is feeling dissatisfied, stressed, happy, etc. This allows the server to recognize the user's current emotional state.

[1219] Step 6:

[1220] The server adjusts quote and application forms based on the results of sentiment analysis, for example adding a special discount to a quote if the user is dissatisfied, resulting in documents that are tailored to the customer.

[1221] Step 7:

[1222] The server generates the email body based on the results of the sentiment analysis. Based on a template, the tone and content are adjusted according to the emotion. For example, if the user is feeling stressed, comforting words are included. This process creates an email body that takes the user's emotions into consideration.

[1223] Step 8:

[1224] The server automatically sends the generated quote and application form PDF files to the customer's email address along with the adjusted email body, providing users with fast and considerate service.

[1225] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1226] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1227] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1228] [Fourth embodiment]

[1229] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1230] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1231] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1232] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1233] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1234] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1235] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1236] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1237] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1238] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1239] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1240] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1241] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1242] This invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. In this system, the server searches the database, generates documents, and sends emails based on the company number entered by the user on the terminal. The system's program processing is described in detail below.

[1243] Program processing overview

[1244] Enter and submit customer information

[1245] The user enters the company number into the input form on the terminal. After that, when the user clicks the "Send" button, the company number is sent to the server. The data sent from the terminal to the server may include user authentication information in addition to the company number.

[1246] Extraction of past requests

[1247] The server receives the company number sent from the terminal and accesses the database. It searches the database for past request information corresponding to this company number and extracts the relevant data. For example, for company number "12345," information on "Project A" and "Project B" is extracted from the database.

[1248] Creating quotes and application forms

[1249] The server automatically generates estimates and application forms based on the extracted information on past requests. Specifically, it embeds the necessary data into estimate and application form templates. The templates contain information such as the customer name, project name, request details, and price information, and this information is automatically inserted based on the extracted data. This generates estimates and application forms that are personalized for each customer.

[1250] Save as PDF

[1251] The generated estimates and application forms are saved in PDF format. The server saves these PDF files in a specific folder, and the file name is given the company number or project name. For example, they might be named "Estimate_12345_ProjectA.pdf" or "Application_12345_ProjectB.pdf."

[1252] Automatic email sending

[1253] The server automatically generates the email body to be sent to the customer from a template. The template includes a greeting and a summary of the request, and is customized based on the extracted customer information. The generated email body and the aforementioned PDF file are attached and automatically sent to the customer's email address. For example, an email with the subject "Information about the quotation and application form" is sent to "Customer name@domain.com."

[1254] Specific examples

[1255] The specific processing flow is shown below.

[1256] 1. Enter and submit customer information

[1257] The user enters the company number "12345" into the input form on the terminal and clicks the send button.

[1258] 2. Extraction of past requests

[1259] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[1260] 3. Creating a quote and application form

[1261] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[1262] Fill in the information for "Project B" into the application form template and automatically generate the application form.

[1263] 4. Save as PDF

[1264] The server saves the generated quotation and application form as "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[1265] 5. Automated email sending

[1266] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[1267] As described above, the present invention makes it possible to improve the efficiency and accuracy of business operations and to improve the quality of customer service.

[1268] The processing flow will be explained below.

[1269] Step 1:

[1270] The user enters the company number "12345" into the input form on the terminal, then clicks the send button, and the entered company number is sent to the server.

[1271] Step 2:

[1272] The server receives the company number "12345" sent from the terminal. After receiving it, the server uses this company number to access the database.

[1273] Step 3:

[1274] The server searches the database for past requests that match the company number "12345." For example, it extracts information on "Project A" and "Project B."

[1275] Step 4:

[1276] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[1277] Step 5:

[1278] The server extracts the information for "Project A" and "Project B" and embeds it into the template. Individual estimates and application forms are generated, with the necessary information accurately inserted.

[1279] Step 6:

[1280] The server saves the generated quotation and application form in PDF format. The file names will be "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[1281] Step 7:

[1282] The server loads an email template to send to the customer, which includes a greeting and a summary of the request.

[1283] Step 8:

[1284] The server automatically inserts necessary information such as the customer name and request details into the email template and generates the email body. The specific content is adapted to the customer.

[1285] Step 9:

[1286] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[1287] Step 10:

[1288] The user receives a confirmation message on their device, confirming that the email was successfully sent to the customer.

[1289] Example 1

[1290] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1291] In conventional systems, creating quotes and application forms in response to repeated requests from customers is done manually, which is time-consuming and labor-intensive. It is also difficult to efficiently extract information about past requests, which increases the risk of manual input errors and omissions. Furthermore, the process of sending generated documents to customers is inefficient, and email transmission is cumbersome. To solve these problems, it is necessary to quickly extract information about past requests, accurately create automatically generated documents, and automate email transmission.

[1292] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1293] In this invention, the server includes a terminal for inputting customer identification information, means for extracting past requests from a database based on the identification information transmitted from the terminal, means for automatically generating a document using the extracted past request information, means for saving the generated document in PDF format, and means for automatically transmitting the generated PDF file to the customer by email. This enables the rapid and accurate extraction of past request information, the automatic generation of estimates and application forms, and the automation of email transmission.

[1294] "Customer" refers to the party that makes a request or places an order with a company or individual that provides a service or product.

[1295] "Identification information" refers to data such as numbers or codes that uniquely identify a particular customer.

[1296] "Terminal" refers to the device (such as a PC, tablet, or smartphone) that a user uses to enter information and communicate with the system.

[1297] A "database" is a system for systematically storing information and quickly and efficiently extracting data based on specific queries.

[1298] "Request" refers to an order or request made by a customer to a company or individual providing a service or product.

[1299] "Document" refers to documents or written documents that organize and describe information (e.g., estimates, application forms, etc.).

[1300] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing, displaying, and printing documents.

[1301] "Email delivery method" refers to the software or process used to create and send email.

[1302] A "template" refers to a document model that has a specific format and structure predefined.

[1303] "Filling" refers to the process of adding appropriate data to placeholders in a template.

[1304] "Personalization" refers to customizing the content of documents and emails based on specific customer information.

[1305] The present invention is a system that quickly processes past requests based on repeated requests from customers, and automates the creation and email transmission of estimates and application forms. Specific embodiments for carrying out the present invention are described below.

[1306] Hardware and software used

[1307] Hardware: Servers, user devices (PCs, tablets, smartphones, etc.)

[1308] Software: Database management system (e.g., MySQL), PDF generation library (e.g., Apache PDFBox), email sending library (e.g., JavaMail)

[1309] Enter and submit customer information

[1310] The user enters the company number into the input form on the terminal and clicks the "Submit" button. This operation causes the terminal to send the company number and user authentication information to the server. An HTTP POST request is used to send data from the terminal to the server.

[1311] Extraction of past requests

[1312] The server accesses the database based on the received company number and searches for past order information related to that company number. The server executes an SQL query using a database management system (e.g., MySQL). For example, it issues a query such as "SELECT FROM orders WHERE company_number = '12345'".

[1313] Creating quotes and application forms

[1314] The server creates estimates and application forms based on past request information. At this time, it reads estimate and application form templates (e.g., template file estimate_template.docx) and embeds the necessary information into the template. During the embedding process, the appropriate data is inserted into placeholders by a program.

[1315] Save as PDF

[1316] The generated quotation and application forms are converted to PDF format. The server uses the Apache PDFBox library to convert the document files to PDF format and saves them in a specific folder (e.g., / var / docs / ). The saved files are assigned the company number and project name (e.g., "Quotation_12345_ProjectA.pdf").

[1317] Automatic email sending

[1318] The server automatically generates the email body from the template, attaches the generated quotation and application form PDF files, and sends them to the customer. The JavaMail library is used to send the email. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[1319] Specific examples

[1320] The specific processing flow is shown below.

[1321] 1. Enter and submit customer information

[1322] The user enters the company number "12345" into the input form on the terminal and clicks the "Submit" button.

[1323] 2. Extraction of past requests

[1324] The server extracts from the database the past request cases "Case A" and "Case B" corresponding to the company number "12345".

[1325] 3. Creating a quote and application form

[1326] The server embeds the information for "Project A" into the quotation template and automatically generates a quotation.

[1327] The server embeds the information for "Project B" into the application form template and automatically generates the application form.

[1328] 4. Save as PDF

[1329] The server saves the generated quotation and application form as "Quotation_12345_CaseA.pdf" and "Application_12345_CaseB.pdf".

[1330] 5. Automated email sending

[1331] The server generates the email body from the template, attaches the quotation and application form, and sends the email to "customer name@domain.com".

[1332] Prompt Sentence Examples

[1333] Below are some examples of prompts related to this system:

[1334] I entered the company number "12345". Please search past requests, generate quotes and application forms, and send them by email.

[1335] In this way, by entering the company number, users can quickly and accurately generate quotations and application forms based on past requests and automatically send them to customers. This system improves work efficiency and accuracy.

[1336] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1337] Program processing flow

[1338] Step 1: Enter and submit customer information

[1339] Specific explanation

[1340] 1.1. The user enters the company number into the input form on the terminal. For example, enter the company number "12345".

[1341] 1.2. When the user clicks the "Submit" button, JavaScript on the terminal constructs form data and sends the company number and user authentication information to the server as an HTTP POST request.

[1342] input

[1343] Company number (e.g. 12345)

[1344] User authentication information (e.g., user ID, password)

[1345] output

[1346] Company number and user authentication information sent to the server

[1347] Step 2: Extract past requests

[1348] Specific explanation

[1349] 2.1. The server receives the company number. For example, the company number "12345" is received.

[1350] The server queries the database to find past orders based on the company number, for example, by executing the SQL query "SELECT FROM orders WHERE company_number = '12345'".

[1351] 2.3. The server extracts the relevant data and stores it in memory. For example, it extracts information on "Project A" and "Project B" corresponding to company number "12345."

[1352] input

[1353] Company number (e.g. 12345)

[1354] User Credentials

[1355] output

[1356] Extracted request information (e.g., Case A, Case B)

[1357] Step 3: Create a quote and application

[1358] Specific explanation

[1359] The server loads the quotation and application form templates. For example, it loads the quotation template file "quote_template.docx."

[1360] 3.2. The server embeds the extracted data into a template and generates a document. For example, it embeds the data for "Project A" into the placeholder in the quotation template.

[1361] The server converts the generated document to PDF format. For example, it saves the generated quotation as "Quotation_12345_ProjectA.pdf".

[1362] input

[1363] Extracted request information (e.g., Case A, Case B)

[1364] Document template files

[1365] output

[1366] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[1367] Step 4: Save as PDF

[1368] Specific explanation

[1369] 4.1. The server accesses a specific folder to save the generated PDF file, for example, the folder " / var / docs / ".

[1370] 4.2. The server saves the generated PDF file in a specific folder. The file name is given the company number and project name. For example, it is saved as "Quotation_12345_ProjectA.pdf".

[1371] input

[1372] Generated PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[1373] output

[1374] PDF files saved in a folder

[1375] Step 5: Automated email sending

[1376] Specific explanation

[1377] The server loads the template file for sending email, for example, the email template file "email_template.html".

[1378] 5.2. The server generates the email body based on the template and embeds the extracted information.

[1379] The server attaches the generated PDF file to an email and sends it to the customer's email address. For example, an email is sent to "customer name@domain.com" with the subject "Information about quotation and application form."

[1380] input

[1381] Email template file

[1382] Customer email address (e.g. customername@domain.com)

[1383] Attached PDF files (e.g., Quotation_12345_ProjectA.pdf, Application_12345_ProjectB.pdf)

[1384] output

[1385] Emails sent to customers

[1386] In this way, specific data processing and data calculations are performed at each processing step, and the overall system flow functions in coordination to respond to customer requests.

[1387] (Application example 1)

[1388] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1389] In conventional logistics centers, employees often manually input specific information and proceed with their work while checking paper-based instructions. This reduces work efficiency and increases the risk of input and confirmation errors. Furthermore, there is a lack of efficient ways to utilize past request data, which can sometimes prevent optimal work instructions from being provided. Therefore, there is a need for a system that utilizes voice input to provide optimal work instructions in real time.

[1390] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1391] In this invention, the server includes a means including a smart device that accepts customer specific information by voice input, a means for presenting work instructions in real time using voice guidance, and a means for automatically generating estimates and application forms using extracted past request information. This allows employees to efficiently input specific information using voice input, and enables them to proceed with work quickly and accurately thanks to real-time voice guidance.

[1392] "Customer specific information" is unique information for identifying a specific customer, such as a customer number or company number.

[1393] A "terminal" is an electronic device used to input customer information, such as a smartphone or tablet.

[1394] A "database" is an information management system for storing information on past requests and customer information.

[1395] "Quotation and application form" means a document that details the price and contract contents of the services or products to be provided to the customer.

[1396] "PDF format" is an abbreviation for Portable Document Format, a general-purpose file format for saving electronic documents.

[1397] "Email sending means" is a function for automatically creating and sending emails.

[1398] A "smart device" is an electronic device that allows voice input, such as smart glasses or a smart speaker.

[1399] "Voice guidance" is a function that conveys information and instructions to users by voice.

[1400] "Real-time" means processing and providing information immediately in the current time.

[1401] This invention realizes a system that improves work efficiency in a logistics center by using voice input and real-time work instructions. The system is composed of the following elements:

[1402] 1. Enter customer information

[1403] The user uses a smart device, specifically smart glasses, to input information by voice. By inputting the customer's customer number, which is the customer's specific information, and issuing a transmission command, the information is sent to the server. The smart glasses have a voice input function and a display that the user can see.

[1404] 2. Extraction of past requests

[1405] The server extracts past requests from the database based on the received customer number. At this stage, all past request data related to the relevant customer is extracted at high speed.

[1406] 3. Generate work instructions

[1407] The server automatically generates work instructions by embedding the necessary information in a template based on the extracted past request information. These work instructions are documents containing detailed information such as a cargo list and work procedures, and are saved in PDF format on the server.

[1408] 4. Real-time work instructions

[1409] The server sends the generated work instructions to the smart glasses in real time, and provides voice reminders and display information to the user, allowing the user to receive instructions both visually and audibly, reducing errors and enabling efficient work.

[1410] Examples of hardware and software used

[1411] Smart glasses (devices with voice input and display capabilities)

[1412] Server (running the database management system)

[1413] Software (automatic work instruction generation, template auto-filling, real-time voice and display control software)

[1414] Specific examples

[1415] When a logistics center employee receives a new order, they voice-input "customer number 12345" into the smart glasses. The server then extracts past order data from the database and automatically generates work instructions based on that data. The generated instructions are sent to the smart glasses in real time and are read aloud and displayed on the screen, providing employees with quick and accurate instructions.

[1416] Example prompts for generative AI models

[1417] Please create a program that generates loading instructions based on past logistics requests for customer number 12345 and displays them on the smart glasses of logistics center employees. Please include voice input and real-time display, or voice reading functionality.

[1418] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1419] Step 1:

[1420] Using the voice input function of the device (smart glasses), the user voice-inputs "Customer number 12345." This voice data is converted into text data and sent to the server as specific information. The input data is the customer number, and the output is the transmission of the specific information to the server.

[1421] Step 2:

[1422] The server accesses the database based on the received specific information (customer number 12345). It performs a database search and extracts past request information related to the corresponding customer number. The input data is the customer number, and the output is past request information. The server executes the database query and obtains the results.

[1423] Step 3:

[1424] The server uses the extracted information about past requests to automatically fill in the necessary information in the quotation and application form templates. Specifically, it inserts the customer name, project name, request details, price information, etc. into the template. The input data is the past request information, and the output is the automatically generated quotation and application form. The server uses a template engine.

[1425] Step 4:

[1426] The server saves the generated quotations and application forms in PDF format. The saved PDF files are stored in a specific folder, and the company number and project name are added to the file name. The input data is the quotation and application form data, and the output is a PDF file. The server uses a PDF generation library.

[1427] Step 5:

[1428] The server automatically generates the body of the email to be sent to the customer from a template based on the PDF file. The template includes a greeting and a summary of the request, and is customized based on the customer information. The input data is the customer information and the PDF file, and the output is the automatically generated email body. The server uses an email template engine.

[1429] Step 6:

[1430] The server attaches the generated email body and PDF file and automatically sends it to the customer's email address. The input data is the email body and PDF file, and the output is the sent email. The server uses an email sending library.

[1431] Step 7:

[1432] The server also transmits the generated work instructions to the smart device (smart glasses) in real time, and simultaneously provides voice guidance and display information to the user. The input data is the work instructions, and the output is voice guidance and display information. The server uses a speech synthesis engine and display control software.

[1433] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1434] This invention combines an emotion engine with a system that quickly processes past requests based on repeated customer requests and automates the creation of estimates and application forms and the sending of emails, thereby realizing responses based on the recognition of user emotions.In this invention, the server performs database searches, document generation, emotion recognition, and email sending based on the company number entered by the user on a terminal.

[1435] Program processing overview

[1436] Enter and submit customer information

[1437] The user enters the company number into the input form on the terminal and clicks the "Send" button, which sends the company number to the server. In this step, the interface installed on the terminal accurately sends the data entered by the user to the server.

[1438] Extraction of past requests

[1439] The server receives the company number sent from the terminal and accesses the database to search for past requests. For example, for company number "12345," it extracts information on "Project A" and "Project B."

[1440] Creating quotes and application forms

[1441] The server automatically generates quotes and application forms based on the templates, embedding the extracted information about past requests into the templates, thereby creating documents that are personalized for each customer.

[1442] Save as PDF

[1443] The server saves the automatically generated quotation and application form in PDF format. The generated files are named "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[1444] Recognizing and Responding to Emotions

[1445] When a user enters and submits a company number, the terminal collects the user's emotional information and sends it to the server. The emotion engine analyzes this data and recognizes the user's emotion. Based on the recognized emotion, the server adjusts the content of the quote and application form. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[1446] Automatic email sending

[1447] The server generates the email body using an email template, and adjusts the tone and content of the email based on the user's emotions as recognized by the emotion engine. For example, if the user is feeling stressed, the email body can include words of comfort.

[1448] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the customer's email address. This procedure enables personalized responses and improves customer satisfaction.

[1449] Specific examples

[1450] 1. User operations

[1451] When a user enters the company number "12345" into the input form on the device and submits it, the device collects the user's facial expression and tone of voice as emotional data.

[1452] 2. Server data search

[1453] The server extracts from the database the past request cases "Case A" and "Case B" that correspond to the company number "12345".

[1454] 3. Generate quotes and application forms

[1455] The server embeds the information for "Project A" into the quotation template and automatically generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and automatically generates "Application_12345_ProjectB.pdf".

[1456] 4. Emotional Recognition and Regulation

[1457] The emotion engine recognizes the user's emotions and adjusts the quote content and email body accordingly. For example, if the user is unhappy, it will include polite language along with a discount offer.

[1458] 5. Automated email sending

[1459] The server generates the email body, adjusts it based on the sentiment, and automatically sends it to "customer name@domain.com" with the quote and application form PDF attached.

[1460] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[1461] The processing flow will be explained below.

[1462] Step 1:

[1463] The user enters the company number "12345" into the input form on the device. Then, they click the send button, and the company number is sent to the server. At this stage, the device collects emotional information such as the user's facial expression and tone of voice.

[1464] Step 2:

[1465] The server receives the company number "12345" sent from the device, and also receives the user's emotion data from the device at the same time.

[1466] Step 3:

[1467] The server accesses the database and searches for past requests related to the company number "12345." For example, it extracts information on "Project A" and "Project B."

[1468] Step 4:

[1469] The server loads template files for quotes and applications, which contain specific formats and empty data fields.

[1470] Step 5:

[1471] The server extracts information about "Project A" and "Project B" and embeds it into a template. Data is inserted into the required fields of each quotation and application form, and they are automatically generated.

[1472] Step 6:

[1473] The server saves the generated quotation and application form in PDF format. The file names are "Quotation_Company Number 12345_Project A.pdf" and "Application Form_Company Number 12345_Project B.pdf".

[1474] Step 7:

[1475] The server analyzes the received user emotion data using an emotion engine. For example, it recognizes that the user is feeling "anxiety."

[1476] Step 8:

[1477] The server tailors quotes and applications based on the emotion it detects, including special discounts and additional support information if the customer is feeling "anxious."

[1478] Step 9:

[1479] The server loads an email template to be sent to the customer, which already contains a greeting and a summary of the request.

[1480] Step 10:

[1481] The server then adjusts the tone and content of the email based on the results of the sentiment analysis, adding, for example, "If you have any concerns, please feel free to contact us."

[1482] Step 11:

[1483] The server automatically sends the generated email and the attached PDF files of the quotation and application form to the specified customer's email address.

[1484] Step 12:

[1485] The user receives a confirmation message at the terminal confirming that the email was successfully sent to the customer, and the confirmation message sent to the terminal also includes a summary of the email sent and the elements that were adjusted.

[1486] Example 2

[1487] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1488] Conventional customer support systems have difficulty in providing quick and personalized responses to repeated requests from customers, making it difficult to improve customer satisfaction. Furthermore, they are unable to respond in a way that takes into account the user's emotions, resulting in insufficient support for dissatisfied or stressed customers.

[1489] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1490] In this invention, the server

[1491] a terminal for inputting customer specific information;

[1492] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[1493] A means for automatically generating estimates and application forms using the extracted past request information;

[1494] A means to save the generated estimate and application form in PDF format,

[1495] An email sending method to automatically send the generated PDF file to the customer,

[1496] A means for collecting and analyzing user emotion information;

[1497] means for adjusting the contents of the quotation and application form based on the result of the user's sentiment analysis;

[1498] a means for adjusting the email body based on the sentiment analysis results;

[1499] This allows for a fast, personalized response and a response that takes into account the user's emotions.

[1500] The "terminal for inputting specific customer information" is a device that allows a customer to input specific information (for example, a company number) and has the function of transmitting that information to the server.

[1501] "Specific information" refers to information that identifies a customer, such as a company number or customer ID.

[1502] A "database" is an information repository for storing and searching past requests and customer information.

[1503] "Past requests" refers to information about requests previously made by a customer, including the request content, date and time, etc.

[1504] "Quotation and Application Form" means a document required for price quotation and contract to be provided to a Customer.

[1505] "Means for automatic generation" refers to the process of automatically creating estimates and application forms using programs or software.

[1506] "Means for saving in PDF format" refers to a method for saving the generated estimate and application form in PDF format, which is a type of electronic file format.

[1507] The "email sending means" is a function for automatically sending an email containing the generated PDF file to the customer.

[1508] "Emotion information" is data related to emotions collected through the user's facial expressions, tone of voice, etc.

[1509] "Means of analysis" refers to the algorithms and engines that analyze the collected emotional information and understand its content.

[1510] "Sentiment analysis results" are the results of analyzed emotional information, based on which the system's behavior is adjusted.

[1511] "Means for tailoring email content" refers to the process of changing the content and tone of an email based on the results of user sentiment analysis.

[1512] The present invention combines an emotion engine with a system that quickly and individually processes past requests based on repeated customer requests, and automates the creation and email sending of estimates and application forms, thereby realizing responses based on user emotion recognition. Specific embodiments are described below.

[1513] 1. Enter and submit customer information

[1514] The user enters the company number into the input form on the device and clicks the "Send" button. The device is equipped with a user interface that can accurately transmit the data entered by the user to the server. At that time, the device collects the user's facial expressions and tone of voice along with the company number using a camera and microphone, and also transmits emotional data to the server.

[1515] 2. Submitting the company number and searching the database

[1516] The server receives the company number sent from the terminal. The server then accesses the MySQL database and searches for past requests based on the company number. For example, if the company number "12345" is entered, the server will extract information on "Project A" and "Project B" from the database.

[1517] 3. Automatic generation of quotes and application forms

[1518] The server retrieves quotation and application form templates using the Google Docs API. Next, it automatically embeds the extracted past request information into the template and generates the quotation and application form in PDF format. The generated files are saved as, for example, "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[1519] 4. Emotion recognition and content regulation

[1520] The server receives the emotion data submitted by the user and analyzes it using an emotion engine such as IBM Watson Tone Analyzer. Based on the results, the server can adjust the content of quotes and applications. For example, if the user is dissatisfied, it can add a special discount offer to the quote.

[1521] 5. Automated email sending

[1522] The server generates the email body using an email template. The tone and content of the email are adjusted based on the emotion engine's recognition results. For example, if the user is feeling stressed, the email body can include words of comfort. The generated email and PDF file are attached and automatically sent to the customer's email address using an SMTP server (e.g., SendGrid).

[1523] Specific examples

[1524] 1. User operations

[1525] The user enters the company number "12345" into the input form on the device and clicks the send button. The device then uses the camera and microphone to collect the user's facial expressions and tone of voice, and sends them to the server as emotional data.

[1526] 2. Server data search

[1527] The server extracts from the database the past requests "Project A" and "Project B" that correspond to the company number "12345."

[1528] 3. Generate quotes and application forms

[1529] The server embeds the information for "Project A" into the quotation template and generates "Quotation_12345_ProjectA.pdf". Similarly, it embeds the information for "Project B" into the application template and generates "Application_12345_ProjectB.pdf".

[1530] 4. Emotional Recognition and Regulation

[1531] The emotion engine recognizes the user's emotions and adds a discount offer to the quote if they are dissatisfied, and includes polite language in the email body.

[1532] 5. Automated email sending

[1533] The server generates the email body, adjusts the content based on the sentiment, and then attaches "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf" and sends the email to "customer12345@domain.com".

[1534] Prompt Sentence Examples

[1535] "Please extract past requests from company number 12345 and generate quotes and application forms. Please add appropriate content based on user sentiment."

[1536] The present invention makes it possible to provide a more personalized response that takes into account the user's feelings, thereby improving customer satisfaction and increasing business efficiency.

[1537] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1538] Step 1:

[1539] The user enters the company number into the input form on the terminal and clicks the "Submit" button.

[1540] Input: Company number (e.g. "12345")

[1541] Output: Request with company number sent to server

[1542] Specific operation: The user enters the company number "12345", and the terminal generates an HTTP request to send the company number to the server.

[1543] Step 2:

[1544] The device sends the company number to the server, and at the same time, collects the user's facial expressions and tone of voice and sends emotional data to the server.

[1545] Input: Company number, user facial expression data, voice data

[1546] Output: A request with company number and emotion data sent to the server

[1547] Specific operation: The device sends the company number "12345" and the emotion data collected using the camera and microphone to the server as an HTTP request.

[1548] Step 3:

[1549] The server receives the company number and accesses the database to search and extract past requests.

[1550] Input: Company Number

[1551] Output: Data of past requests (e.g. "Project A" and "Project B")

[1552] Specific operation: The server extracts the company number "12345" from the HTTP request and queries the MySQL database to retrieve past requests "Project A" and "Project B."

[1553] Step 4:

[1554] The server retrieves quotation and application form templates, embeds the extracted request information, and automatically generates them in PDF format.

[1555] Input: Data of past request cases ("Case A" and "Case B")

[1556] Output: PDF file (quote and application form)

[1557] Specific operation: The server retrieves the template using the Google Docs API, fills in the project details, and generates "Quotation_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf".

[1558] Step 5:

[1559] The server analyzes the received emotion data and adjusts the contents of the estimate and application form.

[1560] Input: Emotion data, PDF files (quote and application form)

[1561] Output: Adjusted PDF file

[1562] What it does: The server analyzes the emotion data with IBM Watson Tone Analyzer, and if dissatisfaction is detected, it adds a special discount to the quote and regenerates the PDF file.

[1563] Step 6:

[1564] The server generates the email body using an email template, adjusts it based on the results of sentiment analysis, and automatically sends the adjusted email body and PDF file to the customer.

[1565] Input: Modified PDF file, emotion data

[1566] Output: Sent email (PDF file attached)

[1567] What happens: The server retrieves the email template, adjusts the content and tone based on the sentiment analysis, and sends the email to "customer12345@domain.com" using the SMTP server.

[1568] This allows the user to input specific information, and the system automatically processes and adjusts past requests, and then efficiently completes the entire process, from sending the generated document as a PDF file to the customer.

[1569] (Application example 2)

[1570] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1571] While the conventional system was functionally capable of automatically generating and sending estimates and application forms to customers, it was unable to provide individualized responses that took into account the customer's emotions. This limited its ability to improve customer satisfaction and service quality. Furthermore, even when a customer was feeling stressed or dissatisfied, the system would send similar documents or emails without noticing their emotions, which created an issue where it was not possible to improve the customer experience.

[1572] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes a terminal for inputting specific information about the customer, means for extracting past requests from a database based on the specific information transmitted from the terminal, means for automatically generating an estimate and an application form using the extracted information about the past requests, means for saving the generated estimate and application form in PDF format, email sending means for automatically sending the generated PDF file to the customer, emotion analysis means for collecting and analyzing user emotion data, means for adjusting the content of the estimate and application form based on the emotion analysis results, and means for adjusting the tone of the email body based on the emotion analysis results. This enables individualized responses that take customer emotions into consideration, thereby increasing customer satisfaction and improving service quality.

[1573] The "terminal for inputting customer specific information" is an electronic device for the customer to input specific information such as a company number.

[1574] The "means for extracting past requests from a database" is a method for reading relevant data from a database that records previous transaction information and request details based on specific information about the customer.

[1575] The "means for automatically generating estimates and application forms" is a function for automatically creating estimates and application forms based on the extracted past request information.

[1576] "Means of saving in PDF format" refers to a method of saving the generated estimate or application form as a PDF file, which is an electronic document format.

[1577] "An email sending method for automatically sending PDF files to customers" is a function that automatically sends saved PDF files to customers via email.

[1578] The "emotion analysis means" is a system that analyzes a user's emotions based on the user's input data and the device's sensor information.

[1579] The "means for adjusting the contents of the estimate and application form based on the results of the emotion analysis" is a function for changing and adjusting the contents of the estimate and application form based on the analyzed emotion data.

[1580] "Means for adjusting the tone of the email body based on the results of sentiment analysis" refers to a function that changes or adjusts the tone and content of an email based on the results obtained from sentiment analysis.

[1581] This invention combines a sentiment analysis engine with a system that quickly processes past requests based on repeated customer requests and automates the creation and email sending of estimates and application forms, thereby enabling responses based on user emotion recognition.

[1582] System Configuration

[1583] Hardware and Software

[1584] 1. Device:

[1585] A device used to input customer-specific information. Generally, it is assumed to be an electronic device such as a PC, smartphone, or tablet.

[1586] 2. Server:

[1587] It is a high-performance computer that performs various functions such as databases, emotion recognition, document generation, and email sending.

[1588] The software used includes a Python program, smtplib (an email sending function), FPDF (a PDF generation library), and a sentiment analysis module.

[1589] Data processing and calculation

[1590] 1. Enter and submit customer information:

[1591] The user enters specific information such as a company number into an input form on the terminal, and the entered information is sent to the server.

[1592] 2. Extraction of past requests:

[1593] The server extracts the relevant past request information from the database based on the specific information received from the terminal.

[1594] 3. Generate quotes and applications:

[1595] The server automatically generates estimates and application forms by embedding the extracted request information into templates, and the generated documents are saved in PDF format.

[1596] 4. Recognizing and responding to emotions:

[1597] When a user inputs specific information, the device collects the user's emotional data (such as facial expressions and tone of voice) and sends it to the server, where the server's emotion analysis engine analyzes the data and evaluates the user's emotions.

[1598] 5. Adjusting documents and email content:

[1599] Based on the results of emotion recognition, quotes and application forms can be tailored—for example, a special discount can be added if the user is feeling stressed—and emails can also be tailored in tone and content depending on the user's emotion.

[1600] 6. Automated emails:

[1601] The adjusted quote and application PDF files are automatically sent to the customer's email address along with a personalized email message, improving customer satisfaction through personalized service.

[1602] Specific examples

[1603] The user enters the company number "12345" into the input form and submits it. At this time, the device collects data on the user's facial expressions and tone of voice.

[1604] The server extracts information on past request cases "Case A" and "Case B" that correspond to the company number "12345" from the database.

[1605] The server automatically generates an estimate for "Project A" and an application form for "Project B" based on the template, and saves them as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf", respectively.

[1606] The emotion engine recognizes the user's emotions (e.g., dissatisfaction) and adds special discount offers to the quote.

[1607] The server generates the email body, adjusts the content based on the sentiment, and automatically sends it to "customer name@domain.com" with PDF files of the quotation and application form attached.

[1608] Prompt Sentence Examples

[1609] My company (Company ID: 12345) has done some business with you in the past. We are currently experiencing issues with late payments for the most recent transaction. We would like to resolve this issue as soon as possible. Please generate a quote and application form to address this issue and send them along with relevant emails.

[1610] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1611] Step 1:

[1612] The user enters specific information (such as a company number) into an input form on the device and submits it. The device collects the input data along with emotional data such as the user's facial expression and tone of voice. This data is then sent to the server, which measures the user's emotional state.

[1613] Step 2:

[1614] The server searches the database based on the specific information received from the terminal. Specifically, it uses the company number as a key to extract past requests (e.g., "Project A" and "Project B"). This retrieves the details of transactions the user has made in the past.

[1615] Step 3:

[1616] The server automatically generates an estimate and application form based on the extracted request information. It embeds the relevant information into a template and creates the estimate and application form. This generates PDF files such as "Estimate_12345_ProjectA.pdf" and "Application_12345_ProjectB.pdf."

[1617] Step 4:

[1618] The server saves the generated PDF files of the quote and application form, making the documents available for future reference.

[1619] Step 5:

[1620] The server receives the emotion data sent from the device and analyzes the emotion using an emotion analysis engine. Specifically, it determines whether the user is feeling dissatisfied, stressed, happy, etc. This allows the server to recognize the user's current emotional state.

[1621] Step 6:

[1622] The server adjusts quote and application forms based on the results of sentiment analysis, for example adding a special discount to a quote if the user is dissatisfied, resulting in documents that are tailored to the customer.

[1623] Step 7:

[1624] The server generates the email body based on the results of the sentiment analysis. Based on a template, the tone and content are adjusted according to the emotion. For example, if the user is feeling stressed, comforting words are included. This process creates an email body that takes the user's emotions into consideration.

[1625] Step 8:

[1626] The server automatically sends the generated quote and application form PDF files to the customer's email address along with the adjusted email body, providing users with fast and considerate service.

[1627] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1628] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1629] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1630] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1631] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1632] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1633] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1634] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1635] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1636] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1637] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1638] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1639] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1640] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1641] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1642] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1643] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1644] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1645] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1646] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1647] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1648] The following is further disclosed regarding the above embodiment.

[1649] (Claim 1)

[1650] a terminal for inputting customer specific information;

[1651] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[1652] A means for automatically generating estimates and application forms using the extracted past request information;

[1653] A means to save the generated estimate and application form in PDF format,

[1654] An email sending method to automatically send the generated PDF file to the customer,

[1655] A system including:

[1656] (Claim 2)

[1657] 10. The system of claim 1, further comprising means for embedding information required for quotes and applications into templates.

[1658] (Claim 3)

[1659] 10. The system of claim 1, further comprising means for automatically generating the email body from a template and personalizing it based on inserted customer information.

[1660] "Example 1"

[1661] (Claim 1)

[1662] a terminal for inputting customer identification information;

[1663] means for extracting past requests from a database based on the identification information transmitted from the terminal;

[1664] A means for automatically generating a document using the extracted past request information;

[1665] A means to save the generated document in PDF format;

[1666] An email sending method to automatically send the generated PDF file to the customer,

[1667] A system including:

[1668] (Claim 2)

[1669] 10. The system of claim 1, further comprising means for embedding required information for a document in a template.

[1670] (Claim 3)

[1671] 10. The system of claim 1, further comprising means for automatically generating the email body from a template and personalizing it based on inserted customer information.

[1672] "Application Example 1"

[1673] (Claim 1)

[1674] a terminal for inputting customer specific information;

[1675] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[1676] A means for automatically generating estimates and application forms using the extracted past request information;

[1677] A means to save the generated estimate and application form in PDF format,

[1678] An email sending method to automatically send the generated PDF file to the customer,

[1679] means including a smart device for accepting customer specific information by voice input;

[1680] A means for presenting work instructions in real time by voice guidance;

[1681] A system including:

[1682] (Claim 2)

[1683] 10. The system of claim 1, further comprising means for embedding information required for quotes and applications into templates.

[1684] (Claim 3)

[1685] 10. The system of claim 1, further comprising means for automatically generating the email body from a template and personalizing it based on inserted customer information.

[1686] "Example 2: Combining Emotion Engines"

[1687] (Claim 1)

[1688] a terminal for inputting customer specific information;

[1689] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[1690] A means for automatically generating estimates and application forms using the extracted past request information;

[1691] A means to save the generated estimate and application form in PDF format,

[1692] An email sending method to automatically send the generated PDF file to the customer,

[1693] A means for collecting and analyzing user emotion information;

[1694] means for adjusting the contents of the quotation and application form based on the result of the user's sentiment analysis;

[1695] a means for adjusting the email body based on the sentiment analysis results;

[1696] A system including:

[1697] (Claim 2)

[1698] 10. The system of claim 1, further comprising means for embedding information required for quotes and applications into templates.

[1699] (Claim 3)

[1700] 10. The system of claim 1, further comprising means for automatically generating email text from a template and personalizing the email text based on inserted customer information and sentiment analysis results.

[1701] "Application example 2 when combining emotion engines"

[1702] (Claim 1)

[1703] a terminal for inputting customer specific information;

[1704] means for extracting past requests from a database based on the specific information transmitted from the terminal;

[1705] A means for automatically generating estimates and application forms using the extracted past request information;

[1706] A means to save the generated estimate and application form in PDF format,

[1707] An email sending method to automatically send the generated PDF file to the customer,

[1708] A sentiment analysis means for collecting and analyzing user sentiment data;

[1709] a means for adjusting the content of the quote and application based on the sentiment analysis results;

[1710] A means to adjust the tone of the email body based on the results of sentiment analysis;

[1711] A system including:

[1712] (Claim 2)

[1713] 10. The system of claim 1, further comprising means for embedding information required for quotes and applications into templates.

[1714] (Claim 3)

[1715] 10. The system of claim 1, further comprising means for automatically generating email text from a template and personalizing the email text based on inserted customer information and means for tailoring the email content based on sentiment analysis means. [Explanation of symbols]

[1716] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a terminal for inputting customer specific information; means for extracting past requests from a database based on the specific information transmitted from the terminal; A means for automatically generating estimates and application forms using the extracted past request information; A means to save the generated estimate and application form in PDF format, An email sending method to automatically send the generated PDF file to the customer, A system including:

2. 10. The system of claim 1, further comprising means for embedding information required for quotes and applications into templates.

3. 10. The system of claim 1, further comprising means for automatically generating the email body from a template and personalizing it based on inserted customer information.

Images