system

Abstract

To provide a system that enables a user to perform consistent operations within the system and to efficiently and quickly respond to customers and create estimates. [Solution] A system including: means for accepting user authentication information and verifying the authentication information against a database for authentication; means for generating and displaying a dashboard screen for a user who has been successfully authenticated; means for displaying a screen for inputting customer information and saving the input information; means for searching and displaying past inquiry history and related proposals; means for automatically generating a quote and calculating and displaying the price and delivery date; means for allowing the contents of the quote to be modified; means for converting the quote into PDF format and making it downloadable; and means for receiving an instruction to end the session, saving the data, and ending the session.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In traditional sales activities, customer correspondence and quotation creation were often done manually, which posed a challenge, requiring a great deal of time and effort. Furthermore, in situations where quick responses that meet customer needs are required, it can be difficult to search past inquiry history or present appropriate proposals, which can result in a decline in customer satisfaction. Furthermore, manually correcting quotation details and creating PDFs is cumbersome and often results in a lack of accuracy. [Means for solving the problem]

[0005] To solve this problem, the present invention provides the following means. First, it has a means for accepting user authentication information and verifying it against a database to perform authentication. For users who are successfully authenticated, a dashboard screen is generated and displayed, allowing them to access each function of the system. It also has a means for providing a screen for entering customer information and saving the entered information. By searching and displaying past inquiry history and related suggestions, users can respond quickly and appropriately.

[0006] Furthermore, the system provides a means to automatically generate a quote based on the product selection information and quantity, and to calculate and display the price and delivery date. The user can modify the quote content, and a means is provided to convert the modified quote into PDF format and make it available for download. This improves the efficiency of creating quotes, and enables the rapid generation of highly accurate quotes. Finally, the system provides a means to save data and safely end the session when an instruction to end the session is received. This allows users to use the system with peace of mind.

[0007] "User authentication" is a method of verifying the authentication information of a user attempting to access a system against a database to confirm that the user is a legitimate user.

[0008] The "dashboard screen" is an interface provided to a user who has been successfully authenticated, for accessing various functions of the system.

[0009] "Customer information" refers to information necessary for inquiries and transactions, such as the customer's name, contact details, and needs.

[0010] A "database" is a repository of information for centrally managing customer information, past inquiry history, proposal details, etc.

[0011] "Inquiry history" is a record of the content, date and time of inquiries made by customers in the past, and the results of their responses.

[0012] A quotation is a document that lists details of the products or services to be provided to a customer, including the quantity, price, and delivery date.

[0013] "Automatic quotation generation" is the process in which the system calculates the price and delivery date based on the product information and quantity entered by the user, and generates a quotation.

[0014] "Ending a session" is the process of saving all relevant data and securely logging out when you have finished using the system.

[0015] "PDF format" is an abbreviation for Portable Document Format, a standard format for electronic documents, and a file format used to save documents such as estimates.

[0016] "Proposals" are options and ideas for products and services offered in response to customer needs. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram illustrating a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] MODE FOR CARRYING OUT THE INVENTION

[0039] The system of the present invention provides a wide range of functions, including user authentication, dashboard screen, customer information management, automatic quotation generation, PDF conversion, and session termination.

[0040] 1. User Authentication

[0041] A user accesses the system and enters their username and password on the login screen.

[0042] The terminal sends this authentication information to the server.

[0043] The server checks the authentication information sent against the registered information in the database. If the check is successful, user authentication is complete.

[0044] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[0045] The terminal displays the generated dashboard screen to the user.

[0046] 2. Customer information management

[0047] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[0048] The terminal transmits the entered customer information (e.g., customer name, contact details, needs, etc.) to the server.

[0049] The server stores the received customer information in a database.

[0050] Furthermore, the server searches the history of past inquiries and sends the results including related suggestions to the terminal.

[0051] The device displays the search results to the user and can provide appropriate responses and suggestions.

[0052] 3. Automatic quotation generation

[0053] The user selects a product or service on the dashboard and enters its quantity.

[0054] The terminal transmits the selected product information and quantity to the server.

[0055] Based on the information received by the server, the unit price and stock status of each product are referenced and an estimate is automatically generated.

[0056] The server sends the generated estimate to the terminal.

[0057] The terminal displays the estimate contents to the user, who can then check the contents and modify them as necessary.

[0058] The terminal sends the revised estimate to the server again.

[0059] The server checks the modifications, generates a final quote, and sends it to the terminal.

[0060] 4. Convert quotation to PDF

[0061] Once the final quote is confirmed, the server generates the quote in PDF format.

[0062] The server sends the generated PDF to the device.

[0063] Make sure your device is ready to download PDF files.

[0064] 5. End of session

[0065] When the user wants to end the use of the system, he clicks the end button.

[0066] The terminal sends a termination signal to the server.

[0067] The server securely stores all session data in a database and ends the user's session.

[0068] The terminal displays a message to the user confirming the end of the session.

[0069] Specific examples

[0070] Example 1: Initial quote creation process

[0071] 1. The user logs in and displays the dashboard screen.

[0072] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[0073] 3. The terminal sends the input data to the server, which stores it in a database.

[0074] 4. The server searches past inquiry history and sends the results to the terminal for display.

[0075] 5. The user selects product A and product B and enters the quantity of each.

[0076] 6. The terminal sends the product information to the server, and the server automatically generates a quote.

[0077] 7. The quotation details are displayed on the terminal, and the user can confirm and make corrections.

[0078] 8. The server regenerates the revised quote, sends it to the device, converts it to PDF format and makes it available for download.

[0079] Example 2: Proposal for repeat customers

[0080] 1. The user logs in and displays the dashboard screen.

[0081] 2. Search for the customer's name to see their past inquiry history.

[0082] 3. The server sends the search results to the device, and the user prepares appropriate suggestions.

[0083] 4. The user creates a quote based on the proposal and sends the final quote in PDF format to the customer.

[0084] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[0085] The processing flow will be explained below.

[0086] User authentication process steps

[0087] Step 1:

[0088] The user accesses the system login screen on the terminal and enters the user name and password.

[0089] Step 2:

[0090] The terminal sends the entered username and password to the server.

[0091] Step 3:

[0092] The server checks the received username and password against the credentials in its database.

[0093] Step 4:

[0094] The server sends the result of authentication success or failure to the terminal.

[0095] Step 5:

[0096] If the device is successfully authenticated, the dashboard screen will be displayed. If authentication fails, an error message will be displayed.

[0097] Enter Customer Data Processing Steps

[0098] Step 1:

[0099] The user clicks the New Enquiry button on the dashboard screen.

[0100] Step 2:

[0101] The terminal displays a new inquiry screen, and the user enters the customer's name, contact information, needs, etc.

[0102] Step 3:

[0103] The terminal transmits the entered customer information to the server.

[0104] Step 4:

[0105] The server stores the received customer information in a database.

[0106] Step 5:

[0107] The server searches a database for past query history and related suggestions.

[0108] Step 6:

[0109] The server sends the search results to the terminal.

[0110] Step 7:

[0111] The device displays the search results for the user to review.

[0112] Process steps for creating a quote

[0113] Step 1:

[0114] The user selects a product or service on the new inquiry screen and enters the quantity.

[0115] Step 2:

[0116] The terminal transmits the selected product information and quantity to the server.

[0117] Step 3:

[0118] The server calculates the product price and delivery date based on the data received.

[0119] Step 4:

[0120] The server automatically generates an estimate and sends the details to the terminal.

[0121] Step 5:

[0122] The terminal displays the estimate details, which the user can confirm and modify.

[0123] Step 6:

[0124] If the user wishes to amend the estimate, he / she inputs the amendments.

[0125] Step 7:

[0126] The terminal transmits the corrected quotation data to the server again.

[0127] Step 8:

[0128] The server transmits the regenerated quotation reflecting the corrections to the terminal.

[0129] Steps for converting quotes to PDF

[0130] Step 1:

[0131] The user clicks the button to generate the final confirmed quotation PDF.

[0132] Step 2:

[0133] The terminal sends the final confirmed quotation data to the server.

[0134] Step 3:

[0135] The server converts the quote into PDF format.

[0136] Step 4:

[0137] The server sends the generated PDF file to the terminal.

[0138] Step 5:

[0139] The device displays a downloadable link to the user.

[0140] Session termination processing steps

[0141] Step 1:

[0142] The user clicks the system shutdown button.

[0143] Step 2:

[0144] The terminal sends a termination signal to the server.

[0145] Step 3:

[0146] The server stores all session data securely in a database.

[0147] Step 4:

[0148] The server terminates the session and sends a termination confirmation message to the terminal.

[0149] Step 5:

[0150] The terminal displays a confirmation message to the user.

[0151] Example 1

[0152] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0153] Conventional customer management systems have a complicated process from user authentication to creating quotes and completing the process, making it difficult to operate efficiently and respond quickly to customers. Automatically generating quotes also requires a lot of manual corrections, which takes time and effort, reducing the efficiency of sales activities. Furthermore, the process of converting quotes into PDF format and providing them to customers is also time-consuming, creating a bottleneck in workplaces where a quick response is required.

[0154] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0155] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for searching for past inquiry history based on the customer information input by the user and providing related proposals, and means for automatically generating a quote by referring to the product unit price and inventory status based on the product information and quantity selected by the user. This allows users to perform consistent operations within the system, enabling efficient and rapid customer service and quote creation.

[0156] "User authentication" is the process of verifying access rights by checking the authentication information provided by a user when accessing a system against a database.

[0157] The "dashboard screen" is a screen that provides a user who has been successfully authenticated with an integrated interface for operating and managing the system.

[0158] "Customer information" refers to individual information such as a customer's name, contact details, and needs, and is data managed by the system.

[0159] "Inquiry history" refers to a record of inquiries received from customers in the past and responses to those inquiries.

[0160] "Quotation" means a document or data that calculates the price and delivery time of goods or services to be provided.

[0161] "PDF format" is an abbreviation for Portable Document Format, a file format that allows documents to be saved and displayed in their original layout.

[0162] A "session" refers to the period of time during which a user performs a series of operations and processes from the time the user logs in to the time the user logs out of the system.

[0163] A "database" is a system for systematically storing and managing information, and is used to store customer information, authentication information, etc.

[0164] "Searching" is the process of finding data that meets specific criteria from information in a database.

[0165] "Automatic generation" refers to the system automatically creating data or documents without human intervention.

[0166] "Stock status" is information that indicates how much of a particular product is currently in stock.

[0167] MODE FOR CARRYING OUT THE INVENTION

[0168] The system of the present invention provides multiple functions to enable users to efficiently and quickly respond to customers and create quotes. The main hardware used includes a server and a terminal (e.g., a user's PC or smartphone). The software includes a database system (e.g., MySQL (registered trademark) or PostgreSQL) and a PDF generation library (e.g., PDFKit).

[0169] User Authentication

[0170] In the user authentication process, a user first accesses the system and enters their username and password on the login screen. The terminal sends this authentication information to the server, which then checks it against the registration information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[0171] Customer information management

[0172] When a user clicks the New Inquiry button on the dashboard, a screen for entering new customer information appears. The user enters the customer's name, contact information, needs, etc., and the device sends this information to the server. The server stores the received customer information in a database, searches past inquiry history, and sends relevant suggestions to the device. The device displays the search results to the user, helping them to provide appropriate responses and suggestions.

[0173] Automatic quote generation

[0174] When a user selects a product or service on the dashboard and enters the quantity, the terminal sends this information to the server. The server references the unit price and stock status of each product and automatically generates a quote. The server then sends the generated quote to the terminal, which displays the quote details to the user. The user can check the details and make any necessary corrections. Once the corrections have been made, the quote is sent again from the terminal to the server, which checks the corrections, generates a final quote, and sends it to the terminal.

[0175] Convert quotation to PDF

[0176] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which then makes the PDF file available for download, allowing the user to easily download the quote and provide it to the customer.

[0177] Session End

[0178] When the user wants to finish using the system, he clicks the Exit button. The terminal sends an exit signal to the server, which then securely stores all session data in a database and ends the user's session. The terminal then displays a message to the user confirming the end of the session.

[0179] Specific examples

[0180] Initial quote creation process

[0181] The user logs in and displays the dashboard screen. They press the New Inquiry button and enter customer information (name, contact details, requirements). The terminal sends the entered data to the server, which saves it in a database. The server searches past inquiry history and sends the results to the terminal for display. The user selects product A and product B and enters the quantities of each. The terminal sends the product information to the server, which automatically generates a quote. The quote details are displayed on the terminal, and the user can confirm and make corrections. The server regenerates the corrected quote and sends it to the terminal, where it is converted to PDF format and made available for download.

[0182] Prompt Sentence Examples

[0183] Here is an example of a prompt to input to a generative AI model:

[0184] Customer Name:Taro Tanaka

[0185] Contact: tanaka@example.com

[0186] Requirements: New Project Quotation

[0187] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[0188] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0189] Program processing steps

[0190] User Authentication

[0191] Step 1:

[0192] Enter: The user enters their username and password into the login screen.

[0193] Action: The user clicks the "Login" button.

[0194] Output: The device sends this authentication information to the server.

[0195] Step 2:

[0196] Input: Credentials (username, password).

[0197] How it works: The server checks the received authentication information against its database.

[0198] Output: Based on the matching result, a flag indicating authentication success or failure is generated.

[0199] Step 3:

[0200] Input: Matching result.

[0201] Operation: If authentication is successful, the server generates the dashboard screen.

[0202] Output: The generated dashboard screen.

[0203] Step 4:

[0204] Input: The generated dashboard screen.

[0205] Operation: The server sends the dashboard screen to the device.

[0206] Output: The device displays the dashboard screen to the user.

[0207] Customer information management

[0208] Step 1:

[0209] Input: The user clicks the New Inquiry button and enters new customer information.

[0210] Action: Fills out a customer information form.

[0211] Output: The device sends the input data to the server.

[0212] Step 2:

[0213] Input: Customer information (name, contact details, needs, etc.).

[0214] Operation: The server stores the received customer information in a database.

[0215] Output: Save completion status.

[0216] Step 3:

[0217] Input: Customer Information.

[0218] Operation: The server searches the database for past query history.

[0219] Output: Search results (past inquiry history).

[0220] Step 4:

[0221] Input: Search results.

[0222] Operation: The server generates relevant suggestions and sends them to the device.

[0223] Output: Proposal.

[0224] Step 5:

[0225] Input: Proposal content.

[0226] Action: The device displays the suggestions to the user.

[0227] Output: The user prepares an appropriate response or suggestion.

[0228] Automatic quote generation

[0229] Step 1:

[0230] Input: The user selects a product or service and enters its quantity.

[0231] Action: Select product and enter quantity.

[0232] Output: The terminal sends product information and quantity to the server.

[0233] Step 2:

[0234] Input: Product information and quantity.

[0235] Operation: Based on the information received by the server, the product's unit price and stock status are looked up in the database.

[0236] Output: Product unit price and stock information.

[0237] Step 3:

[0238] Input: Item unit price and stock information.

[0239] Operation: The server calculates the estimated amount and automatically generates a quote.

[0240] Output: The generated quote.

[0241] Step 4:

[0242] Input: Generated quote.

[0243] Action: The server sends the quote to the device.

[0244] Output: The terminal displays the quote to the user.

[0245] Step 5:

[0246] Input: Quote details.

[0247] What happens: The user reviews the quote and makes any necessary adjustments.

[0248] Output: The corrections.

[0249] Step 6:

[0250] Input: Corrections.

[0251] Action: The device resends the revised quote to the server.

[0252] Output: Revised quote.

[0253] Step 7:

[0254] Enter: Revised quote.

[0255] Action: The server reflects the modifications and generates the final quote.

[0256] Output: Final quote.

[0257] Convert quotation to PDF

[0258] Step 1:

[0259] Enter: Final quote.

[0260] Action: The server generates a quote in PDF format.

[0261] Output: The generated PDF file.

[0262] Step 2:

[0263] Input: The generated PDF file.

[0264] Action: The server sends a PDF file to the device.

[0265] Output: The device receives the PDF file.

[0266] Step 3:

[0267] Input: PDF file.

[0268] What it does: The device makes the PDF file available for download.

[0269] Output: Download link.

[0270] Session End

[0271] Step 1:

[0272] Input: The user clicks the Finish button.

[0273] Action: Click on the Exit button.

[0274] Output: The terminal sends a termination signal to the server.

[0275] Step 2:

[0276] Input: Termination signal.

[0277] How it works: The server saves the session data to a database.

[0278] Output: Save completion status.

[0279] Step 3:

[0280] Input: Saved status.

[0281] Action: The server ends the session.

[0282] Output: A message confirming the end of the session.

[0283] Step 4:

[0284] Input: Session termination confirmation message.

[0285] Action: The terminal displays a confirmation message to the user.

[0286] Output: The user confirms the system shutdown.

[0287] (Application example 1)

[0288] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0289] Conventional customer information management and quotation creation systems are often inefficient when interactively proposing products and services. They also involve a large amount of manual work, placing a heavy burden on sales representatives and increasing the likelihood of errors. Virtual stores, in particular, require technology that can instantly obtain customer information and generate accurate quotations quickly and on the spot.

[0290] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0291] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for accepting voice input and eye gaze input using smart glasses, means for acquiring customer orders based on the voice input, automatically generating a quote and displaying it on the smart glasses, and means for converting the quote into PDF format and making it sendable via voice command. This enables interactive and efficient customer service and quote generation in a virtual store.

[0292] "User authentication" is a method of verifying the identity of a user accessing a system by checking the authentication information against a database.

[0293] The "dashboard screen" is an operation interface that is displayed to an authenticated user, and is a means for providing main functions and information in an integrated manner.

[0294] "Customer information" refers to information such as a customer's name, contact details, and needs that is entered and saved based on new inquiries and past history.

[0295] "Automatic quotation generation" is a means of automatically generating a quotation by calculating the price and delivery date based on the product information and quantity selected by the user.

[0296] "PDF conversion" is a method of converting an automatically generated quotation into a PDF format so that the user can download or send it.

[0297] "Smart glasses" are a display device worn on the head and are a wearable device that can accept voice and eye input.

[0298] "Voice input" is a means of recognizing a user's voice and processing it as instructions or information within the system.

[0299] "Eye gaze input" is an interface technology that tracks the user's gaze to perform operations and selections.

[0300] "End of session" is a method for saving data and safely closing a session when a user finishes using the system.

[0301] The present invention provides a system that covers user authentication, dashboard screen generation, customer information management, automatic quotation generation, PDF conversion, operation using voice and eye gaze input, and even session termination. The detailed form for realizing this system is shown below.

[0302] 1. User Authentication

[0303] The user enters authentication information (user name and password) to access the system. The terminal sends this authentication information to the server, which then authenticates the user by checking it against the registered information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[0304] 2. Customer information management

[0305] The user clicks the "New Inquiry" button and enters new customer information. The terminal sends the entered customer information to the server, which stores it in a database. The server then searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal then displays the search results to the user, allowing them to make appropriate responses and suggestions.

[0306] 3. Automatic quotation generation

[0307] The user selects products or services on the dashboard and enters their quantities. The terminal sends the selected product information and quantities to the server, which then uses the received information to automatically generate a quote by referencing the unit price and stock status of each product. The generated quote is sent to the terminal, where the user can check its contents. If necessary, the user can modify the quote and send it back to the server. The final quote is converted to PDF format and can be downloaded by the user.

[0308] 4. PDF Conversion

[0309] Once the final quote is confirmed, the server generates a PDF version of the quote and sends it to the device, which makes the PDF file available for download.

[0310] 5. Operation via smart glasses

[0311] The user wears the smart glasses and performs operations using voice and eye contact. For example, a customer order can be captured by voice input and a quote can be automatically generated based on that. The quote can also be converted to PDF format by voice command and instantly sent to the customer.

[0312] 6. End of session

[0313] When the user wants to finish using the system, they click the Exit button or use a voice command. The device sends an exit signal to the server, which securely stores all session data in a database and ends the user's session. The device then displays a message to the user confirming the end of the session.

[0314] Hardware and software used

[0315] Hardware: Smart glasses (e.g., head-mounted display devices)

[0316] Software: Flask (a lightweight web framework for Python), pyttsx3 (speech synthesis), speech_recognition (speech recognition), pdfkit (PDF generation)

[0317] Specific examples

[0318] A salesperson wears smart glasses and selects products while interacting with the customer. For example, if a salesperson voice-inputs, "I'd like three units of product A and two units of product B, please," the system responds, "Generating a quote... The total amount is 500 yen. Please confirm the details." If the salesperson instructs, "I've confirmed it. Please convert the quote to PDF," the system responds, "The PDF has been generated. I'll send it."

[0319] Example prompts for generative AI models

[0320] I am developing an application that generates quotes and converts them to PDFs based on customer orders obtained through voice recognition. This application uses smart glasses and is controlled by the user's gaze and voice. Please tell me the operation flow for specific voice commands.

[0321] The system enables interactive and efficient customer interaction and quote generation in a virtual store, improving sales productivity.

[0322] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0323] Step 1:

[0324] Enter and submit user credentials:

[0325] A user accesses the system and enters authentication information (user name and password) into a terminal. The terminal sends this authentication information to the server. The server compares the received authentication information with the registered information in a database, performs authentication, and returns the result to the terminal. The input is the user name and password, and the output is the authentication result.

[0326] Step 2:

[0327] Generate and display dashboard screens:

[0328] The server generates a dashboard screen for the user who has been successfully authenticated and sends it to the terminal. The terminal displays the generated dashboard screen to the user. The input is the authentication result, and the output is the display of the dashboard screen.

[0329] Step 3:

[0330] Accepting new inquiries and storing customer information:

[0331] The user clicks the New Inquiry button on the dashboard and enters customer information (e.g., customer name, contact information, needs, etc.). The terminal sends the entered customer information to the server. The server stores the received customer information in a database and searches past inquiry history. The input is customer information, and the output is the stored customer information and a display of related suggestions.

[0332] Step 4:

[0333] View past enquiry history and suggestions:

[0334] The server searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal displays the search results to the user and makes appropriate responses or suggestions based on the suggestions. The input is customer information, and the output is a display of the suggestions.

[0335] Step 5:

[0336] Auto-generate and view quotes:

[0337] The user selects a product or service on the dashboard and enters the quantity. The terminal sends the selected product information and quantity to the server. Based on the received information, the server references the unit price and stock status of each product and automatically generates a quote. The generated quote is sent to the terminal and displayed to the user. The input is product information and quantity, and the output is the quote.

[0338] Step 6:

[0339] Modify and regenerate quotes:

[0340] The user checks the quote and makes any necessary corrections. The terminal sends the corrected quote to the server. The server checks the corrected information, generates a final quote, and sends it to the terminal. The input is the corrections, and the output is the corrected quote.

[0341] Step 7:

[0342] Convert and download your quote to PDF:

[0343] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which makes the PDF file available for download by the user. The input is the final quote and the output is a PDF file.

[0344] Step 8:

[0345] Voice and gaze input with smart glasses:

[0346] The user wears smart glasses and operates them using voice and eye gaze input. For example, if the user wants to order three items of product A and two items of product B, they input the voice input. The device sends the voice input to the server, which then automatically generates a quote. The input is voice data, and the output is a display of the quote details.

[0347] Step 9:

[0348] Convert and send quotes to PDF via voice command:

[0349] The user uses a voice command to convert the quotation into PDF format and send it. The device sends this command to the server, which then converts the quotation into PDF format and sends it. The input is a voice command, and the output is the generation and transmission of a PDF file.

[0350] Step 10:

[0351] Session End:

[0352] When the user wants to finish using the system, they click the quit button or use a voice command. The device sends a quit signal to the server, which securely stores all session data and ends the session. The device then displays a message to the user confirming the end of the session. The input is the quit command, and the output is the message confirming the end of the session.

[0353] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0354] MODE FOR CARRYING OUT THE INVENTION

[0355] The system of the present invention achieves even more advanced customer service by combining user authentication, dashboard screens, customer information management, automatic quotation generation, PDF conversion, and session termination with an emotion engine that recognizes the user's emotions.

[0356] 1. User Authentication

[0357] A user accesses the system and enters a user name and password on the login screen.

[0358] The terminal sends this authentication information to the server.

[0359] The server checks the authentication information sent against the registered information in the database, and if the check is successful, user authentication is complete.

[0360] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[0361] The terminal displays the generated dashboard screen to the user.

[0362] 2. Customer information management

[0363] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[0364] The terminal sends the entered information (customer's name, contact details, needs, etc.) to the server.

[0365] The server stores the information in a database.

[0366] The server searches a database for past inquiry history and related suggestions and sends the results to the terminal.

[0367] The device displays the search results for the user to review.

[0368] 3. Automatic quotation generation

[0369] The user selects a product or service on the new inquiry screen and enters the quantity.

[0370] The terminal transmits the selected product information and quantity to the server.

[0371] The server calculates the product price and delivery date based on the received information.

[0372] The server automatically generates an estimate and sends the details to the terminal.

[0373] The terminal displays the estimate contents to the user, who then checks and modifies them.

[0374] The terminal transmits the revised quotation data to the server again.

[0375] The server will generate a new quotation reflecting the corrections and send it to the terminal.

[0376] 4. Convert quotation to PDF

[0377] The user clicks the button to generate the final confirmed quotation PDF.

[0378] The terminal sends the final confirmed quotation data to the server.

[0379] The server converts the quote into PDF format.

[0380] The server sends the generated PDF to the device.

[0381] The device displays a downloadable link to the user.

[0382] 5. End of session

[0383] The user clicks the system shutdown button.

[0384] The terminal sends a termination signal to the server.

[0385] The server stores all session data securely in a database.

[0386] The server terminates the session and sends a termination confirmation message to the terminal.

[0387] The terminal displays a confirmation message to the user.

[0388] 6. Emotion engine integration

[0389] The device sends the user's operation information and text input content to the emotion engine.

[0390] The emotion engine analyzes the user's input data and operation patterns to recognize their emotional state.

[0391] The recognized emotion data is sent to the server.

[0392] The server adjusts its response and suggestions based on the recognized emotion.

[0393] The device displays the adjustments to the user.

[0394] Specific examples

[0395] Example 1: Entering customer information and responding

[0396] 1. The user logs in and displays the dashboard screen.

[0397] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[0398] 3. The terminal sends the input data to the server, which stores it in a database.

[0399] 4. The server searches the past inquiry history and sends relevant suggestions to the terminal for display.

[0400] 5. The emotion engine analyzes the user's input data and operation patterns and sends the emotional state to the server.

[0401] 6. The server adjusts the suggestions and responses based on the recognized emotions, and sends them to the device for display.

[0402] Example 2: Checking and correcting quote details

[0403] 1. The user selects a product or service and enters its quantity.

[0404] 2. The terminal sends the selection information and quantity to the server, which then automatically generates a quote.

[0405] 3. The server sends the generated estimate to the terminal and the user confirms it.

[0406] 4. The emotion engine sends the analysis data to the server so that the user can make modifications based on their emotions.

[0407] 5. The server receives the revised quotation data and sends the regenerated quotation to the terminal.

[0408] The present invention realizes improved customer satisfaction and more efficient sales activities by recognizing the user's emotions and taking appropriate action based on those emotions.

[0409] The processing flow will be explained below.

[0410] Processing steps for entering and responding to customer information

[0411] Step 1:

[0412] The user logs in and displays the dashboard screen.

[0413] Step 2:

[0414] The user clicks the New Inquiry button and enters customer information (name, contact details, requirements).

[0415] Step 3:

[0416] The terminal transmits the entered customer information to the server.

[0417] Step 4:

[0418] The server stores the received customer information in a database.

[0419] Step 5:

[0420] The server retrieves the customer's past inquiry history and related offers from a database.

[0421] Step 6:

[0422] The server sends the search results to the terminal.

[0423] Step 7:

[0424] The device displays the search results for the user to review.

[0425] Step 8:

[0426] The device sends the user's input data and operation patterns to the emotion engine.

[0427] Step 9:

[0428] The emotion engine analyzes the user's emotional state and transmits the emotion data to the server.

[0429] Step 10:

[0430] The server adjusts the response method and suggestions based on the emotional data received.

[0431] Step 11:

[0432] The server sends the adjusted response methods and suggestions to the terminal.

[0433] Step 12:

[0434] The device displays the adjustments to the user.

[0435] Processing steps for reviewing and amending quote details

[0436] Step 1:

[0437] The user selects a product or service on the new inquiry screen and enters the quantity.

[0438] Step 2:

[0439] The terminal transmits the selected product information and quantity to the server.

[0440] Step 3:

[0441] The server calculates the product price and delivery date based on the data received.

[0442] Step 4:

[0443] The server automatically generates an estimate and sends the details to the terminal.

[0444] Step 5:

[0445] The terminal displays the estimate details and the user confirms them.

[0446] Step 6:

[0447] If the user wishes to amend the estimate, he / she inputs the amendments.

[0448] Step 7:

[0449] The terminal transmits the corrected quotation data to the server again.

[0450] Step 8:

[0451] The server transmits the regenerated quotation that reflects the corrections to the terminal.

[0452] Step 9:

[0453] The terminal transmits the user's emotional state regarding the content of the estimate to the emotion engine.

[0454] Step 10:

[0455] The emotion engine analyzes the user's emotion regarding the quote and transmits the emotion data to the server.

[0456] Step 11:

[0457] The server further adjusts the proposal and estimate based on the emotion data.

[0458] Step 12:

[0459] The server sends the adjusted content to the terminal.

[0460] Step 13:

[0461] The device displays the adjustments to the user.

[0462] Example 2

[0463] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0464] Conventional customer service systems include authentication, customer information management, automatic quotation generation, PDF conversion, and session management, but lack the ability to properly recognize the user's emotional state and respond accordingly. This limits their ability to improve customer satisfaction and streamline sales activities. Therefore, there is a need for a system that can realize more advanced customer service by recognizing the user's emotions and responding accordingly.

[0465] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0466] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it available for download, means for receiving an instruction to end the session, saving the data, and ending the session, means for analyzing the user's operation information and text input content to recognize the user's emotional state, and means for adjusting a response method and proposal content based on the user's emotional state. This makes it possible to improve customer satisfaction and streamline sales activities by recognizing the user's emotions and responding based on them.

[0467] "User authentication" is the process of receiving the authentication information of a user accessing a system and verifying it against a database.

[0468] The "dashboard screen" is an operation screen that is displayed after a user logs in, and is an interface that aggregates the system's main functions and information.

[0469] "Customer information management" is the process of inputting and saving information such as customer name, contact details, and needs that users enter when making a new inquiry.

[0470] "Inquiry history search" is a function that searches the database for past customer inquiry history and displays related suggestions to the user as needed.

[0471] "Automatic quotation generation" is a process that calculates the product price and delivery date based on the product information and quantity selected by the user, and automatically generates a quotation.

[0472] "PDF Conversion" is a function that converts the final confirmed quotation into PDF format and makes it available for download by the user.

[0473] "Session termination" is a process in which, when a user finishes operating the system, all session data is saved in a database and the connection with the system is terminated.

[0474] An "emotion engine" is an algorithm or model that analyzes user operation information and text input content to recognize the user's emotional state.

[0475] "Emotional data adjustment" is the process of adjusting the system's response methods and suggestions based on the user's recognized emotional state.

[0476] The system of the present invention is a highly functional customer support system that includes user authentication, a dashboard screen, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion engine integration. This system performs specific data processing and data calculations using various hardware and software such as those listed below.

[0477] User Authentication

[0478] User authentication is the first process that takes place when a user accesses a system. The user enters their username and password on the login screen, and the terminal sends the entered information to the server. The server compares the information with the registration information stored in a database such as MySQL, and if authentication is successful, user authentication is complete, and the server generates a dashboard screen and sends it to the terminal. For example, consider the case where John Smith logs in using his email address and password.

[0479] Dashboard screen

[0480] The dashboard screen is the first operation screen that is displayed after a user logs in, and allows access to key functions such as entering customer information, managing new inquiries, and creating quotes. When a user clicks the New Inquiry button on the dashboard, the terminal displays a screen for entering new customer information and sends the entered information to the server.

[0481] Customer information management

[0482] Customer information management is a function that manages information such as customer name, contact details, and needs that users enter when making a new inquiry. The server stores this information in a database and can search past inquiry history and provide related suggestions. For example, when a user manages an inquiry for customer Jane Doe, the device sends the information to the database, and the server searches past inquiry history and displays suggestions.

[0483] Automatic quote generation

[0484] Automatic quote generation is a function that automatically generates quotes when a user selects a product or service and enters its quantity. The terminal sends the selected product information and quantity to the server, and the server calculates the price and delivery date using NumPy or similar. For example, if a user inquires about 100 laptops, the server generates a quote and sends it to the terminal, where the user can confirm and modify it.

[0485] Convert quotation to PDF

[0486] The PDF conversion of quotations is a function that converts final confirmed quotations into PDF format and makes them available for download by users. The server uses a PDF library such as iText or PDFBox to convert the quotation to PDF and sends it to the terminal, where the user can obtain the PDF using a download link.

[0487] Session End

[0488] Session termination is the process that occurs when a user wants to end their system operation. When the user clicks the end button, the terminal sends a termination signal to the server, and the server saves all session data in a database. For example, you can use MongoDB to store session data and send a confirmation message to the terminal when the session ends.

[0489] Emotion engine integration

[0490] The emotion engine is a function that analyzes the user's operation information and text input content to recognize the user's emotional state. The server can adjust the response method and proposal content based on the emotional data sent from the emotion engine and reflect it on the device. Emotion engines often use generative AI models such as BERT and GPT-3 (registered trademark). Specific examples of prompts include "Please generate an example of customer information entered in a new inquiry" and "Please explain the step-by-step process of how a user enters product information and generates a quote based on the quantity."

[0491] The system of the present invention can improve customer satisfaction and sales efficiency by recognizing the user's emotional state and responding appropriately based on that state.

[0492] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0493] Step 1:

[0494] The user accesses the system login screen and enters their username and password.

[0495] Input: Username and Password

[0496] Data processing: The device converts input information into JSON format

[0497] Output: Transformed credentials

[0498] Step 2:

[0499] The terminal transmits the entered authentication information to the server.

[0500] Input: Credentials

[0501] Data processing: None

[0502] Output: Authentication information sent to the server

[0503] Step 3:

[0504] The server checks the submitted credentials against its database.

[0505] Input: Registration information in the database and submitted authentication information

[0506] Data operations: verifying credentials through database queries (e.g., SQL queries)

[0507] Output: Authentication result (success or failure)

[0508] Step 4:

[0509] If the authentication is successful, the server generates an authentication token, generates a dashboard screen, and sends it to the terminal.

[0510] Input: Authentication result (success)

[0511] Data processing: Generating authentication tokens, generating HTML for dashboard screens

[0512] Output: Authentication token, dashboard screen

[0513] Step 5:

[0514] The terminal receives the dashboard screen and authentication token and displays them to the user.

[0515] Input: Dashboard screen, authentication token

[0516] Data processing: None

[0517] Output: Display of dashboard screen

[0518] Step 6:

[0519] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[0520] Input: Customer information (name, contact details, needs, etc.)

[0521] Data processing: The device converts input information into JSON format

[0522] Output: Transformed customer information

[0523] Step 7:

[0524] The terminal transmits the entered customer information to the server.

[0525] Input: Customer Information

[0526] Data processing: None

[0527] Output: Customer information sent to the server

[0528] Step 8:

[0529] The server stores the customer information in a database.

[0530] Input: Customer Information

[0531] Data operation: Insertion into a database (e.g., SQL INSERT statement)

[0532] Output: Status message of successful save

[0533] Step 9:

[0534] The server searches a database for past inquiry history and related suggestions and sends them to the terminal.

[0535] Input: Customer Information

[0536] Data operation: database search (e.g. SQL SELECT statement)

[0537] Output: Search results (inquiry history, proposal details)

[0538] Step 10:

[0539] The terminal displays the search results to the user.

[0540] Input: Search results

[0541] Data processing: None

[0542] Output: Search results displayed

[0543] Step 11:

[0544] The user selects a product or service on the new inquiry screen and enters the quantity.

[0545] Input: Product information, quantity

[0546] Data processing: The device converts input information into JSON format

[0547] Output: Transformed product information and quantity

[0548] Step 12:

[0549] The terminal transmits the selected product information and quantity to the server.

[0550] Input: Product information, quantity

[0551] Data processing: None

[0552] Output: Product information and quantity sent to the server

[0553] Step 13:

[0554] The server calculates the product price and delivery date and automatically generates a quotation.

[0555] Input: Product information, quantity

[0556] Data calculation: price calculation (e.g., price calculation using NumPy), delivery date calculation

[0557] Output: Generated quote

[0558] Step 14:

[0559] The server sends the estimate to the terminal and displays it to the user.

[0560] Input: Quote

[0561] Data processing: None

[0562] Output: Quote sent to the terminal

[0563] Step 15:

[0564] The user confirms and modifies the estimate content, and the terminal transmits the modified data to the server.

[0565] Input: Revised quotation data

[0566] Data processing: The device converts the correction information into JSON format

[0567] Output: Correction information sent to the server

[0568] Step 16:

[0569] The server reflects the corrections, generates a new estimate, and sends it to the terminal.

[0570] Input: Correction information

[0571] Data calculation: Reflection of correction information, regeneration of estimate

[0572] Output: Regenerated quote

[0573] Step 17:

[0574] The user clicks the button to generate the final confirmed quotation PDF.

[0575] Input: None

[0576] Data processing: None

[0577] Output: PDF generation instruction

[0578] Step 18:

[0579] The terminal sends the final confirmed quotation data to the server.

[0580] Input: Final confirmed quotation data

[0581] Data processing: None

[0582] Output: Final confirmed quote data sent to the server

[0583] Step 19:

[0584] The server converts the quote into PDF format.

[0585] Input: Final confirmed quotation data

[0586] Data operations: PDF conversion (e.g., using iText or PDFBox)

[0587] Output: PDF file

[0588] Step 20:

[0589] The server sends the generated PDF to the device and displays a download link to the user.

[0590] Input: PDF file

[0591] Data processing: None

[0592] Output: Download link

[0593] Step 21:

[0594] The user clicks the system shutdown button.

[0595] Input: Exit instruction

[0596] Data processing: None

[0597] Output: End signal

[0598] Step 22:

[0599] The terminal sends a termination signal to the server.

[0600] Input: Termination signal

[0601] Data processing: None

[0602] Output: Termination signal sent to the server

[0603] Step 23:

[0604] The server saves all session data to a database and safely terminates the session.

[0605] Input: Termination signal

[0606] Data Computing: Storing session data (e.g., using MongoDB)

[0607] Output: Exit status message

[0608] Step 24:

[0609] The server sends a completion confirmation message to the terminal, which displays it to the user.

[0610] Input: Exit status message

[0611] Data processing: None

[0612] Output: Finish confirmation message

[0613] (Application example 2)

[0614] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0615] Conventional systems have difficulty recognizing a user's emotional state based on operational information and text input, and responding accordingly. This has led to problems such as lower customer satisfaction and inefficient sales activities. Furthermore, they are unable to provide optimal product recommendations or customer support based on the user's emotional state, limiting the quality of customer support.

[0616] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, engine means for analyzing the user's operation information and text input content to recognize the user's emotional state, means for adjusting the content of proposals and response methods based on the recognized emotional data, and means for providing optimal product suggestions and customer support based on the user's emotional state. This makes it possible to recognize the user's emotional state in real time and provide appropriate product suggestions and support based on that.

[0617] "User authentication information" refers to personal authentication data such as a username and password that a user enters to access a system.

[0618] The "dashboard screen" is an interface for displaying integrated information that is first displayed after a user logs in.

[0619] "Customer Information" is personal and business information about a user, such as name, contact details, needs, etc.

[0620] "Past inquiry history" is data that records previous contacts with users and support details.

[0621] A "quote" is a document that shows the calculated price and delivery time for a specific product or service.

[0622] The "PDF format" is a portable document format, a file format in which the document format is fixed.

[0623] "Ending a session" is the process by which a user saves all data and disconnects from the system when they have finished using the system.

[0624] An "emotion engine" is software or hardware that analyzes the user's operation information and text input content to recognize their emotional state.

[0625] "Emotion data" is information that indicates the user's emotional state analyzed by the emotion engine.

[0626] "Proposal content" refers to information about products and services that the system presents based on the user's needs and emotional state.

[0627] "Response method" is a method that indicates the response procedures and actions that the system should take depending on the user's emotional state.

[0628] The present invention is an application for an online shopping site that improves customer satisfaction by using a system that integrates an emotion recognition engine to provide optimal product suggestions and customer support in response to the user's emotions. A specific embodiment of the system is described below.

[0629] Hardware and Software:

[0630] The system includes a smartphone, a server, a database, and an emotion engine. Specifically, it has the following configuration:

[0631] Smartphone: A device on which a user operates applications.

[0632] Server: A central computing device responsible for authentication, data processing, and sentiment analysis.

[0633] Database: Used to store customer information, past inquiry history, and product information.

[0634] Emotion engine: Software that analyzes user input data and operation patterns to recognize emotional states (e.g., Emotion Engine API).

[0635] Program processing:

[0636] The server performs user authentication, dashboard generation, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion recognition, making suggestions and responding based on the emotion.

[0637] 1. User authentication:

[0638] A user accesses the app using a smartphone and enters authentication information (user name, password) on the login screen. The server collates this authentication information with the database to authenticate the user, and if authentication is successful, a dashboard screen is generated and displayed on the smartphone.

[0639] 2. Dashboard generation:

[0640] Authenticated users are provided with a dashboard screen where they can make new inquiries and search for products.

[0641] 3. Customer information management:

[0642] The user enters new customer information, and the server stores the information in a database. It also searches the database for past inquiries and related suggestions and displays them to the user.

[0643] 4. Automatic quote generation:

[0644] The user selects a product or service and submits a quote. The server calculates the price and delivery time, generates a quote, and sends it to the smartphone in a format that can be modified.

[0645] 5. PDF Conversion:

[0646] Once the user has finalized the quotation, it will be converted into a PDF format and a downloadable link will be provided.

[0647] 6. End of session:

[0648] When the user tells the system to exit, the server securely stores all session data in a database and ends the session.

[0649] 7. Emotion Recognition and Suggestion:

[0650] The user's operation information and text input are sent to the emotion engine to recognize their emotional state. Based on the recognized emotional data, the server adjusts the suggestions and response methods. For example, if the user is feeling stressed, it will suggest relaxation items and provide support methods to calm the user's emotions.

[0651] Examples:

[0652] Emotion recognition during product search:

[0653] If the server detects feelings of stress while the user is searching for relaxation items, it will suggest a massage chair or an aroma diffuser.

[0654] Customer support optimization:

[0655] When the emotion engine recognizes negative emotions, the server immediately connects with appropriate support staff to provide support to the user.

[0656] Example prompt sentence:

[0657] "This user's operation patterns and text input suggest feelings of stress. Please suggest relaxation items."

[0658] "Users are happy, so please suggest related popular products."

[0659] By implementing this invention, it is possible to recognize the user's emotional state in real time and provide appropriate product suggestions and support based on that information, thereby improving customer satisfaction and streamlining sales activities.

[0660] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0661] Program processing steps

[0662] Step 1: Handling user authentication

[0663] The terminal accepts user authentication information (user name, password). The entered authentication information is sent to the server. The server compares it with a database and determines whether the authentication was successful. If successful, a dashboard screen is generated and sent to the terminal. The terminal displays the dashboard screen.

[0664] Step 2: Enter and save customer information

[0665] The user enters customer information (name, contact details, needs) for a new inquiry. The device sends the entered data to the server. The server stores this data in a database. The server searches past inquiry history and related suggestions and sends them to the device. The device displays the search results.

[0666] Step 3: Auto-generate and modify quotes

[0667] The user selects a product or service and enters its quantity. The terminal sends the selection information and quantity to the server. The server calculates the price and delivery date and automatically generates a quote. The generated quote is sent to the terminal and the user confirms it. The user modifies the quote as needed and sends it again from the terminal to the server. The server regenerates a quote reflecting the modifications and sends it to the terminal.

[0668] Step 4: Convert and download the quote to PDF

[0669] The user presses a button to convert the final confirmed quotation into PDF format. The device sends the quotation data to the server. The server converts the quotation into PDF format and sends the generated PDF to the device. The device displays a downloadable link to the user.

[0670] Step 5: Emotion Recognition Processing

[0671] The device sends the user's operation information and text input to the emotion engine. The emotion engine analyzes this data and recognizes the user's emotional state. The recognized emotion data is sent to the server. The server adjusts the suggestions and response methods based on the recognized emotion data. The device displays the adjusted content to the user.

[0672] Step 6: Ending the session

[0673] The user presses the system's end button. The terminal sends an end signal to the server. The server saves the session data in a database and ends the session. A termination confirmation message is sent to the terminal, which displays it to the user.

[0674] Detailed explanation of the processing steps

[0675] Step 1: Handling user authentication

[0676] Input: Username, Password

[0677] How it works: The device receives a username and password from the user and sends them to the server, which checks them against the authentication information stored in the database. If authentication is successful, the server generates a dashboard screen and sends it to the device.

[0678] Output: Dashboard screen

[0679] Step 2: Enter and save customer information

[0680] Input: Customer information (name, contact details, needs)

[0681] How it works: A user enters customer information into a device, which then sends the data to a server. The server stores the customer information in a database, searches past inquiries and related suggestions, and sends the results to the device. The device then displays the search results.

[0682] Output: Display of saved customer information, inquiry history, and suggestions

[0683] Step 3: Auto-generate and modify quotes

[0684] Input: Product information, quantity

[0685] How it works: The user selects a product or service and enters the quantity. The device sends that information to the server, which calculates the price and delivery date and generates a quote. The generated quote is sent to the device and displayed to the user. If the user makes any changes, the changes are sent from the device to the server again. The server regenerates a quote reflecting the changes and sends it to the device.

[0686] Output: Quote, revised quote

[0687] Step 4: Convert and download the quote to PDF

[0688] Input: Final Confirmed Quote

[0689] Operation: When the user presses the PDF conversion button, the device sends the quote data to the server. The server converts the quote to PDF format and sends the PDF to the device. The device displays a downloadable link to the user.

[0690] Output: PDF quote and download link

[0691] Step 5: Emotion Recognition Processing

[0692] Input: Operation information, text input content

[0693] How it works: The device sends the user's operation information and text input to the emotion engine. The emotion engine analyzes the data to recognize the user's emotional state and sends that emotional data to the server. The server adjusts the suggestions and response methods based on the emotional data and sends the adjustment results to the device. The device then displays the adjusted content to the user.

[0694] Output: Recognized emotion data, adjusted suggestions

[0695] Step 6: Ending the session

[0696] Input: End signal

[0697] Operation: When the user presses the quit button, the terminal sends a quit signal to the server. The server saves the session data in a database and terminates the session. A quit confirmation message is sent to the terminal, which displays it to the user.

[0698] Output: Finish confirmation message

[0699] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0700] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0701] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0702] [Second embodiment]

[0703] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0704] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0705] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0706] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0707] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0708] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0709] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0710] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0711] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0712] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0713] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0714] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0715] MODE FOR CARRYING OUT THE INVENTION

[0716] The system of the present invention provides a wide range of functions, including user authentication, dashboard screen, customer information management, automatic quotation generation, PDF conversion, and session termination.

[0717] 1. User Authentication

[0718] A user accesses the system and enters their username and password on the login screen.

[0719] The terminal sends this authentication information to the server.

[0720] The server checks the authentication information sent against the registered information in the database. If the check is successful, user authentication is complete.

[0721] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[0722] The terminal displays the generated dashboard screen to the user.

[0723] 2. Customer information management

[0724] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[0725] The terminal transmits the entered customer information (e.g., customer name, contact details, needs, etc.) to the server.

[0726] The server stores the received customer information in a database.

[0727] Furthermore, the server searches the history of past inquiries and sends the results including related suggestions to the terminal.

[0728] The device displays the search results to the user and can provide appropriate responses and suggestions.

[0729] 3. Automatic quotation generation

[0730] The user selects a product or service on the dashboard and enters its quantity.

[0731] The terminal transmits the selected product information and quantity to the server.

[0732] Based on the information received by the server, the unit price and stock status of each product are referenced and an estimate is automatically generated.

[0733] The server sends the generated estimate to the terminal.

[0734] The terminal displays the estimate contents to the user, who can then check the contents and modify them as necessary.

[0735] The terminal sends the revised estimate to the server again.

[0736] The server checks the modifications, generates a final quote, and sends it to the terminal.

[0737] 4. Convert quotation to PDF

[0738] Once the final quote is confirmed, the server generates the quote in PDF format.

[0739] The server sends the generated PDF to the device.

[0740] Make sure your device is ready to download PDF files.

[0741] 5. End of session

[0742] When the user wants to end the use of the system, he clicks the end button.

[0743] The terminal sends a termination signal to the server.

[0744] The server securely stores all session data in a database and ends the user's session.

[0745] The terminal displays a message to the user confirming the end of the session.

[0746] Specific examples

[0747] Example 1: Initial quote creation process

[0748] 1. The user logs in and displays the dashboard screen.

[0749] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[0750] 3. The terminal sends the input data to the server, which stores it in a database.

[0751] 4. The server searches past inquiry history and sends the results to the terminal for display.

[0752] 5. The user selects product A and product B and enters the quantity of each.

[0753] 6. The terminal sends the product information to the server, and the server automatically generates a quote.

[0754] 7. The quotation details are displayed on the terminal, and the user can confirm and make corrections.

[0755] 8. The server regenerates the revised quote, sends it to the device, converts it to PDF format and makes it available for download.

[0756] Example 2: Proposal for repeat customers

[0757] 1. The user logs in and displays the dashboard screen.

[0758] 2. Search for the customer's name to see their past inquiry history.

[0759] 3. The server sends the search results to the device, and the user prepares appropriate suggestions.

[0760] 4. The user creates a quote based on the proposal and sends the final quote in PDF format to the customer.

[0761] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[0762] The processing flow will be explained below.

[0763] User authentication process steps

[0764] Step 1:

[0765] The user accesses the system login screen on the terminal and enters the user name and password.

[0766] Step 2:

[0767] The terminal sends the entered username and password to the server.

[0768] Step 3:

[0769] The server checks the received username and password against the credentials in its database.

[0770] Step 4:

[0771] The server sends the result of authentication success or failure to the terminal.

[0772] Step 5:

[0773] If the device is successfully authenticated, the dashboard screen will be displayed. If authentication fails, an error message will be displayed.

[0774] Enter Customer Data Processing Steps

[0775] Step 1:

[0776] The user clicks the New Enquiry button on the dashboard screen.

[0777] Step 2:

[0778] The terminal displays a new inquiry screen, and the user enters the customer's name, contact information, needs, etc.

[0779] Step 3:

[0780] The terminal transmits the entered customer information to the server.

[0781] Step 4:

[0782] The server stores the received customer information in a database.

[0783] Step 5:

[0784] The server searches a database for past query history and related suggestions.

[0785] Step 6:

[0786] The server sends the search results to the terminal.

[0787] Step 7:

[0788] The device displays the search results for the user to review.

[0789] Process steps for creating a quote

[0790] Step 1:

[0791] The user selects a product or service on the new inquiry screen and enters the quantity.

[0792] Step 2:

[0793] The terminal transmits the selected product information and quantity to the server.

[0794] Step 3:

[0795] The server calculates the product price and delivery date based on the data received.

[0796] Step 4:

[0797] The server automatically generates an estimate and sends the details to the terminal.

[0798] Step 5:

[0799] The terminal displays the estimate details, which the user can confirm and modify.

[0800] Step 6:

[0801] If the user wishes to amend the estimate, he / she inputs the amendments.

[0802] Step 7:

[0803] The terminal transmits the corrected quotation data to the server again.

[0804] Step 8:

[0805] The server transmits the regenerated quotation reflecting the corrections to the terminal.

[0806] Steps for converting quotes to PDF

[0807] Step 1:

[0808] The user clicks the button to generate the final confirmed quotation PDF.

[0809] Step 2:

[0810] The terminal sends the final confirmed quotation data to the server.

[0811] Step 3:

[0812] The server converts the quote into PDF format.

[0813] Step 4:

[0814] The server sends the generated PDF file to the terminal.

[0815] Step 5:

[0816] The device displays a downloadable link to the user.

[0817] Session termination processing steps

[0818] Step 1:

[0819] The user clicks the system shutdown button.

[0820] Step 2:

[0821] The terminal sends a termination signal to the server.

[0822] Step 3:

[0823] The server stores all session data securely in a database.

[0824] Step 4:

[0825] The server terminates the session and sends a termination confirmation message to the terminal.

[0826] Step 5:

[0827] The terminal displays a confirmation message to the user.

[0828] Example 1

[0829] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0830] Conventional customer management systems have a complicated process from user authentication to creating quotes and completing the process, making it difficult to operate efficiently and respond quickly to customers. Automatically generating quotes also requires a lot of manual corrections, which takes time and effort, reducing the efficiency of sales activities. Furthermore, the process of converting quotes into PDF format and providing them to customers is also time-consuming, creating a bottleneck in workplaces where a quick response is required.

[0831] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0832] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for searching for past inquiry history based on the customer information input by the user and providing related proposals, and means for automatically generating a quote by referring to the product unit price and inventory status based on the product information and quantity selected by the user. This allows users to perform consistent operations within the system, enabling efficient and rapid customer service and quote creation.

[0833] "User authentication" is the process of verifying access rights by checking the authentication information provided by a user when accessing a system against a database.

[0834] The "dashboard screen" is a screen that provides a user who has been successfully authenticated with an integrated interface for operating and managing the system.

[0835] "Customer information" refers to individual information such as a customer's name, contact details, and needs, and is data managed by the system.

[0836] "Inquiry history" refers to a record of inquiries received from customers in the past and responses to those inquiries.

[0837] "Quotation" means a document or data that calculates the price and delivery time of goods or services to be provided.

[0838] "PDF format" is an abbreviation for Portable Document Format, a file format that allows documents to be saved and displayed in their original layout.

[0839] A "session" refers to the period of time during which a user performs a series of operations and processes from the time the user logs in to the time the user logs out of the system.

[0840] A "database" is a system for systematically storing and managing information, and is used to store customer information, authentication information, etc.

[0841] "Searching" is the process of finding data that meets specific criteria from information in a database.

[0842] "Automatic generation" refers to the system automatically creating data or documents without human intervention.

[0843] "Stock status" is information that indicates how much of a particular product is currently in stock.

[0844] MODE FOR CARRYING OUT THE INVENTION

[0845] The system of the present invention provides multiple functions to enable users to efficiently and quickly respond to customers and create quotes. The main hardware used includes a server and a terminal (e.g., a user's PC or smartphone). The software includes a database system (e.g., MySQL or PostgreSQL) and a PDF generation library (e.g., PDFKit).

[0846] User Authentication

[0847] In the user authentication process, a user first accesses the system and enters their username and password on the login screen. The terminal sends this authentication information to the server, which then checks it against the registration information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[0848] Customer information management

[0849] When a user clicks the New Inquiry button on the dashboard, a screen for entering new customer information appears. The user enters the customer's name, contact information, needs, etc., and the device sends this information to the server. The server stores the received customer information in a database, searches past inquiry history, and sends relevant suggestions to the device. The device displays the search results to the user, helping them to provide appropriate responses and suggestions.

[0850] Automatic quote generation

[0851] When a user selects a product or service on the dashboard and enters the quantity, the terminal sends this information to the server. The server references the unit price and stock status of each product and automatically generates a quote. The server then sends the generated quote to the terminal, which displays the quote details to the user. The user can check the details and make any necessary corrections. Once the corrections have been made, the quote is sent again from the terminal to the server, which checks the corrections, generates a final quote, and sends it to the terminal.

[0852] Convert quotation to PDF

[0853] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which then makes the PDF file available for download, allowing the user to easily download the quote and provide it to the customer.

[0854] Session End

[0855] When the user wants to finish using the system, he clicks the Exit button. The terminal sends an exit signal to the server, which then securely stores all session data in a database and ends the user's session. The terminal then displays a message to the user confirming the end of the session.

[0856] Specific examples

[0857] Initial quote creation process

[0858] The user logs in and displays the dashboard screen. They press the New Inquiry button and enter customer information (name, contact details, requirements). The terminal sends the entered data to the server, which saves it in a database. The server searches past inquiry history and sends the results to the terminal for display. The user selects product A and product B and enters the quantities of each. The terminal sends the product information to the server, which automatically generates a quote. The quote details are displayed on the terminal, and the user can confirm and make corrections. The server regenerates the corrected quote and sends it to the terminal, where it is converted to PDF format and made available for download.

[0859] Prompt Sentence Examples

[0860] Here is an example of a prompt to input to a generative AI model:

[0861] Customer Name:Taro Tanaka

[0862] Contact: tanaka@example.com

[0863] Requirements: New Project Quotation

[0864] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[0865] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0866] Program processing steps

[0867] User Authentication

[0868] Step 1:

[0869] Enter: The user enters their username and password into the login screen.

[0870] Action: The user clicks the "Login" button.

[0871] Output: The device sends this authentication information to the server.

[0872] Step 2:

[0873] Input: Credentials (username, password).

[0874] How it works: The server checks the received authentication information against its database.

[0875] Output: Based on the matching result, a flag indicating authentication success or failure is generated.

[0876] Step 3:

[0877] Input: Matching result.

[0878] Operation: If authentication is successful, the server generates the dashboard screen.

[0879] Output: The generated dashboard screen.

[0880] Step 4:

[0881] Input: The generated dashboard screen.

[0882] Operation: The server sends the dashboard screen to the device.

[0883] Output: The device displays the dashboard screen to the user.

[0884] Customer information management

[0885] Step 1:

[0886] Input: The user clicks the New Inquiry button and enters new customer information.

[0887] Action: Fills out a customer information form.

[0888] Output: The device sends the input data to the server.

[0889] Step 2:

[0890] Input: Customer information (name, contact details, needs, etc.).

[0891] Operation: The server stores the received customer information in a database.

[0892] Output: Save completion status.

[0893] Step 3:

[0894] Input: Customer Information.

[0895] Operation: The server searches the database for past query history.

[0896] Output: Search results (past inquiry history).

[0897] Step 4:

[0898] Input: Search results.

[0899] Operation: The server generates relevant suggestions and sends them to the device.

[0900] Output: Proposal.

[0901] Step 5:

[0902] Input: Proposal content.

[0903] Action: The device displays the suggestions to the user.

[0904] Output: The user prepares an appropriate response or suggestion.

[0905] Automatic quote generation

[0906] Step 1:

[0907] Input: The user selects a product or service and enters its quantity.

[0908] Action: Select product and enter quantity.

[0909] Output: The terminal sends product information and quantity to the server.

[0910] Step 2:

[0911] Input: Product information and quantity.

[0912] Operation: Based on the information received by the server, the product's unit price and stock status are looked up in the database.

[0913] Output: Product unit price and stock information.

[0914] Step 3:

[0915] Input: Item unit price and stock information.

[0916] Operation: The server calculates the estimated amount and automatically generates a quote.

[0917] Output: The generated quote.

[0918] Step 4:

[0919] Input: Generated quote.

[0920] Action: The server sends the quote to the device.

[0921] Output: The terminal displays the quote to the user.

[0922] Step 5:

[0923] Input: Quote details.

[0924] What happens: The user reviews the quote and makes any necessary adjustments.

[0925] Output: The corrections.

[0926] Step 6:

[0927] Input: Corrections.

[0928] Action: The device resends the revised quote to the server.

[0929] Output: Revised quote.

[0930] Step 7:

[0931] Enter: Revised quote.

[0932] Action: The server reflects the modifications and generates the final quote.

[0933] Output: Final quote.

[0934] Convert quotation to PDF

[0935] Step 1:

[0936] Enter: Final quote.

[0937] Action: The server generates a quote in PDF format.

[0938] Output: The generated PDF file.

[0939] Step 2:

[0940] Input: The generated PDF file.

[0941] Action: The server sends a PDF file to the device.

[0942] Output: The device receives the PDF file.

[0943] Step 3:

[0944] Input: PDF file.

[0945] What it does: The device makes the PDF file available for download.

[0946] Output: Download link.

[0947] Session End

[0948] Step 1:

[0949] Input: The user clicks the Finish button.

[0950] Action: Click on the Exit button.

[0951] Output: The terminal sends a termination signal to the server.

[0952] Step 2:

[0953] Input: Termination signal.

[0954] How it works: The server saves the session data to a database.

[0955] Output: Save completion status.

[0956] Step 3:

[0957] Input: Saved status.

[0958] Action: The server ends the session.

[0959] Output: A message confirming the end of the session.

[0960] Step 4:

[0961] Input: Session termination confirmation message.

[0962] Action: The terminal displays a confirmation message to the user.

[0963] Output: The user confirms the system shutdown.

[0964] (Application example 1)

[0965] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0966] Conventional customer information management and quotation creation systems are often inefficient when interactively proposing products and services. They also involve a large amount of manual work, placing a heavy burden on sales representatives and increasing the likelihood of errors. Virtual stores, in particular, require technology that can instantly obtain customer information and generate accurate quotations quickly and on the spot.

[0967] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0968] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for accepting voice input and eye gaze input using smart glasses, means for acquiring customer orders based on the voice input, automatically generating a quote and displaying it on the smart glasses, and means for converting the quote into PDF format and making it sendable via voice command. This enables interactive and efficient customer service and quote generation in a virtual store.

[0969] "User authentication" is a method of verifying the identity of a user accessing a system by checking the authentication information against a database.

[0970] The "dashboard screen" is an operation interface that is displayed to an authenticated user, and is a means for providing main functions and information in an integrated manner.

[0971] "Customer information" refers to information such as a customer's name, contact details, and needs that is entered and saved based on new inquiries and past history.

[0972] "Automatic quotation generation" is a means of automatically generating a quotation by calculating the price and delivery date based on the product information and quantity selected by the user.

[0973] "PDF conversion" is a method of converting an automatically generated quotation into a PDF format so that the user can download or send it.

[0974] "Smart glasses" are a display device worn on the head and are a wearable device that can accept voice and eye input.

[0975] "Voice input" is a means of recognizing a user's voice and processing it as instructions or information within the system.

[0976] "Eye gaze input" is an interface technology that tracks the user's gaze to perform operations and selections.

[0977] "End of session" is a method for saving data and safely closing a session when a user finishes using the system.

[0978] The present invention provides a system that covers user authentication, dashboard screen generation, customer information management, automatic quotation generation, PDF conversion, operation using voice and eye gaze input, and even session termination. The detailed form for realizing this system is shown below.

[0979] 1. User Authentication

[0980] The user enters authentication information (user name and password) to access the system. The terminal sends this authentication information to the server, which then authenticates the user by checking it against the registered information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[0981] 2. Customer information management

[0982] The user clicks the "New Inquiry" button and enters new customer information. The terminal sends the entered customer information to the server, which stores it in a database. The server then searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal then displays the search results to the user, allowing them to make appropriate responses and suggestions.

[0983] 3. Automatic quotation generation

[0984] The user selects products or services on the dashboard and enters their quantities. The terminal sends the selected product information and quantities to the server, which then uses the received information to automatically generate a quote by referencing the unit price and stock status of each product. The generated quote is sent to the terminal, where the user can check its contents. If necessary, the user can modify the quote and send it back to the server. The final quote is converted to PDF format and can be downloaded by the user.

[0985] 4. PDF Conversion

[0986] Once the final quote is confirmed, the server generates a PDF version of the quote and sends it to the device, which makes the PDF file available for download.

[0987] 5. Operation via smart glasses

[0988] The user wears the smart glasses and performs operations using voice and eye contact. For example, a customer order can be captured by voice input and a quote can be automatically generated based on that. The quote can also be converted to PDF format by voice command and instantly sent to the customer.

[0989] 6. End of session

[0990] When the user wants to finish using the system, they click the Exit button or use a voice command. The device sends an exit signal to the server, which securely stores all session data in a database and ends the user's session. The device then displays a message to the user confirming the end of the session.

[0991] Hardware and software used

[0992] Hardware: Smart glasses (e.g., head-mounted display devices)

[0993] Software: Flask (a lightweight web framework for Python), pyttsx3 (speech synthesis), speech_recognition (speech recognition), pdfkit (PDF generation)

[0994] Specific examples

[0995] A salesperson wears smart glasses and selects products while interacting with the customer. For example, if a salesperson voice-inputs, "I'd like three units of product A and two units of product B, please," the system responds, "Generating a quote... The total amount is 500 yen. Please confirm the details." If the salesperson instructs, "I've confirmed it. Please convert the quote to PDF," the system responds, "The PDF has been generated. I'll send it."

[0996] Example prompts for generative AI models

[0997] I am developing an application that generates quotes and converts them to PDFs based on customer orders obtained through voice recognition. This application uses smart glasses and is controlled by the user's gaze and voice. Please tell me the operation flow for specific voice commands.

[0998] The system enables interactive and efficient customer interaction and quote generation in a virtual store, improving sales productivity.

[0999] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1000] Step 1:

[1001] Enter and submit user credentials:

[1002] A user accesses the system and enters authentication information (user name and password) into a terminal. The terminal sends this authentication information to the server. The server compares the received authentication information with the registered information in a database, performs authentication, and returns the result to the terminal. The input is the user name and password, and the output is the authentication result.

[1003] Step 2:

[1004] Generate and display dashboard screens:

[1005] The server generates a dashboard screen for the user who has been successfully authenticated and sends it to the terminal. The terminal displays the generated dashboard screen to the user. The input is the authentication result, and the output is the display of the dashboard screen.

[1006] Step 3:

[1007] Accepting new inquiries and storing customer information:

[1008] The user clicks the New Inquiry button on the dashboard and enters customer information (e.g., customer name, contact information, needs, etc.). The terminal sends the entered customer information to the server. The server stores the received customer information in a database and searches past inquiry history. The input is customer information, and the output is the stored customer information and a display of related suggestions.

[1009] Step 4:

[1010] View past enquiry history and suggestions:

[1011] The server searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal displays the search results to the user and makes appropriate responses or suggestions based on the suggestions. The input is customer information, and the output is a display of the suggestions.

[1012] Step 5:

[1013] Auto-generate and view quotes:

[1014] The user selects a product or service on the dashboard and enters the quantity. The terminal sends the selected product information and quantity to the server. Based on the received information, the server references the unit price and stock status of each product and automatically generates a quote. The generated quote is sent to the terminal and displayed to the user. The input is product information and quantity, and the output is the quote.

[1015] Step 6:

[1016] Modify and regenerate quotes:

[1017] The user checks the quote and makes any necessary corrections. The terminal sends the corrected quote to the server. The server checks the corrected information, generates a final quote, and sends it to the terminal. The input is the corrections, and the output is the corrected quote.

[1018] Step 7:

[1019] Convert and download your quote to PDF:

[1020] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which makes the PDF file available for download by the user. The input is the final quote and the output is a PDF file.

[1021] Step 8:

[1022] Voice and gaze input with smart glasses:

[1023] The user wears smart glasses and operates them using voice and eye gaze input. For example, if the user wants to order three items of product A and two items of product B, they input the voice input. The device sends the voice input to the server, which then automatically generates a quote. The input is voice data, and the output is a display of the quote details.

[1024] Step 9:

[1025] Convert and send quotes to PDF via voice command:

[1026] The user uses a voice command to convert the quotation into PDF format and send it. The device sends this command to the server, which then converts the quotation into PDF format and sends it. The input is a voice command, and the output is the generation and transmission of a PDF file.

[1027] Step 10:

[1028] Session End:

[1029] When the user wants to finish using the system, they click the quit button or use a voice command. The device sends a quit signal to the server, which securely stores all session data and ends the session. The device then displays a message to the user confirming the end of the session. The input is the quit command, and the output is the message confirming the end of the session.

[1030] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1031] MODE FOR CARRYING OUT THE INVENTION

[1032] The system of the present invention achieves even more advanced customer service by combining user authentication, dashboard screens, customer information management, automatic quotation generation, PDF conversion, and session termination with an emotion engine that recognizes the user's emotions.

[1033] 1. User Authentication

[1034] A user accesses the system and enters a user name and password on the login screen.

[1035] The terminal sends this authentication information to the server.

[1036] The server checks the authentication information sent against the registered information in the database, and if the check is successful, user authentication is complete.

[1037] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[1038] The terminal displays the generated dashboard screen to the user.

[1039] 2. Customer information management

[1040] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[1041] The terminal sends the entered information (customer's name, contact details, needs, etc.) to the server.

[1042] The server stores the information in a database.

[1043] The server searches a database for past inquiry history and related suggestions and sends the results to the terminal.

[1044] The device displays the search results for the user to review.

[1045] 3. Automatic quotation generation

[1046] The user selects a product or service on the new inquiry screen and enters the quantity.

[1047] The terminal transmits the selected product information and quantity to the server.

[1048] The server calculates the product price and delivery date based on the received information.

[1049] The server automatically generates an estimate and sends the details to the terminal.

[1050] The terminal displays the estimate contents to the user, who then checks and modifies them.

[1051] The terminal transmits the revised quotation data to the server again.

[1052] The server will generate a new quotation reflecting the corrections and send it to the terminal.

[1053] 4. Convert quotation to PDF

[1054] The user clicks the button to generate the final confirmed quotation PDF.

[1055] The terminal sends the final confirmed quotation data to the server.

[1056] The server converts the quote into PDF format.

[1057] The server sends the generated PDF to the device.

[1058] The device displays a downloadable link to the user.

[1059] 5. End of session

[1060] The user clicks the system shutdown button.

[1061] The terminal sends a termination signal to the server.

[1062] The server stores all session data securely in a database.

[1063] The server terminates the session and sends a termination confirmation message to the terminal.

[1064] The terminal displays a confirmation message to the user.

[1065] 6. Emotion engine integration

[1066] The device sends the user's operation information and text input content to the emotion engine.

[1067] The emotion engine analyzes the user's input data and operation patterns to recognize their emotional state.

[1068] The recognized emotion data is sent to the server.

[1069] The server adjusts its response and suggestions based on the recognized emotion.

[1070] The device displays the adjustments to the user.

[1071] Specific examples

[1072] Example 1: Entering customer information and responding

[1073] 1. The user logs in and displays the dashboard screen.

[1074] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[1075] 3. The terminal sends the input data to the server, which stores it in a database.

[1076] 4. The server searches the past inquiry history and sends relevant suggestions to the terminal for display.

[1077] 5. The emotion engine analyzes the user's input data and operation patterns and sends the emotional state to the server.

[1078] 6. The server adjusts the suggestions and responses based on the recognized emotions, and sends them to the device for display.

[1079] Example 2: Checking and correcting quote details

[1080] 1. The user selects a product or service and enters its quantity.

[1081] 2. The terminal sends the selection information and quantity to the server, which then automatically generates a quote.

[1082] 3. The server sends the generated estimate to the terminal and the user confirms it.

[1083] 4. The emotion engine sends the analysis data to the server so that the user can make modifications based on their emotions.

[1084] 5. The server receives the revised quotation data and sends the regenerated quotation to the terminal.

[1085] The present invention realizes improved customer satisfaction and more efficient sales activities by recognizing the user's emotions and taking appropriate action based on those emotions.

[1086] The processing flow will be explained below.

[1087] Processing steps for entering and responding to customer information

[1088] Step 1:

[1089] The user logs in and displays the dashboard screen.

[1090] Step 2:

[1091] The user clicks the New Inquiry button and enters customer information (name, contact details, requirements).

[1092] Step 3:

[1093] The terminal transmits the entered customer information to the server.

[1094] Step 4:

[1095] The server stores the received customer information in a database.

[1096] Step 5:

[1097] The server retrieves the customer's past inquiry history and related offers from a database.

[1098] Step 6:

[1099] The server sends the search results to the terminal.

[1100] Step 7:

[1101] The device displays the search results for the user to review.

[1102] Step 8:

[1103] The device sends the user's input data and operation patterns to the emotion engine.

[1104] Step 9:

[1105] The emotion engine analyzes the user's emotional state and transmits the emotion data to the server.

[1106] Step 10:

[1107] The server adjusts the response method and suggestions based on the emotional data received.

[1108] Step 11:

[1109] The server sends the adjusted response methods and suggestions to the terminal.

[1110] Step 12:

[1111] The device displays the adjustments to the user.

[1112] Processing steps for reviewing and amending quote details

[1113] Step 1:

[1114] The user selects a product or service on the new inquiry screen and enters the quantity.

[1115] Step 2:

[1116] The terminal transmits the selected product information and quantity to the server.

[1117] Step 3:

[1118] The server calculates the product price and delivery date based on the data received.

[1119] Step 4:

[1120] The server automatically generates an estimate and sends the details to the terminal.

[1121] Step 5:

[1122] The terminal displays the estimate details and the user confirms them.

[1123] Step 6:

[1124] If the user wishes to amend the estimate, he / she inputs the amendments.

[1125] Step 7:

[1126] The terminal transmits the corrected quotation data to the server again.

[1127] Step 8:

[1128] The server transmits the regenerated quotation that reflects the corrections to the terminal.

[1129] Step 9:

[1130] The terminal transmits the user's emotional state regarding the content of the estimate to the emotion engine.

[1131] Step 10:

[1132] The emotion engine analyzes the user's emotion regarding the quote and transmits the emotion data to the server.

[1133] Step 11:

[1134] The server further adjusts the proposal and estimate based on the emotion data.

[1135] Step 12:

[1136] The server sends the adjusted content to the terminal.

[1137] Step 13:

[1138] The device displays the adjustments to the user.

[1139] Example 2

[1140] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1141] Conventional customer service systems include authentication, customer information management, automatic quotation generation, PDF conversion, and session management, but lack the ability to properly recognize the user's emotional state and respond accordingly. This limits their ability to improve customer satisfaction and streamline sales activities. Therefore, there is a need for a system that can realize more advanced customer service by recognizing the user's emotions and responding accordingly.

[1142] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1143] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it available for download, means for receiving an instruction to end the session, saving the data, and ending the session, means for analyzing the user's operation information and text input content to recognize the user's emotional state, and means for adjusting a response method and proposal content based on the user's emotional state. This makes it possible to improve customer satisfaction and streamline sales activities by recognizing the user's emotions and responding based on them.

[1144] "User authentication" is the process of receiving the authentication information of a user accessing a system and verifying it against a database.

[1145] The "dashboard screen" is an operation screen that is displayed after a user logs in, and is an interface that aggregates the system's main functions and information.

[1146] "Customer information management" is the process of inputting and saving information such as customer name, contact details, and needs that users enter when making a new inquiry.

[1147] "Inquiry history search" is a function that searches the database for past customer inquiry history and displays related suggestions to the user as needed.

[1148] "Automatic quotation generation" is a process that calculates the product price and delivery date based on the product information and quantity selected by the user, and automatically generates a quotation.

[1149] "PDF Conversion" is a function that converts the final confirmed quotation into PDF format and makes it available for download by the user.

[1150] "Session termination" is a process in which, when a user finishes operating the system, all session data is saved in a database and the connection with the system is terminated.

[1151] An "emotion engine" is an algorithm or model that analyzes user operation information and text input content to recognize the user's emotional state.

[1152] "Emotional data adjustment" is the process of adjusting the system's response methods and suggestions based on the user's recognized emotional state.

[1153] The system of the present invention is a highly functional customer support system that includes user authentication, a dashboard screen, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion engine integration. This system performs specific data processing and data calculations using various hardware and software such as those listed below.

[1154] User Authentication

[1155] User authentication is the first process that takes place when a user accesses a system. The user enters their username and password on the login screen, and the terminal sends the entered information to the server. The server compares the information with the registration information stored in a database such as MySQL, and if authentication is successful, user authentication is complete, and the server generates a dashboard screen and sends it to the terminal. For example, consider the case where John Smith logs in using his email address and password.

[1156] Dashboard screen

[1157] The dashboard screen is the first operation screen that is displayed after a user logs in, and allows access to key functions such as entering customer information, managing new inquiries, and creating quotes. When a user clicks the New Inquiry button on the dashboard, the terminal displays a screen for entering new customer information and sends the entered information to the server.

[1158] Customer information management

[1159] Customer information management is a function that manages information such as customer name, contact details, and needs that users enter when making a new inquiry. The server stores this information in a database and can search past inquiry history and provide related suggestions. For example, when a user manages an inquiry for customer Jane Doe, the device sends the information to the database, and the server searches past inquiry history and displays suggestions.

[1160] Automatic quote generation

[1161] Automatic quote generation is a function that automatically generates quotes when a user selects a product or service and enters its quantity. The terminal sends the selected product information and quantity to the server, and the server calculates the price and delivery date using NumPy or similar. For example, if a user inquires about 100 laptops, the server generates a quote and sends it to the terminal, where the user can confirm and modify it.

[1162] Convert quotation to PDF

[1163] The PDF conversion of quotations is a function that converts final confirmed quotations into PDF format and makes them available for download by users. The server uses a PDF library such as iText or PDFBox to convert the quotation to PDF and sends it to the terminal, where the user can obtain the PDF using a download link.

[1164] Session End

[1165] Session termination is the process that occurs when a user wants to end their system operation. When the user clicks the end button, the terminal sends a termination signal to the server, and the server saves all session data in a database. For example, you can use MongoDB to store session data and send a confirmation message to the terminal when the session ends.

[1166] Emotion engine integration

[1167] The emotion engine is a function that analyzes user operation information and text input content to recognize the user's emotional state. The server can adjust the response method and proposal content based on the emotional data sent from the emotion engine and reflect it on the device. Generative AI models such as BERT and GPT-3 are often used for emotion engines. Specific examples of prompts include "Please generate an example of customer information entered in a new inquiry" and "Please explain the step-by-step process in which a user enters product information and generates a quote based on the quantity."

[1168] The system of the present invention can improve customer satisfaction and sales efficiency by recognizing the user's emotional state and responding appropriately based on that state.

[1169] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1170] Step 1:

[1171] The user accesses the system login screen and enters their username and password.

[1172] Input: Username and Password

[1173] Data processing: The device converts input information into JSON format

[1174] Output: Transformed credentials

[1175] Step 2:

[1176] The terminal transmits the entered authentication information to the server.

[1177] Input: Credentials

[1178] Data processing: None

[1179] Output: Authentication information sent to the server

[1180] Step 3:

[1181] The server checks the submitted credentials against its database.

[1182] Input: Registration information in the database and submitted authentication information

[1183] Data operations: verifying credentials through database queries (e.g., SQL queries)

[1184] Output: Authentication result (success or failure)

[1185] Step 4:

[1186] If the authentication is successful, the server generates an authentication token, generates a dashboard screen, and sends it to the terminal.

[1187] Input: Authentication result (success)

[1188] Data processing: Generating authentication tokens, generating HTML for dashboard screens

[1189] Output: Authentication token, dashboard screen

[1190] Step 5:

[1191] The terminal receives the dashboard screen and authentication token and displays them to the user.

[1192] Input: Dashboard screen, authentication token

[1193] Data processing: None

[1194] Output: Display of dashboard screen

[1195] Step 6:

[1196] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[1197] Input: Customer information (name, contact details, needs, etc.)

[1198] Data processing: The device converts input information into JSON format

[1199] Output: Transformed customer information

[1200] Step 7:

[1201] The terminal transmits the entered customer information to the server.

[1202] Input: Customer Information

[1203] Data processing: None

[1204] Output: Customer information sent to the server

[1205] Step 8:

[1206] The server stores the customer information in a database.

[1207] Input: Customer Information

[1208] Data operation: Insertion into a database (e.g., SQL INSERT statement)

[1209] Output: Status message of successful save

[1210] Step 9:

[1211] The server searches a database for past inquiry history and related suggestions and sends them to the terminal.

[1212] Input: Customer Information

[1213] Data operation: database search (e.g. SQL SELECT statement)

[1214] Output: Search results (inquiry history, proposal details)

[1215] Step 10:

[1216] The terminal displays the search results to the user.

[1217] Input: Search results

[1218] Data processing: None

[1219] Output: Search results displayed

[1220] Step 11:

[1221] The user selects a product or service on the new inquiry screen and enters the quantity.

[1222] Input: Product information, quantity

[1223] Data processing: The device converts input information into JSON format

[1224] Output: Transformed product information and quantity

[1225] Step 12:

[1226] The terminal transmits the selected product information and quantity to the server.

[1227] Input: Product information, quantity

[1228] Data processing: None

[1229] Output: Product information and quantity sent to the server

[1230] Step 13:

[1231] The server calculates the product price and delivery date and automatically generates a quotation.

[1232] Input: Product information, quantity

[1233] Data calculation: price calculation (e.g., price calculation using NumPy), delivery date calculation

[1234] Output: Generated quote

[1235] Step 14:

[1236] The server sends the estimate to the terminal and displays it to the user.

[1237] Input: Quote

[1238] Data processing: None

[1239] Output: Quote sent to the terminal

[1240] Step 15:

[1241] The user confirms and modifies the estimate content, and the terminal transmits the modified data to the server.

[1242] Input: Revised quotation data

[1243] Data processing: The device converts the correction information into JSON format

[1244] Output: Correction information sent to the server

[1245] Step 16:

[1246] The server reflects the corrections, generates a new estimate, and sends it to the terminal.

[1247] Input: Correction information

[1248] Data calculation: Reflection of correction information, regeneration of estimate

[1249] Output: Regenerated quote

[1250] Step 17:

[1251] The user clicks the button to generate the final confirmed quotation PDF.

[1252] Input: None

[1253] Data processing: None

[1254] Output: PDF generation instruction

[1255] Step 18:

[1256] The terminal sends the final confirmed quotation data to the server.

[1257] Input: Final confirmed quotation data

[1258] Data processing: None

[1259] Output: Final confirmed quote data sent to the server

[1260] Step 19:

[1261] The server converts the quote into PDF format.

[1262] Input: Final confirmed quotation data

[1263] Data operations: PDF conversion (e.g., using iText or PDFBox)

[1264] Output: PDF file

[1265] Step 20:

[1266] The server sends the generated PDF to the device and displays a download link to the user.

[1267] Input: PDF file

[1268] Data processing: None

[1269] Output: Download link

[1270] Step 21:

[1271] The user clicks the system shutdown button.

[1272] Input: Exit instruction

[1273] Data processing: None

[1274] Output: End signal

[1275] Step 22:

[1276] The terminal sends a termination signal to the server.

[1277] Input: Termination signal

[1278] Data processing: None

[1279] Output: Termination signal sent to the server

[1280] Step 23:

[1281] The server saves all session data to a database and safely terminates the session.

[1282] Input: Termination signal

[1283] Data Computing: Storing session data (e.g., using MongoDB)

[1284] Output: Exit status message

[1285] Step 24:

[1286] The server sends a completion confirmation message to the terminal, which displays it to the user.

[1287] Input: Exit status message

[1288] Data processing: None

[1289] Output: Finish confirmation message

[1290] (Application example 2)

[1291] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1292] Conventional systems have difficulty recognizing a user's emotional state based on operational information and text input, and responding accordingly. This has led to problems such as lower customer satisfaction and inefficient sales activities. Furthermore, they are unable to provide optimal product recommendations or customer support based on the user's emotional state, limiting the quality of customer support.

[1293] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, engine means for analyzing the user's operation information and text input content to recognize the user's emotional state, means for adjusting the content of proposals and response methods based on the recognized emotional data, and means for providing optimal product suggestions and customer support based on the user's emotional state. This makes it possible to recognize the user's emotional state in real time and provide appropriate product suggestions and support based on that.

[1294] "User authentication information" refers to personal authentication data such as a username and password that a user enters to access a system.

[1295] The "dashboard screen" is an interface for displaying integrated information that is first displayed after a user logs in.

[1296] "Customer Information" is personal and business information about a user, such as name, contact details, needs, etc.

[1297] "Past inquiry history" is data that records previous contacts with users and support details.

[1298] A "quote" is a document that shows the calculated price and delivery time for a specific product or service.

[1299] The "PDF format" is a portable document format, a file format in which the document format is fixed.

[1300] "Ending a session" is the process by which a user saves all data and disconnects from the system when they have finished using the system.

[1301] An "emotion engine" is software or hardware that analyzes the user's operation information and text input content to recognize their emotional state.

[1302] "Emotion data" is information that indicates the user's emotional state analyzed by the emotion engine.

[1303] "Proposal content" refers to information about products and services that the system presents based on the user's needs and emotional state.

[1304] "Response method" is a method that indicates the response procedures and actions that the system should take depending on the user's emotional state.

[1305] The present invention is an application for an online shopping site that improves customer satisfaction by using a system that integrates an emotion recognition engine to provide optimal product suggestions and customer support in response to the user's emotions. A specific embodiment of the system is described below.

[1306] Hardware and Software:

[1307] The system includes a smartphone, a server, a database, and an emotion engine. Specifically, it has the following configuration:

[1308] Smartphone: A device on which a user operates applications.

[1309] Server: A central computing device responsible for authentication, data processing, and sentiment analysis.

[1310] Database: Used to store customer information, past inquiry history, and product information.

[1311] Emotion engine: Software that analyzes user input data and operation patterns to recognize emotional states (e.g., Emotion Engine API).

[1312] Program processing:

[1313] The server performs user authentication, dashboard generation, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion recognition, making suggestions and responding based on the emotion.

[1314] 1. User authentication:

[1315] A user accesses the app using a smartphone and enters authentication information (user name, password) on the login screen. The server collates this authentication information with the database to authenticate the user, and if authentication is successful, a dashboard screen is generated and displayed on the smartphone.

[1316] 2. Dashboard generation:

[1317] Authenticated users are provided with a dashboard screen where they can make new inquiries and search for products.

[1318] 3. Customer information management:

[1319] The user enters new customer information, and the server stores the information in a database. It also searches the database for past inquiries and related suggestions and displays them to the user.

[1320] 4. Automatic quote generation:

[1321] The user selects a product or service and submits a quote. The server calculates the price and delivery time, generates a quote, and sends it to the smartphone in a format that can be modified.

[1322] 5. PDF Conversion:

[1323] Once the user has finalized the quotation, it will be converted into a PDF format and a downloadable link will be provided.

[1324] 6. End of session:

[1325] When the user tells the system to exit, the server securely stores all session data in a database and ends the session.

[1326] 7. Emotion Recognition and Suggestion:

[1327] The user's operation information and text input are sent to the emotion engine to recognize their emotional state. Based on the recognized emotional data, the server adjusts the suggestions and response methods. For example, if the user is feeling stressed, it will suggest relaxation items and provide support methods to calm the user's emotions.

[1328] Examples:

[1329] Emotion recognition during product search:

[1330] If the server detects feelings of stress while the user is searching for relaxation items, it will suggest a massage chair or an aroma diffuser.

[1331] Customer support optimization:

[1332] When the emotion engine recognizes negative emotions, the server immediately connects with appropriate support staff to provide support to the user.

[1333] Example prompt sentence:

[1334] "This user's operation patterns and text input suggest feelings of stress. Please suggest relaxation items."

[1335] "Users are happy, so please suggest related popular products."

[1336] By implementing this invention, it is possible to recognize the user's emotional state in real time and provide appropriate product suggestions and support based on that information, thereby improving customer satisfaction and streamlining sales activities.

[1337] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1338] Program processing steps

[1339] Step 1: Handling user authentication

[1340] The terminal accepts user authentication information (user name, password). The entered authentication information is sent to the server. The server compares it with a database and determines whether the authentication was successful. If successful, a dashboard screen is generated and sent to the terminal. The terminal displays the dashboard screen.

[1341] Step 2: Enter and save customer information

[1342] The user enters customer information (name, contact details, needs) for a new inquiry. The device sends the entered data to the server. The server stores this data in a database. The server searches past inquiry history and related suggestions and sends them to the device. The device displays the search results.

[1343] Step 3: Auto-generate and modify quotes

[1344] The user selects a product or service and enters its quantity. The terminal sends the selection information and quantity to the server. The server calculates the price and delivery date and automatically generates a quote. The generated quote is sent to the terminal and the user confirms it. The user modifies the quote as needed and sends it again from the terminal to the server. The server regenerates a quote reflecting the modifications and sends it to the terminal.

[1345] Step 4: Convert and download the quote to PDF

[1346] The user presses a button to convert the final confirmed quotation into PDF format. The device sends the quotation data to the server. The server converts the quotation into PDF format and sends the generated PDF to the device. The device displays a downloadable link to the user.

[1347] Step 5: Emotion Recognition Processing

[1348] The device sends the user's operation information and text input to the emotion engine. The emotion engine analyzes this data and recognizes the user's emotional state. The recognized emotion data is sent to the server. The server adjusts the suggestions and response methods based on the recognized emotion data. The device displays the adjusted content to the user.

[1349] Step 6: Ending the session

[1350] The user presses the system's end button. The terminal sends an end signal to the server. The server saves the session data in a database and ends the session. A termination confirmation message is sent to the terminal, which displays it to the user.

[1351] Detailed explanation of the processing steps

[1352] Step 1: Handling user authentication

[1353] Input: Username, Password

[1354] How it works: The device receives a username and password from the user and sends them to the server, which checks them against the authentication information stored in the database. If authentication is successful, the server generates a dashboard screen and sends it to the device.

[1355] Output: Dashboard screen

[1356] Step 2: Enter and save customer information

[1357] Input: Customer information (name, contact details, needs)

[1358] How it works: A user enters customer information into a device, which then sends the data to a server. The server stores the customer information in a database, searches past inquiries and related suggestions, and sends the results to the device. The device then displays the search results.

[1359] Output: Display of saved customer information, inquiry history, and suggestions

[1360] Step 3: Auto-generate and modify quotes

[1361] Input: Product information, quantity

[1362] How it works: The user selects a product or service and enters the quantity. The device sends that information to the server, which calculates the price and delivery date and generates a quote. The generated quote is sent to the device and displayed to the user. If the user makes any changes, the changes are sent from the device to the server again. The server regenerates a quote reflecting the changes and sends it to the device.

[1363] Output: Quote, revised quote

[1364] Step 4: Convert and download the quote to PDF

[1365] Input: Final Confirmed Quote

[1366] Operation: When the user presses the PDF conversion button, the device sends the quote data to the server. The server converts the quote to PDF format and sends the PDF to the device. The device displays a downloadable link to the user.

[1367] Output: PDF quote and download link

[1368] Step 5: Emotion Recognition Processing

[1369] Input: Operation information, text input content

[1370] How it works: The device sends the user's operation information and text input to the emotion engine. The emotion engine analyzes the data to recognize the user's emotional state and sends that emotional data to the server. The server adjusts the suggestions and response methods based on the emotional data and sends the adjustment results to the device. The device then displays the adjusted content to the user.

[1371] Output: Recognized emotion data, adjusted suggestions

[1372] Step 6: Ending the session

[1373] Input: End signal

[1374] Operation: When the user presses the quit button, the terminal sends a quit signal to the server. The server saves the session data in a database and terminates the session. A quit confirmation message is sent to the terminal, which displays it to the user.

[1375] Output: Finish confirmation message

[1376] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1377] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1378] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1379] [Third embodiment]

[1380] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1381] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1382] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1383] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1384] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1385] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1386] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1387] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1388] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1389] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1390] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1391] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1392] MODE FOR CARRYING OUT THE INVENTION

[1393] The system of the present invention provides a wide range of functions, including user authentication, dashboard screen, customer information management, automatic quotation generation, PDF conversion, and session termination.

[1394] 1. User Authentication

[1395] A user accesses the system and enters their username and password on the login screen.

[1396] The terminal sends this authentication information to the server.

[1397] The server checks the authentication information sent against the registered information in the database. If the check is successful, user authentication is complete.

[1398] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[1399] The terminal displays the generated dashboard screen to the user.

[1400] 2. Customer information management

[1401] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[1402] The terminal transmits the entered customer information (e.g., customer name, contact details, needs, etc.) to the server.

[1403] The server stores the received customer information in a database.

[1404] Furthermore, the server searches the history of past inquiries and sends the results including related suggestions to the terminal.

[1405] The device displays the search results to the user and can provide appropriate responses and suggestions.

[1406] 3. Automatic quotation generation

[1407] The user selects a product or service on the dashboard and enters its quantity.

[1408] The terminal transmits the selected product information and quantity to the server.

[1409] Based on the information received by the server, the unit price and stock status of each product are referenced and an estimate is automatically generated.

[1410] The server sends the generated estimate to the terminal.

[1411] The terminal displays the estimate contents to the user, who can then check the contents and modify them as necessary.

[1412] The terminal sends the revised estimate to the server again.

[1413] The server checks the modifications, generates a final quote, and sends it to the terminal.

[1414] 4. Convert quotation to PDF

[1415] Once the final quote is confirmed, the server generates the quote in PDF format.

[1416] The server sends the generated PDF to the device.

[1417] Make sure your device is ready to download PDF files.

[1418] 5. End of session

[1419] When the user wants to end the use of the system, he clicks the end button.

[1420] The terminal sends a termination signal to the server.

[1421] The server securely stores all session data in a database and ends the user's session.

[1422] The terminal displays a message to the user confirming the end of the session.

[1423] Specific examples

[1424] Example 1: Initial quote creation process

[1425] 1. The user logs in and displays the dashboard screen.

[1426] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[1427] 3. The terminal sends the input data to the server, which stores it in a database.

[1428] 4. The server searches past inquiry history and sends the results to the terminal for display.

[1429] 5. The user selects product A and product B and enters the quantity of each.

[1430] 6. The terminal sends the product information to the server, and the server automatically generates a quote.

[1431] 7. The quotation details are displayed on the terminal, and the user can confirm and make corrections.

[1432] 8. The server regenerates the revised quote, sends it to the device, converts it to PDF format and makes it available for download.

[1433] Example 2: Proposal for repeat customers

[1434] 1. The user logs in and displays the dashboard screen.

[1435] 2. Search for the customer's name to see their past inquiry history.

[1436] 3. The server sends the search results to the device, and the user prepares appropriate suggestions.

[1437] 4. The user creates a quote based on the proposal and sends the final quote in PDF format to the customer.

[1438] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[1439] The processing flow will be explained below.

[1440] User authentication process steps

[1441] Step 1:

[1442] The user accesses the system login screen on the terminal and enters the user name and password.

[1443] Step 2:

[1444] The terminal sends the entered username and password to the server.

[1445] Step 3:

[1446] The server checks the received username and password against the credentials in its database.

[1447] Step 4:

[1448] The server sends the result of authentication success or failure to the terminal.

[1449] Step 5:

[1450] If the device is successfully authenticated, the dashboard screen will be displayed. If authentication fails, an error message will be displayed.

[1451] Enter Customer Data Processing Steps

[1452] Step 1:

[1453] The user clicks the New Enquiry button on the dashboard screen.

[1454] Step 2:

[1455] The terminal displays a new inquiry screen, and the user enters the customer's name, contact information, needs, etc.

[1456] Step 3:

[1457] The terminal transmits the entered customer information to the server.

[1458] Step 4:

[1459] The server stores the received customer information in a database.

[1460] Step 5:

[1461] The server searches a database for past query history and related suggestions.

[1462] Step 6:

[1463] The server sends the search results to the terminal.

[1464] Step 7:

[1465] The device displays the search results for the user to review.

[1466] Process steps for creating a quote

[1467] Step 1:

[1468] The user selects a product or service on the new inquiry screen and enters the quantity.

[1469] Step 2:

[1470] The terminal transmits the selected product information and quantity to the server.

[1471] Step 3:

[1472] The server calculates the product price and delivery date based on the data received.

[1473] Step 4:

[1474] The server automatically generates an estimate and sends the details to the terminal.

[1475] Step 5:

[1476] The terminal displays the estimate details, which the user can confirm and modify.

[1477] Step 6:

[1478] If the user wishes to amend the estimate, he / she inputs the amendments.

[1479] Step 7:

[1480] The terminal transmits the corrected quotation data to the server again.

[1481] Step 8:

[1482] The server transmits the regenerated quotation reflecting the corrections to the terminal.

[1483] Steps for converting quotes to PDF

[1484] Step 1:

[1485] The user clicks the button to generate the final confirmed quotation PDF.

[1486] Step 2:

[1487] The terminal sends the final confirmed quotation data to the server.

[1488] Step 3:

[1489] The server converts the quote into PDF format.

[1490] Step 4:

[1491] The server sends the generated PDF file to the terminal.

[1492] Step 5:

[1493] The device displays a downloadable link to the user.

[1494] Session termination processing steps

[1495] Step 1:

[1496] The user clicks the system shutdown button.

[1497] Step 2:

[1498] The terminal sends a termination signal to the server.

[1499] Step 3:

[1500] The server stores all session data securely in a database.

[1501] Step 4:

[1502] The server terminates the session and sends a termination confirmation message to the terminal.

[1503] Step 5:

[1504] The terminal displays a confirmation message to the user.

[1505] Example 1

[1506] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1507] Conventional customer management systems have a complicated process from user authentication to creating quotes and completing the process, making it difficult to operate efficiently and respond quickly to customers. Automatically generating quotes also requires a lot of manual corrections, which takes time and effort, reducing the efficiency of sales activities. Furthermore, the process of converting quotes into PDF format and providing them to customers is also time-consuming, creating a bottleneck in workplaces where a quick response is required.

[1508] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1509] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for searching for past inquiry history based on the customer information input by the user and providing related proposals, and means for automatically generating a quote by referring to the product unit price and inventory status based on the product information and quantity selected by the user. This allows users to perform consistent operations within the system, enabling efficient and rapid customer service and quote creation.

[1510] "User authentication" is the process of verifying access rights by checking the authentication information provided by a user when accessing a system against a database.

[1511] The "dashboard screen" is a screen that provides a user who has been successfully authenticated with an integrated interface for operating and managing the system.

[1512] "Customer information" refers to individual information such as a customer's name, contact details, and needs, and is data managed by the system.

[1513] "Inquiry history" refers to a record of inquiries received from customers in the past and responses to those inquiries.

[1514] "Quotation" means a document or data that calculates the price and delivery time of goods or services to be provided.

[1515] "PDF format" is an abbreviation for Portable Document Format, a file format that allows documents to be saved and displayed in their original layout.

[1516] A "session" refers to the period of time during which a user performs a series of operations and processes from the time the user logs in to the time the user logs out of the system.

[1517] A "database" is a system for systematically storing and managing information, and is used to store customer information, authentication information, etc.

[1518] "Searching" is the process of finding data that meets specific criteria from information in a database.

[1519] "Automatic generation" refers to the system automatically creating data or documents without human intervention.

[1520] "Stock status" is information that indicates how much of a particular product is currently in stock.

[1521] MODE FOR CARRYING OUT THE INVENTION

[1522] The system of the present invention provides multiple functions to enable users to efficiently and quickly respond to customers and create quotes. The main hardware used includes a server and a terminal (e.g., a user's PC or smartphone). The software includes a database system (e.g., MySQL or PostgreSQL) and a PDF generation library (e.g., PDFKit).

[1523] User Authentication

[1524] In the user authentication process, a user first accesses the system and enters their username and password on the login screen. The terminal sends this authentication information to the server, which then checks it against the registration information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[1525] Customer information management

[1526] When a user clicks the New Inquiry button on the dashboard, a screen for entering new customer information appears. The user enters the customer's name, contact information, needs, etc., and the device sends this information to the server. The server stores the received customer information in a database, searches past inquiry history, and sends relevant suggestions to the device. The device displays the search results to the user, helping them to provide appropriate responses and suggestions.

[1527] Automatic quote generation

[1528] When a user selects a product or service on the dashboard and enters the quantity, the terminal sends this information to the server. The server references the unit price and stock status of each product and automatically generates a quote. The server then sends the generated quote to the terminal, which displays the quote details to the user. The user can check the details and make any necessary corrections. Once the corrections have been made, the quote is sent again from the terminal to the server, which checks the corrections, generates a final quote, and sends it to the terminal.

[1529] Convert quotation to PDF

[1530] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which then makes the PDF file available for download, allowing the user to easily download the quote and provide it to the customer.

[1531] Session End

[1532] When the user wants to finish using the system, he clicks the Exit button. The terminal sends an exit signal to the server, which then securely stores all session data in a database and ends the user's session. The terminal then displays a message to the user confirming the end of the session.

[1533] Specific examples

[1534] Initial quote creation process

[1535] The user logs in and displays the dashboard screen. They press the New Inquiry button and enter customer information (name, contact details, requirements). The terminal sends the entered data to the server, which saves it in a database. The server searches past inquiry history and sends the results to the terminal for display. The user selects product A and product B and enters the quantities of each. The terminal sends the product information to the server, which automatically generates a quote. The quote details are displayed on the terminal, and the user can confirm and make corrections. The server regenerates the corrected quote and sends it to the terminal, where it is converted to PDF format and made available for download.

[1536] Prompt Sentence Examples

[1537] Here is an example of a prompt to input to a generative AI model:

[1538] Customer Name:Taro Tanaka

[1539] Contact: tanaka@example.com

[1540] Requirements: New Project Quotation

[1541] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[1542] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1543] Program processing steps

[1544] User Authentication

[1545] Step 1:

[1546] Enter: The user enters their username and password into the login screen.

[1547] Action: The user clicks the "Login" button.

[1548] Output: The device sends this authentication information to the server.

[1549] Step 2:

[1550] Input: Credentials (username, password).

[1551] How it works: The server checks the received authentication information against its database.

[1552] Output: Based on the matching result, a flag indicating authentication success or failure is generated.

[1553] Step 3:

[1554] Input: Matching result.

[1555] Operation: If authentication is successful, the server generates the dashboard screen.

[1556] Output: The generated dashboard screen.

[1557] Step 4:

[1558] Input: The generated dashboard screen.

[1559] Operation: The server sends the dashboard screen to the device.

[1560] Output: The device displays the dashboard screen to the user.

[1561] Customer information management

[1562] Step 1:

[1563] Input: The user clicks the New Inquiry button and enters new customer information.

[1564] Action: Fills out a customer information form.

[1565] Output: The device sends the input data to the server.

[1566] Step 2:

[1567] Input: Customer information (name, contact details, needs, etc.).

[1568] Operation: The server stores the received customer information in a database.

[1569] Output: Save completion status.

[1570] Step 3:

[1571] Input: Customer Information.

[1572] Operation: The server searches the database for past query history.

[1573] Output: Search results (past inquiry history).

[1574] Step 4:

[1575] Input: Search results.

[1576] Operation: The server generates relevant suggestions and sends them to the device.

[1577] Output: Proposal.

[1578] Step 5:

[1579] Input: Proposal content.

[1580] Action: The device displays the suggestions to the user.

[1581] Output: The user prepares an appropriate response or suggestion.

[1582] Automatic quote generation

[1583] Step 1:

[1584] Input: The user selects a product or service and enters its quantity.

[1585] Action: Select product and enter quantity.

[1586] Output: The terminal sends product information and quantity to the server.

[1587] Step 2:

[1588] Input: Product information and quantity.

[1589] Operation: Based on the information received by the server, the product's unit price and stock status are looked up in the database.

[1590] Output: Product unit price and stock information.

[1591] Step 3:

[1592] Input: Item unit price and stock information.

[1593] Operation: The server calculates the estimated amount and automatically generates a quote.

[1594] Output: The generated quote.

[1595] Step 4:

[1596] Input: Generated quote.

[1597] Action: The server sends the quote to the device.

[1598] Output: The terminal displays the quote to the user.

[1599] Step 5:

[1600] Input: Quote details.

[1601] What happens: The user reviews the quote and makes any necessary adjustments.

[1602] Output: The corrections.

[1603] Step 6:

[1604] Input: Corrections.

[1605] Action: The device resends the revised quote to the server.

[1606] Output: Revised quote.

[1607] Step 7:

[1608] Enter: Revised quote.

[1609] Action: The server reflects the modifications and generates the final quote.

[1610] Output: Final quote.

[1611] Convert quotation to PDF

[1612] Step 1:

[1613] Enter: Final quote.

[1614] Action: The server generates a quote in PDF format.

[1615] Output: The generated PDF file.

[1616] Step 2:

[1617] Input: The generated PDF file.

[1618] Action: The server sends a PDF file to the device.

[1619] Output: The device receives the PDF file.

[1620] Step 3:

[1621] Input: PDF file.

[1622] What it does: The device makes the PDF file available for download.

[1623] Output: Download link.

[1624] Session End

[1625] Step 1:

[1626] Input: The user clicks the Finish button.

[1627] Action: Click on the Exit button.

[1628] Output: The terminal sends a termination signal to the server.

[1629] Step 2:

[1630] Input: Termination signal.

[1631] How it works: The server saves the session data to a database.

[1632] Output: Save completion status.

[1633] Step 3:

[1634] Input: Saved status.

[1635] Action: The server ends the session.

[1636] Output: A message confirming the end of the session.

[1637] Step 4:

[1638] Input: Session termination confirmation message.

[1639] Action: The terminal displays a confirmation message to the user.

[1640] Output: The user confirms the system shutdown.

[1641] (Application example 1)

[1642] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1643] Conventional customer information management and quotation creation systems are often inefficient when interactively proposing products and services. They also involve a large amount of manual work, placing a heavy burden on sales representatives and increasing the likelihood of errors. Virtual stores, in particular, require technology that can instantly obtain customer information and generate accurate quotations quickly and on the spot.

[1644] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1645] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for accepting voice input and eye gaze input using smart glasses, means for acquiring customer orders based on the voice input, automatically generating a quote and displaying it on the smart glasses, and means for converting the quote into PDF format and making it sendable via voice command. This enables interactive and efficient customer service and quote generation in a virtual store.

[1646] "User authentication" is a method of verifying the identity of a user accessing a system by checking the authentication information against a database.

[1647] The "dashboard screen" is an operation interface that is displayed to an authenticated user, and is a means for providing main functions and information in an integrated manner.

[1648] "Customer information" refers to information such as a customer's name, contact details, and needs that is entered and saved based on new inquiries and past history.

[1649] "Automatic quotation generation" is a means of automatically generating a quotation by calculating the price and delivery date based on the product information and quantity selected by the user.

[1650] "PDF conversion" is a method of converting an automatically generated quotation into a PDF format so that the user can download or send it.

[1651] "Smart glasses" are a display device worn on the head and are a wearable device that can accept voice and eye input.

[1652] "Voice input" is a means of recognizing a user's voice and processing it as instructions or information within the system.

[1653] "Eye gaze input" is an interface technology that tracks the user's gaze to perform operations and selections.

[1654] "End of session" is a method for saving data and safely closing a session when a user finishes using the system.

[1655] The present invention provides a system that covers user authentication, dashboard screen generation, customer information management, automatic quotation generation, PDF conversion, operation using voice and eye gaze input, and even session termination. The detailed form for realizing this system is shown below.

[1656] 1. User Authentication

[1657] The user enters authentication information (user name and password) to access the system. The terminal sends this authentication information to the server, which then authenticates the user by checking it against the registered information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[1658] 2. Customer information management

[1659] The user clicks the "New Inquiry" button and enters new customer information. The terminal sends the entered customer information to the server, which stores it in a database. The server then searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal then displays the search results to the user, allowing them to make appropriate responses and suggestions.

[1660] 3. Automatic quotation generation

[1661] The user selects products or services on the dashboard and enters their quantities. The terminal sends the selected product information and quantities to the server, which then uses the received information to automatically generate a quote by referencing the unit price and stock status of each product. The generated quote is sent to the terminal, where the user can check its contents. If necessary, the user can modify the quote and send it back to the server. The final quote is converted to PDF format and can be downloaded by the user.

[1662] 4. PDF Conversion

[1663] Once the final quote is confirmed, the server generates a PDF version of the quote and sends it to the device, which makes the PDF file available for download.

[1664] 5. Operation via smart glasses

[1665] The user wears the smart glasses and performs operations using voice and eye contact. For example, a customer order can be captured by voice input and a quote can be automatically generated based on that. The quote can also be converted to PDF format by voice command and instantly sent to the customer.

[1666] 6. End of session

[1667] When the user wants to finish using the system, they click the Exit button or use a voice command. The device sends an exit signal to the server, which securely stores all session data in a database and ends the user's session. The device then displays a message to the user confirming the end of the session.

[1668] Hardware and software used

[1669] Hardware: Smart glasses (e.g., head-mounted display devices)

[1670] Software: Flask (a lightweight web framework for Python), pyttsx3 (speech synthesis), speech_recognition (speech recognition), pdfkit (PDF generation)

[1671] Specific examples

[1672] A salesperson wears smart glasses and selects products while interacting with the customer. For example, if a salesperson voice-inputs, "I'd like three units of product A and two units of product B, please," the system responds, "Generating a quote... The total amount is 500 yen. Please confirm the details." If the salesperson instructs, "I've confirmed it. Please convert the quote to PDF," the system responds, "The PDF has been generated. I'll send it."

[1673] Example prompts for generative AI models

[1674] I am developing an application that generates quotes and converts them to PDFs based on customer orders obtained through voice recognition. This application uses smart glasses and is controlled by the user's gaze and voice. Please tell me the operation flow for specific voice commands.

[1675] The system enables interactive and efficient customer interaction and quote generation in a virtual store, improving sales productivity.

[1676] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1677] Step 1:

[1678] Enter and submit user credentials:

[1679] A user accesses the system and enters authentication information (user name and password) into a terminal. The terminal sends this authentication information to the server. The server compares the received authentication information with the registered information in a database, performs authentication, and returns the result to the terminal. The input is the user name and password, and the output is the authentication result.

[1680] Step 2:

[1681] Generate and display dashboard screens:

[1682] The server generates a dashboard screen for the user who has been successfully authenticated and sends it to the terminal. The terminal displays the generated dashboard screen to the user. The input is the authentication result, and the output is the display of the dashboard screen.

[1683] Step 3:

[1684] Accepting new inquiries and storing customer information:

[1685] The user clicks the New Inquiry button on the dashboard and enters customer information (e.g., customer name, contact information, needs, etc.). The terminal sends the entered customer information to the server. The server stores the received customer information in a database and searches past inquiry history. The input is customer information, and the output is the stored customer information and a display of related suggestions.

[1686] Step 4:

[1687] View past enquiry history and suggestions:

[1688] The server searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal displays the search results to the user and makes appropriate responses or suggestions based on the suggestions. The input is customer information, and the output is a display of the suggestions.

[1689] Step 5:

[1690] Auto-generate and view quotes:

[1691] The user selects a product or service on the dashboard and enters the quantity. The terminal sends the selected product information and quantity to the server. Based on the received information, the server references the unit price and stock status of each product and automatically generates a quote. The generated quote is sent to the terminal and displayed to the user. The input is product information and quantity, and the output is the quote.

[1692] Step 6:

[1693] Modify and regenerate quotes:

[1694] The user checks the quote and makes any necessary corrections. The terminal sends the corrected quote to the server. The server checks the corrected information, generates a final quote, and sends it to the terminal. The input is the corrections, and the output is the corrected quote.

[1695] Step 7:

[1696] Convert and download your quote to PDF:

[1697] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which makes the PDF file available for download by the user. The input is the final quote and the output is a PDF file.

[1698] Step 8:

[1699] Voice and gaze input with smart glasses:

[1700] The user wears smart glasses and operates them using voice and eye gaze input. For example, if the user wants to order three items of product A and two items of product B, they input the voice input. The device sends the voice input to the server, which then automatically generates a quote. The input is voice data, and the output is a display of the quote details.

[1701] Step 9:

[1702] Convert and send quotes to PDF via voice command:

[1703] The user uses a voice command to convert the quotation into PDF format and send it. The device sends this command to the server, which then converts the quotation into PDF format and sends it. The input is a voice command, and the output is the generation and transmission of a PDF file.

[1704] Step 10:

[1705] Session End:

[1706] When the user wants to finish using the system, they click the quit button or use a voice command. The device sends a quit signal to the server, which securely stores all session data and ends the session. The device then displays a message to the user confirming the end of the session. The input is the quit command, and the output is the message confirming the end of the session.

[1707] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1708] MODE FOR CARRYING OUT THE INVENTION

[1709] The system of the present invention achieves even more advanced customer service by combining user authentication, dashboard screens, customer information management, automatic quotation generation, PDF conversion, and session termination with an emotion engine that recognizes the user's emotions.

[1710] 1. User Authentication

[1711] A user accesses the system and enters a user name and password on the login screen.

[1712] The terminal sends this authentication information to the server.

[1713] The server checks the authentication information sent against the registered information in the database, and if the check is successful, user authentication is complete.

[1714] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[1715] The terminal displays the generated dashboard screen to the user.

[1716] 2. Customer information management

[1717] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[1718] The terminal sends the entered information (customer's name, contact details, needs, etc.) to the server.

[1719] The server stores the information in a database.

[1720] The server searches a database for past inquiry history and related suggestions and sends the results to the terminal.

[1721] The device displays the search results for the user to review.

[1722] 3. Automatic quotation generation

[1723] The user selects a product or service on the new inquiry screen and enters the quantity.

[1724] The terminal transmits the selected product information and quantity to the server.

[1725] The server calculates the product price and delivery date based on the received information.

[1726] The server automatically generates an estimate and sends the details to the terminal.

[1727] The terminal displays the estimate contents to the user, who then checks and modifies them.

[1728] The terminal transmits the revised quotation data to the server again.

[1729] The server will generate a new quotation reflecting the corrections and send it to the terminal.

[1730] 4. Convert quotation to PDF

[1731] The user clicks the button to generate the final confirmed quotation PDF.

[1732] The terminal sends the final confirmed quotation data to the server.

[1733] The server converts the quote into PDF format.

[1734] The server sends the generated PDF to the device.

[1735] The device displays a downloadable link to the user.

[1736] 5. End of session

[1737] The user clicks the system shutdown button.

[1738] The terminal sends a termination signal to the server.

[1739] The server stores all session data securely in a database.

[1740] The server terminates the session and sends a termination confirmation message to the terminal.

[1741] The terminal displays a confirmation message to the user.

[1742] 6. Emotion engine integration

[1743] The device sends the user's operation information and text input content to the emotion engine.

[1744] The emotion engine analyzes the user's input data and operation patterns to recognize their emotional state.

[1745] The recognized emotion data is sent to the server.

[1746] The server adjusts its response and suggestions based on the recognized emotion.

[1747] The device displays the adjustments to the user.

[1748] Specific examples

[1749] Example 1: Entering customer information and responding

[1750] 1. The user logs in and displays the dashboard screen.

[1751] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[1752] 3. The terminal sends the input data to the server, which stores it in a database.

[1753] 4. The server searches the past inquiry history and sends relevant suggestions to the terminal for display.

[1754] 5. The emotion engine analyzes the user's input data and operation patterns and sends the emotional state to the server.

[1755] 6. The server adjusts the suggestions and responses based on the recognized emotions, and sends them to the device for display.

[1756] Example 2: Checking and correcting quote details

[1757] 1. The user selects a product or service and enters its quantity.

[1758] 2. The terminal sends the selection information and quantity to the server, which then automatically generates a quote.

[1759] 3. The server sends the generated estimate to the terminal and the user confirms it.

[1760] 4. The emotion engine sends the analysis data to the server so that the user can make modifications based on their emotions.

[1761] 5. The server receives the revised quotation data and sends the regenerated quotation to the terminal.

[1762] The present invention realizes improved customer satisfaction and more efficient sales activities by recognizing the user's emotions and taking appropriate action based on those emotions.

[1763] The processing flow will be explained below.

[1764] Processing steps for entering and responding to customer information

[1765] Step 1:

[1766] The user logs in and displays the dashboard screen.

[1767] Step 2:

[1768] The user clicks the New Inquiry button and enters customer information (name, contact details, requirements).

[1769] Step 3:

[1770] The terminal transmits the entered customer information to the server.

[1771] Step 4:

[1772] The server stores the received customer information in a database.

[1773] Step 5:

[1774] The server retrieves the customer's past inquiry history and related offers from a database.

[1775] Step 6:

[1776] The server sends the search results to the terminal.

[1777] Step 7:

[1778] The device displays the search results for the user to review.

[1779] Step 8:

[1780] The device sends the user's input data and operation patterns to the emotion engine.

[1781] Step 9:

[1782] The emotion engine analyzes the user's emotional state and transmits the emotion data to the server.

[1783] Step 10:

[1784] The server adjusts the response method and suggestions based on the emotional data received.

[1785] Step 11:

[1786] The server sends the adjusted response methods and suggestions to the terminal.

[1787] Step 12:

[1788] The device displays the adjustments to the user.

[1789] Processing steps for reviewing and amending quote details

[1790] Step 1:

[1791] The user selects a product or service on the new inquiry screen and enters the quantity.

[1792] Step 2:

[1793] The terminal transmits the selected product information and quantity to the server.

[1794] Step 3:

[1795] The server calculates the product price and delivery date based on the data received.

[1796] Step 4:

[1797] The server automatically generates an estimate and sends the details to the terminal.

[1798] Step 5:

[1799] The terminal displays the estimate details and the user confirms them.

[1800] Step 6:

[1801] If the user wishes to amend the estimate, he / she inputs the amendments.

[1802] Step 7:

[1803] The terminal transmits the corrected quotation data to the server again.

[1804] Step 8:

[1805] The server transmits the regenerated quotation that reflects the corrections to the terminal.

[1806] Step 9:

[1807] The terminal transmits the user's emotional state regarding the content of the estimate to the emotion engine.

[1808] Step 10:

[1809] The emotion engine analyzes the user's emotion regarding the quote and transmits the emotion data to the server.

[1810] Step 11:

[1811] The server further adjusts the proposal and estimate based on the emotion data.

[1812] Step 12:

[1813] The server sends the adjusted content to the terminal.

[1814] Step 13:

[1815] The device displays the adjustments to the user.

[1816] Example 2

[1817] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1818] Conventional customer service systems include authentication, customer information management, automatic quotation generation, PDF conversion, and session management, but lack the ability to properly recognize the user's emotional state and respond accordingly. This limits their ability to improve customer satisfaction and streamline sales activities. Therefore, there is a need for a system that can realize more advanced customer service by recognizing the user's emotions and responding accordingly.

[1819] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1820] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it available for download, means for receiving an instruction to end the session, saving the data, and ending the session, means for analyzing the user's operation information and text input content to recognize the user's emotional state, and means for adjusting a response method and proposal content based on the user's emotional state. This makes it possible to improve customer satisfaction and streamline sales activities by recognizing the user's emotions and responding based on them.

[1821] "User authentication" is the process of receiving the authentication information of a user accessing a system and verifying it against a database.

[1822] The "dashboard screen" is an operation screen that is displayed after a user logs in, and is an interface that aggregates the system's main functions and information.

[1823] "Customer information management" is the process of inputting and saving information such as customer name, contact details, and needs that users enter when making a new inquiry.

[1824] "Inquiry history search" is a function that searches the database for past customer inquiry history and displays related suggestions to the user as needed.

[1825] "Automatic quotation generation" is a process that calculates the product price and delivery date based on the product information and quantity selected by the user, and automatically generates a quotation.

[1826] "PDF Conversion" is a function that converts the final confirmed quotation into PDF format and makes it available for download by the user.

[1827] "Session termination" is a process in which, when a user finishes operating the system, all session data is saved in a database and the connection with the system is terminated.

[1828] An "emotion engine" is an algorithm or model that analyzes user operation information and text input content to recognize the user's emotional state.

[1829] "Emotional data adjustment" is the process of adjusting the system's response methods and suggestions based on the user's recognized emotional state.

[1830] The system of the present invention is a highly functional customer support system that includes user authentication, a dashboard screen, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion engine integration. This system performs specific data processing and data calculations using various hardware and software such as those listed below.

[1831] User Authentication

[1832] User authentication is the first process that takes place when a user accesses a system. The user enters their username and password on the login screen, and the terminal sends the entered information to the server. The server compares the information with the registration information stored in a database such as MySQL, and if authentication is successful, user authentication is complete, and the server generates a dashboard screen and sends it to the terminal. For example, consider the case where John Smith logs in using his email address and password.

[1833] Dashboard screen

[1834] The dashboard screen is the first operation screen that is displayed after a user logs in, and allows access to key functions such as entering customer information, managing new inquiries, and creating quotes. When a user clicks the New Inquiry button on the dashboard, the terminal displays a screen for entering new customer information and sends the entered information to the server.

[1835] Customer information management

[1836] Customer information management is a function that manages information such as customer name, contact details, and needs that users enter when making a new inquiry. The server stores this information in a database and can search past inquiry history and provide related suggestions. For example, when a user manages an inquiry for customer Jane Doe, the device sends the information to the database, and the server searches past inquiry history and displays suggestions.

[1837] Automatic quote generation

[1838] Automatic quote generation is a function that automatically generates quotes when a user selects a product or service and enters its quantity. The terminal sends the selected product information and quantity to the server, and the server calculates the price and delivery date using NumPy or similar. For example, if a user inquires about 100 laptops, the server generates a quote and sends it to the terminal, where the user can confirm and modify it.

[1839] Convert quotation to PDF

[1840] The PDF conversion of quotations is a function that converts final confirmed quotations into PDF format and makes them available for download by users. The server uses a PDF library such as iText or PDFBox to convert the quotation to PDF and sends it to the terminal, where the user can obtain the PDF using a download link.

[1841] Session End

[1842] Session termination is the process that occurs when a user wants to end their system operation. When the user clicks the end button, the terminal sends a termination signal to the server, and the server saves all session data in a database. For example, you can use MongoDB to store session data and send a confirmation message to the terminal when the session ends.

[1843] Emotion engine integration

[1844] The emotion engine is a function that analyzes user operation information and text input content to recognize the user's emotional state. The server can adjust the response method and proposal content based on the emotional data sent from the emotion engine and reflect it on the device. Generative AI models such as BERT and GPT-3 are often used for emotion engines. Specific examples of prompts include "Please generate an example of customer information entered in a new inquiry" and "Please explain the step-by-step process in which a user enters product information and generates a quote based on the quantity."

[1845] The system of the present invention can improve customer satisfaction and sales efficiency by recognizing the user's emotional state and responding appropriately based on that state.

[1846] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1847] Step 1:

[1848] The user accesses the system login screen and enters their username and password.

[1849] Input: Username and Password

[1850] Data processing: The device converts input information into JSON format

[1851] Output: Transformed credentials

[1852] Step 2:

[1853] The terminal transmits the entered authentication information to the server.

[1854] Input: Credentials

[1855] Data processing: None

[1856] Output: Authentication information sent to the server

[1857] Step 3:

[1858] The server checks the submitted credentials against its database.

[1859] Input: Registration information in the database and submitted authentication information

[1860] Data operations: verifying credentials through database queries (e.g., SQL queries)

[1861] Output: Authentication result (success or failure)

[1862] Step 4:

[1863] If the authentication is successful, the server generates an authentication token, generates a dashboard screen, and sends it to the terminal.

[1864] Input: Authentication result (success)

[1865] Data processing: Generating authentication tokens, generating HTML for dashboard screens

[1866] Output: Authentication token, dashboard screen

[1867] Step 5:

[1868] The terminal receives the dashboard screen and authentication token and displays them to the user.

[1869] Input: Dashboard screen, authentication token

[1870] Data processing: None

[1871] Output: Display of dashboard screen

[1872] Step 6:

[1873] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[1874] Input: Customer information (name, contact details, needs, etc.)

[1875] Data processing: The device converts input information into JSON format

[1876] Output: Transformed customer information

[1877] Step 7:

[1878] The terminal transmits the entered customer information to the server.

[1879] Input: Customer Information

[1880] Data processing: None

[1881] Output: Customer information sent to the server

[1882] Step 8:

[1883] The server stores the customer information in a database.

[1884] Input: Customer Information

[1885] Data operation: Insertion into a database (e.g., SQL INSERT statement)

[1886] Output: Status message of successful save

[1887] Step 9:

[1888] The server searches a database for past inquiry history and related suggestions and sends them to the terminal.

[1889] Input: Customer Information

[1890] Data operation: database search (e.g. SQL SELECT statement)

[1891] Output: Search results (inquiry history, proposal details)

[1892] Step 10:

[1893] The terminal displays the search results to the user.

[1894] Input: Search results

[1895] Data processing: None

[1896] Output: Search results displayed

[1897] Step 11:

[1898] The user selects a product or service on the new inquiry screen and enters the quantity.

[1899] Input: Product information, quantity

[1900] Data processing: The device converts input information into JSON format

[1901] Output: Transformed product information and quantity

[1902] Step 12:

[1903] The terminal transmits the selected product information and quantity to the server.

[1904] Input: Product information, quantity

[1905] Data processing: None

[1906] Output: Product information and quantity sent to the server

[1907] Step 13:

[1908] The server calculates the product price and delivery date and automatically generates a quotation.

[1909] Input: Product information, quantity

[1910] Data calculation: price calculation (e.g., price calculation using NumPy), delivery date calculation

[1911] Output: Generated quote

[1912] Step 14:

[1913] The server sends the estimate to the terminal and displays it to the user.

[1914] Input: Quote

[1915] Data processing: None

[1916] Output: Quote sent to the terminal

[1917] Step 15:

[1918] The user confirms and modifies the estimate content, and the terminal transmits the modified data to the server.

[1919] Input: Revised quotation data

[1920] Data processing: The device converts the correction information into JSON format

[1921] Output: Correction information sent to the server

[1922] Step 16:

[1923] The server reflects the corrections, generates a new estimate, and sends it to the terminal.

[1924] Input: Correction information

[1925] Data calculation: Reflection of correction information, regeneration of estimate

[1926] Output: Regenerated quote

[1927] Step 17:

[1928] The user clicks the button to generate the final confirmed quotation PDF.

[1929] Input: None

[1930] Data processing: None

[1931] Output: PDF generation instruction

[1932] Step 18:

[1933] The terminal sends the final confirmed quotation data to the server.

[1934] Input: Final confirmed quotation data

[1935] Data processing: None

[1936] Output: Final confirmed quote data sent to the server

[1937] Step 19:

[1938] The server converts the quote into PDF format.

[1939] Input: Final confirmed quotation data

[1940] Data operations: PDF conversion (e.g., using iText or PDFBox)

[1941] Output: PDF file

[1942] Step 20:

[1943] The server sends the generated PDF to the device and displays a download link to the user.

[1944] Input: PDF file

[1945] Data processing: None

[1946] Output: Download link

[1947] Step 21:

[1948] The user clicks the system shutdown button.

[1949] Input: Exit instruction

[1950] Data processing: None

[1951] Output: End signal

[1952] Step 22:

[1953] The terminal sends a termination signal to the server.

[1954] Input: Termination signal

[1955] Data processing: None

[1956] Output: Termination signal sent to the server

[1957] Step 23:

[1958] The server saves all session data to a database and safely terminates the session.

[1959] Input: Termination signal

[1960] Data Computing: Storing session data (e.g., using MongoDB)

[1961] Output: Exit status message

[1962] Step 24:

[1963] The server sends a completion confirmation message to the terminal, which displays it to the user.

[1964] Input: Exit status message

[1965] Data processing: None

[1966] Output: Finish confirmation message

[1967] (Application example 2)

[1968] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1969] Conventional systems have difficulty recognizing a user's emotional state based on operational information and text input, and responding accordingly. This has led to problems such as lower customer satisfaction and inefficient sales activities. Furthermore, they are unable to provide optimal product recommendations or customer support based on the user's emotional state, limiting the quality of customer support.

[1970] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, engine means for analyzing the user's operation information and text input content to recognize the user's emotional state, means for adjusting the content of proposals and response methods based on the recognized emotional data, and means for providing optimal product suggestions and customer support based on the user's emotional state. This makes it possible to recognize the user's emotional state in real time and provide appropriate product suggestions and support based on that.

[1971] "User authentication information" refers to personal authentication data such as a username and password that a user enters to access a system.

[1972] The "dashboard screen" is an interface for displaying integrated information that is first displayed after a user logs in.

[1973] "Customer Information" is personal and business information about a user, such as name, contact details, needs, etc.

[1974] "Past inquiry history" is data that records previous contacts with users and support details.

[1975] A "quote" is a document that shows the calculated price and delivery time for a specific product or service.

[1976] The "PDF format" is a portable document format, a file format in which the document format is fixed.

[1977] "Ending a session" is the process by which a user saves all data and disconnects from the system when they have finished using the system.

[1978] An "emotion engine" is software or hardware that analyzes the user's operation information and text input content to recognize their emotional state.

[1979] "Emotion data" is information that indicates the user's emotional state analyzed by the emotion engine.

[1980] "Proposal content" refers to information about products and services that the system presents based on the user's needs and emotional state.

[1981] "Response method" is a method that indicates the response procedures and actions that the system should take depending on the user's emotional state.

[1982] The present invention is an application for an online shopping site that improves customer satisfaction by using a system that integrates an emotion recognition engine to provide optimal product suggestions and customer support in response to the user's emotions. A specific embodiment of the system is described below.

[1983] Hardware and Software:

[1984] The system includes a smartphone, a server, a database, and an emotion engine. Specifically, it has the following configuration:

[1985] Smartphone: A device on which a user operates applications.

[1986] Server: A central computing device responsible for authentication, data processing, and sentiment analysis.

[1987] Database: Used to store customer information, past inquiry history, and product information.

[1988] Emotion engine: Software that analyzes user input data and operation patterns to recognize emotional states (e.g., Emotion Engine API).

[1989] Program processing:

[1990] The server performs user authentication, dashboard generation, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion recognition, making suggestions and responding based on the emotion.

[1991] 1. User authentication:

[1992] A user accesses the app using a smartphone and enters authentication information (user name, password) on the login screen. The server collates this authentication information with the database to authenticate the user, and if authentication is successful, a dashboard screen is generated and displayed on the smartphone.

[1993] 2. Dashboard generation:

[1994] Authenticated users are provided with a dashboard screen where they can make new inquiries and search for products.

[1995] 3. Customer information management:

[1996] The user enters new customer information, and the server stores the information in a database. It also searches the database for past inquiries and related suggestions and displays them to the user.

[1997] 4. Automatic quote generation:

[1998] The user selects a product or service and submits a quote. The server calculates the price and delivery time, generates a quote, and sends it to the smartphone in a format that can be modified.

[1999] 5. PDF Conversion:

[2000] Once the user has finalized the quotation, it will be converted into a PDF format and a downloadable link will be provided.

[2001] 6. End of session:

[2002] When the user tells the system to exit, the server securely stores all session data in a database and ends the session.

[2003] 7. Emotion Recognition and Suggestion:

[2004] The user's operation information and text input are sent to the emotion engine to recognize their emotional state. Based on the recognized emotional data, the server adjusts the suggestions and response methods. For example, if the user is feeling stressed, it will suggest relaxation items and provide support methods to calm the user's emotions.

[2005] Examples:

[2006] Emotion recognition during product search:

[2007] If the server detects feelings of stress while the user is searching for relaxation items, it will suggest a massage chair or an aroma diffuser.

[2008] Customer support optimization:

[2009] When the emotion engine recognizes negative emotions, the server immediately connects with appropriate support staff to provide support to the user.

[2010] Example prompt sentence:

[2011] "This user's operation patterns and text input suggest feelings of stress. Please suggest relaxation items."

[2012] "Users are happy, so please suggest related popular products."

[2013] By implementing this invention, it is possible to recognize the user's emotional state in real time and provide appropriate product suggestions and support based on that information, thereby improving customer satisfaction and streamlining sales activities.

[2014] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2015] Program processing steps

[2016] Step 1: Handling user authentication

[2017] The terminal accepts user authentication information (user name, password). The entered authentication information is sent to the server. The server compares it with a database and determines whether the authentication was successful. If successful, a dashboard screen is generated and sent to the terminal. The terminal displays the dashboard screen.

[2018] Step 2: Enter and save customer information

[2019] The user enters customer information (name, contact details, needs) for a new inquiry. The device sends the entered data to the server. The server stores this data in a database. The server searches past inquiry history and related suggestions and sends them to the device. The device displays the search results.

[2020] Step 3: Auto-generate and modify quotes

[2021] The user selects a product or service and enters its quantity. The terminal sends the selection information and quantity to the server. The server calculates the price and delivery date and automatically generates a quote. The generated quote is sent to the terminal and the user confirms it. The user modifies the quote as needed and sends it again from the terminal to the server. The server regenerates a quote reflecting the modifications and sends it to the terminal.

[2022] Step 4: Convert and download the quote to PDF

[2023] The user presses a button to convert the final confirmed quotation into PDF format. The device sends the quotation data to the server. The server converts the quotation into PDF format and sends the generated PDF to the device. The device displays a downloadable link to the user.

[2024] Step 5: Emotion Recognition Processing

[2025] The device sends the user's operation information and text input to the emotion engine. The emotion engine analyzes this data and recognizes the user's emotional state. The recognized emotion data is sent to the server. The server adjusts the suggestions and response methods based on the recognized emotion data. The device displays the adjusted content to the user.

[2026] Step 6: Ending the session

[2027] The user presses the system's end button. The terminal sends an end signal to the server. The server saves the session data in a database and ends the session. A termination confirmation message is sent to the terminal, which displays it to the user.

[2028] Detailed explanation of the processing steps

[2029] Step 1: Handling user authentication

[2030] Input: Username, Password

[2031] How it works: The device receives a username and password from the user and sends them to the server, which checks them against the authentication information stored in the database. If authentication is successful, the server generates a dashboard screen and sends it to the device.

[2032] Output: Dashboard screen

[2033] Step 2: Enter and save customer information

[2034] Input: Customer information (name, contact details, needs)

[2035] How it works: A user enters customer information into a device, which then sends the data to a server. The server stores the customer information in a database, searches past inquiries and related suggestions, and sends the results to the device. The device then displays the search results.

[2036] Output: Display of saved customer information, inquiry history, and suggestions

[2037] Step 3: Auto-generate and modify quotes

[2038] Input: Product information, quantity

[2039] How it works: The user selects a product or service and enters the quantity. The device sends that information to the server, which calculates the price and delivery date and generates a quote. The generated quote is sent to the device and displayed to the user. If the user makes any changes, the changes are sent from the device to the server again. The server regenerates a quote reflecting the changes and sends it to the device.

[2040] Output: Quote, revised quote

[2041] Step 4: Convert and download the quote to PDF

[2042] Input: Final Confirmed Quote

[2043] Operation: When the user presses the PDF conversion button, the device sends the quote data to the server. The server converts the quote to PDF format and sends the PDF to the device. The device displays a downloadable link to the user.

[2044] Output: PDF quote and download link

[2045] Step 5: Emotion Recognition Processing

[2046] Input: Operation information, text input content

[2047] How it works: The device sends the user's operation information and text input to the emotion engine. The emotion engine analyzes the data to recognize the user's emotional state and sends that emotional data to the server. The server adjusts the suggestions and response methods based on the emotional data and sends the adjustment results to the device. The device then displays the adjusted content to the user.

[2048] Output: Recognized emotion data, adjusted suggestions

[2049] Step 6: Ending the session

[2050] Input: End signal

[2051] Operation: When the user presses the quit button, the terminal sends a quit signal to the server. The server saves the session data in a database and terminates the session. A quit confirmation message is sent to the terminal, which displays it to the user.

[2052] Output: Finish confirmation message

[2053] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2054] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2055] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2056] [Fourth embodiment]

[2057] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2058] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2059] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2060] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2061] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2062] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2063] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2064] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2065] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2066] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2067] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2068] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2069] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2070] MODE FOR CARRYING OUT THE INVENTION

[2071] The system of the present invention provides a wide range of functions, including user authentication, dashboard screen, customer information management, automatic quotation generation, PDF conversion, and session termination.

[2072] 1. User Authentication

[2073] A user accesses the system and enters their username and password on the login screen.

[2074] The terminal sends this authentication information to the server.

[2075] The server checks the authentication information sent against the registered information in the database. If the check is successful, user authentication is complete.

[2076] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[2077] The terminal displays the generated dashboard screen to the user.

[2078] 2. Customer information management

[2079] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[2080] The terminal transmits the entered customer information (e.g., customer name, contact details, needs, etc.) to the server.

[2081] The server stores the received customer information in a database.

[2082] Furthermore, the server searches the history of past inquiries and sends the results including related suggestions to the terminal.

[2083] The device displays the search results to the user and can provide appropriate responses and suggestions.

[2084] 3. Automatic quotation generation

[2085] The user selects a product or service on the dashboard and enters its quantity.

[2086] The terminal transmits the selected product information and quantity to the server.

[2087] Based on the information received by the server, the unit price and stock status of each product are referenced and an estimate is automatically generated.

[2088] The server sends the generated estimate to the terminal.

[2089] The terminal displays the estimate contents to the user, who can then check the contents and modify them as necessary.

[2090] The terminal sends the revised estimate to the server again.

[2091] The server checks the modifications, generates a final quote, and sends it to the terminal.

[2092] 4. Convert quotation to PDF

[2093] Once the final quote is confirmed, the server generates the quote in PDF format.

[2094] The server sends the generated PDF to the device.

[2095] Make sure your device is ready to download PDF files.

[2096] 5. End of session

[2097] When the user wants to end the use of the system, he clicks the end button.

[2098] The terminal sends a termination signal to the server.

[2099] The server securely stores all session data in a database and ends the user's session.

[2100] The terminal displays a message to the user confirming the end of the session.

[2101] Specific examples

[2102] Example 1: Initial quote creation process

[2103] 1. The user logs in and displays the dashboard screen.

[2104] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[2105] 3. The terminal sends the input data to the server, which stores it in a database.

[2106] 4. The server searches past inquiry history and sends the results to the terminal for display.

[2107] 5. The user selects product A and product B and enters the quantity of each.

[2108] 6. The terminal sends the product information to the server, and the server automatically generates a quote.

[2109] 7. The quotation details are displayed on the terminal, and the user can confirm and make corrections.

[2110] 8. The server regenerates the revised quote, sends it to the device, converts it to PDF format and makes it available for download.

[2111] Example 2: Proposal for repeat customers

[2112] 1. The user logs in and displays the dashboard screen.

[2113] 2. Search for the customer's name to see their past inquiry history.

[2114] 3. The server sends the search results to the device, and the user prepares appropriate suggestions.

[2115] 4. The user creates a quote based on the proposal and sends the final quote in PDF format to the customer.

[2116] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[2117] The processing flow will be explained below.

[2118] User authentication process steps

[2119] Step 1:

[2120] The user accesses the system login screen on the terminal and enters the user name and password.

[2121] Step 2:

[2122] The terminal sends the entered username and password to the server.

[2123] Step 3:

[2124] The server checks the received username and password against the credentials in its database.

[2125] Step 4:

[2126] The server sends the result of authentication success or failure to the terminal.

[2127] Step 5:

[2128] If the device is successfully authenticated, the dashboard screen will be displayed. If authentication fails, an error message will be displayed.

[2129] Enter Customer Data Processing Steps

[2130] Step 1:

[2131] The user clicks the New Enquiry button on the dashboard screen.

[2132] Step 2:

[2133] The terminal displays a new inquiry screen, and the user enters the customer's name, contact information, needs, etc.

[2134] Step 3:

[2135] The terminal transmits the entered customer information to the server.

[2136] Step 4:

[2137] The server stores the received customer information in a database.

[2138] Step 5:

[2139] The server searches a database for past query history and related suggestions.

[2140] Step 6:

[2141] The server sends the search results to the terminal.

[2142] Step 7:

[2143] The device displays the search results for the user to review.

[2144] Process steps for creating a quote

[2145] Step 1:

[2146] The user selects a product or service on the new inquiry screen and enters the quantity.

[2147] Step 2:

[2148] The terminal transmits the selected product information and quantity to the server.

[2149] Step 3:

[2150] The server calculates the product price and delivery date based on the data received.

[2151] Step 4:

[2152] The server automatically generates an estimate and sends the details to the terminal.

[2153] Step 5:

[2154] The terminal displays the estimate details, which the user can confirm and modify.

[2155] Step 6:

[2156] If the user wishes to amend the estimate, he / she inputs the amendments.

[2157] Step 7:

[2158] The terminal transmits the corrected quotation data to the server again.

[2159] Step 8:

[2160] The server transmits the regenerated quotation reflecting the corrections to the terminal.

[2161] Steps for converting quotes to PDF

[2162] Step 1:

[2163] The user clicks the button to generate the final confirmed quotation PDF.

[2164] Step 2:

[2165] The terminal sends the final confirmed quotation data to the server.

[2166] Step 3:

[2167] The server converts the quote into PDF format.

[2168] Step 4:

[2169] The server sends the generated PDF file to the terminal.

[2170] Step 5:

[2171] The device displays a downloadable link to the user.

[2172] Session termination processing steps

[2173] Step 1:

[2174] The user clicks the system shutdown button.

[2175] Step 2:

[2176] The terminal sends a termination signal to the server.

[2177] Step 3:

[2178] The server stores all session data securely in a database.

[2179] Step 4:

[2180] The server terminates the session and sends a termination confirmation message to the terminal.

[2181] Step 5:

[2182] The terminal displays a confirmation message to the user.

[2183] Example 1

[2184] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2185] Conventional customer management systems have a complicated process from user authentication to creating quotes and completing the process, making it difficult to operate efficiently and respond quickly to customers. Automatically generating quotes also requires a lot of manual corrections, which takes time and effort, reducing the efficiency of sales activities. Furthermore, the process of converting quotes into PDF format and providing them to customers is also time-consuming, creating a bottleneck in workplaces where a quick response is required.

[2186] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2187] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for searching for past inquiry history based on the customer information input by the user and providing related proposals, and means for automatically generating a quote by referring to the product unit price and inventory status based on the product information and quantity selected by the user. This allows users to perform consistent operations within the system, enabling efficient and rapid customer service and quote creation.

[2188] "User authentication" is the process of verifying access rights by checking the authentication information provided by a user when accessing a system against a database.

[2189] The "dashboard screen" is a screen that provides a user who has been successfully authenticated with an integrated interface for operating and managing the system.

[2190] "Customer information" refers to individual information such as a customer's name, contact details, and needs, and is data managed by the system.

[2191] "Inquiry history" refers to a record of inquiries received from customers in the past and responses to those inquiries.

[2192] "Quotation" means a document or data that calculates the price and delivery time of goods or services to be provided.

[2193] "PDF format" is an abbreviation for Portable Document Format, a file format that allows documents to be saved and displayed in their original layout.

[2194] A "session" refers to the period of time during which a user performs a series of operations and processes from the time the user logs in to the time the user logs out of the system.

[2195] A "database" is a system for systematically storing and managing information, and is used to store customer information, authentication information, etc.

[2196] "Searching" is the process of finding data that meets specific criteria from information in a database.

[2197] "Automatic generation" refers to the system automatically creating data or documents without human intervention.

[2198] "Stock status" is information that indicates how much of a particular product is currently in stock.

[2199] MODE FOR CARRYING OUT THE INVENTION

[2200] The system of the present invention provides multiple functions to enable users to efficiently and quickly respond to customers and create quotes. The main hardware used includes a server and a terminal (e.g., a user's PC or smartphone). The software includes a database system (e.g., MySQL or PostgreSQL) and a PDF generation library (e.g., PDFKit).

[2201] User Authentication

[2202] In the user authentication process, a user first accesses the system and enters their username and password on the login screen. The terminal sends this authentication information to the server, which then checks it against the registration information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[2203] Customer information management

[2204] When a user clicks the New Inquiry button on the dashboard, a screen for entering new customer information appears. The user enters the customer's name, contact information, needs, etc., and the device sends this information to the server. The server stores the received customer information in a database, searches past inquiry history, and sends relevant suggestions to the device. The device displays the search results to the user, helping them to provide appropriate responses and suggestions.

[2205] Automatic quote generation

[2206] When a user selects a product or service on the dashboard and enters the quantity, the terminal sends this information to the server. The server references the unit price and stock status of each product and automatically generates a quote. The server then sends the generated quote to the terminal, which displays the quote details to the user. The user can check the details and make any necessary corrections. Once the corrections have been made, the quote is sent again from the terminal to the server, which checks the corrections, generates a final quote, and sends it to the terminal.

[2207] Convert quotation to PDF

[2208] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which then makes the PDF file available for download, allowing the user to easily download the quote and provide it to the customer.

[2209] Session End

[2210] When the user wants to finish using the system, he clicks the Exit button. The terminal sends an exit signal to the server, which then securely stores all session data in a database and ends the user's session. The terminal then displays a message to the user confirming the end of the session.

[2211] Specific examples

[2212] Initial quote creation process

[2213] The user logs in and displays the dashboard screen. They press the New Inquiry button and enter customer information (name, contact details, requirements). The terminal sends the entered data to the server, which saves it in a database. The server searches past inquiry history and sends the results to the terminal for display. The user selects product A and product B and enters the quantities of each. The terminal sends the product information to the server, which automatically generates a quote. The quote details are displayed on the terminal, and the user can confirm and make corrections. The server regenerates the corrected quote and sends it to the terminal, where it is converted to PDF format and made available for download.

[2214] Prompt Sentence Examples

[2215] Here is an example of a prompt to input to a generative AI model:

[2216] Customer Name:Taro Tanaka

[2217] Contact: tanaka@example.com

[2218] Requirements: New Project Quotation

[2219] As a result, the present invention can realize efficient and accurate customer service and quotation creation, thereby improving the productivity of sales activities.

[2220] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2221] Program processing steps

[2222] User Authentication

[2223] Step 1:

[2224] Enter: The user enters their username and password into the login screen.

[2225] Action: The user clicks the "Login" button.

[2226] Output: The device sends this authentication information to the server.

[2227] Step 2:

[2228] Input: Credentials (username, password).

[2229] How it works: The server checks the received authentication information against its database.

[2230] Output: Based on the matching result, a flag indicating authentication success or failure is generated.

[2231] Step 3:

[2232] Input: Matching result.

[2233] Operation: If authentication is successful, the server generates the dashboard screen.

[2234] Output: The generated dashboard screen.

[2235] Step 4:

[2236] Input: The generated dashboard screen.

[2237] Operation: The server sends the dashboard screen to the device.

[2238] Output: The device displays the dashboard screen to the user.

[2239] Customer information management

[2240] Step 1:

[2241] Input: The user clicks the New Inquiry button and enters new customer information.

[2242] Action: Fills out a customer information form.

[2243] Output: The device sends the input data to the server.

[2244] Step 2:

[2245] Input: Customer information (name, contact details, needs, etc.).

[2246] Operation: The server stores the received customer information in a database.

[2247] Output: Save completion status.

[2248] Step 3:

[2249] Input: Customer Information.

[2250] Operation: The server searches the database for past query history.

[2251] Output: Search results (past inquiry history).

[2252] Step 4:

[2253] Input: Search results.

[2254] Operation: The server generates relevant suggestions and sends them to the device.

[2255] Output: Proposal.

[2256] Step 5:

[2257] Input: Proposal content.

[2258] Action: The device displays the suggestions to the user.

[2259] Output: The user prepares an appropriate response or suggestion.

[2260] Automatic quote generation

[2261] Step 1:

[2262] Input: The user selects a product or service and enters its quantity.

[2263] Action: Select product and enter quantity.

[2264] Output: The terminal sends product information and quantity to the server.

[2265] Step 2:

[2266] Input: Product information and quantity.

[2267] Operation: Based on the information received by the server, the product's unit price and stock status are looked up in the database.

[2268] Output: Product unit price and stock information.

[2269] Step 3:

[2270] Input: Item unit price and stock information.

[2271] Operation: The server calculates the estimated amount and automatically generates a quote.

[2272] Output: The generated quote.

[2273] Step 4:

[2274] Input: Generated quote.

[2275] Action: The server sends the quote to the device.

[2276] Output: The terminal displays the quote to the user.

[2277] Step 5:

[2278] Input: Quote details.

[2279] What happens: The user reviews the quote and makes any necessary adjustments.

[2280] Output: The corrections.

[2281] Step 6:

[2282] Input: Corrections.

[2283] Action: The device resends the revised quote to the server.

[2284] Output: Revised quote.

[2285] Step 7:

[2286] Enter: Revised quote.

[2287] Action: The server reflects the modifications and generates the final quote.

[2288] Output: Final quote.

[2289] Convert quotation to PDF

[2290] Step 1:

[2291] Enter: Final quote.

[2292] Action: The server generates a quote in PDF format.

[2293] Output: The generated PDF file.

[2294] Step 2:

[2295] Input: The generated PDF file.

[2296] Action: The server sends a PDF file to the device.

[2297] Output: The device receives the PDF file.

[2298] Step 3:

[2299] Input: PDF file.

[2300] What it does: The device makes the PDF file available for download.

[2301] Output: Download link.

[2302] Session End

[2303] Step 1:

[2304] Input: The user clicks the Finish button.

[2305] Action: Click on the Exit button.

[2306] Output: The terminal sends a termination signal to the server.

[2307] Step 2:

[2308] Input: Termination signal.

[2309] How it works: The server saves the session data to a database.

[2310] Output: Save completion status.

[2311] Step 3:

[2312] Input: Saved status.

[2313] Action: The server ends the session.

[2314] Output: A message confirming the end of the session.

[2315] Step 4:

[2316] Input: Session termination confirmation message.

[2317] Action: The terminal displays a confirmation message to the user.

[2318] Output: The user confirms the system shutdown.

[2319] (Application example 1)

[2320] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2321] Conventional customer information management and quotation creation systems are often inefficient when interactively proposing products and services. They also involve a large amount of manual work, placing a heavy burden on sales representatives and increasing the likelihood of errors. Virtual stores, in particular, require technology that can instantly obtain customer information and generate accurate quotations quickly and on the spot.

[2322] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2323] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching and displaying past inquiry history and related proposals, means for automatically generating a quote, calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it downloadable, means for receiving an instruction to end the session, saving the data, and ending the session, means for accepting voice input and eye gaze input using smart glasses, means for acquiring customer orders based on the voice input, automatically generating a quote and displaying it on the smart glasses, and means for converting the quote into PDF format and making it sendable via voice command. This enables interactive and efficient customer service and quote generation in a virtual store.

[2324] "User authentication" is a method of verifying the identity of a user accessing a system by checking the authentication information against a database.

[2325] The "dashboard screen" is an operation interface that is displayed to an authenticated user, and is a means for providing main functions and information in an integrated manner.

[2326] "Customer information" refers to information such as a customer's name, contact details, and needs that is entered and saved based on new inquiries and past history.

[2327] "Automatic quotation generation" is a means of automatically generating a quotation by calculating the price and delivery date based on the product information and quantity selected by the user.

[2328] "PDF conversion" is a method of converting an automatically generated quotation into a PDF format so that the user can download or send it.

[2329] "Smart glasses" are a display device worn on the head and are a wearable device that can accept voice and eye input.

[2330] "Voice input" is a means of recognizing a user's voice and processing it as instructions or information within the system.

[2331] "Eye gaze input" is an interface technology that tracks the user's gaze to perform operations and selections.

[2332] "End of session" is a method for saving data and safely closing a session when a user finishes using the system.

[2333] The present invention provides a system that covers user authentication, dashboard screen generation, customer information management, automatic quotation generation, PDF conversion, operation using voice and eye gaze input, and even session termination. The detailed form for realizing this system is shown below.

[2334] 1. User Authentication

[2335] The user enters authentication information (user name and password) to access the system. The terminal sends this authentication information to the server, which then authenticates the user by checking it against the registered information in the database. If authentication is successful, the server generates a dashboard screen and sends it to the terminal. The terminal then displays the generated dashboard screen to the user.

[2336] 2. Customer information management

[2337] The user clicks the "New Inquiry" button and enters new customer information. The terminal sends the entered customer information to the server, which stores it in a database. The server then searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal then displays the search results to the user, allowing them to make appropriate responses and suggestions.

[2338] 3. Automatic quotation generation

[2339] The user selects products or services on the dashboard and enters their quantities. The terminal sends the selected product information and quantities to the server, which then uses the received information to automatically generate a quote by referencing the unit price and stock status of each product. The generated quote is sent to the terminal, where the user can check its contents. If necessary, the user can modify the quote and send it back to the server. The final quote is converted to PDF format and can be downloaded by the user.

[2340] 4. PDF Conversion

[2341] Once the final quote is confirmed, the server generates a PDF version of the quote and sends it to the device, which makes the PDF file available for download.

[2342] 5. Operation via smart glasses

[2343] The user wears the smart glasses and performs operations using voice and eye contact. For example, a customer order can be captured by voice input and a quote can be automatically generated based on that. The quote can also be converted to PDF format by voice command and instantly sent to the customer.

[2344] 6. End of session

[2345] When the user wants to finish using the system, they click the Exit button or use a voice command. The device sends an exit signal to the server, which securely stores all session data in a database and ends the user's session. The device then displays a message to the user confirming the end of the session.

[2346] Hardware and software used

[2347] Hardware: Smart glasses (e.g., head-mounted display devices)

[2348] Software: Flask (a lightweight web framework for Python), pyttsx3 (speech synthesis), speech_recognition (speech recognition), pdfkit (PDF generation)

[2349] Specific examples

[2350] A salesperson wears smart glasses and selects products while interacting with the customer. For example, if a salesperson voice-inputs, "I'd like three units of product A and two units of product B, please," the system responds, "Generating a quote... The total amount is 500 yen. Please confirm the details." If the salesperson instructs, "I've confirmed it. Please convert the quote to PDF," the system responds, "The PDF has been generated. I'll send it."

[2351] Example prompts for generative AI models

[2352] I am developing an application that generates quotes and converts them to PDFs based on customer orders obtained through voice recognition. This application uses smart glasses and is controlled by the user's gaze and voice. Please tell me the operation flow for specific voice commands.

[2353] The system enables interactive and efficient customer interaction and quote generation in a virtual store, improving sales productivity.

[2354] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2355] Step 1:

[2356] Enter and submit user credentials:

[2357] A user accesses the system and enters authentication information (user name and password) into a terminal. The terminal sends this authentication information to the server. The server compares the received authentication information with the registered information in a database, performs authentication, and returns the result to the terminal. The input is the user name and password, and the output is the authentication result.

[2358] Step 2:

[2359] Generate and display dashboard screens:

[2360] The server generates a dashboard screen for the user who has been successfully authenticated and sends it to the terminal. The terminal displays the generated dashboard screen to the user. The input is the authentication result, and the output is the display of the dashboard screen.

[2361] Step 3:

[2362] Accepting new inquiries and storing customer information:

[2363] The user clicks the New Inquiry button on the dashboard and enters customer information (e.g., customer name, contact information, needs, etc.). The terminal sends the entered customer information to the server. The server stores the received customer information in a database and searches past inquiry history. The input is customer information, and the output is the stored customer information and a display of related suggestions.

[2364] Step 4:

[2365] View past enquiry history and suggestions:

[2366] The server searches past inquiry history and sends it to the terminal along with relevant suggestions. The terminal displays the search results to the user and makes appropriate responses or suggestions based on the suggestions. The input is customer information, and the output is a display of the suggestions.

[2367] Step 5:

[2368] Auto-generate and view quotes:

[2369] The user selects a product or service on the dashboard and enters the quantity. The terminal sends the selected product information and quantity to the server. Based on the received information, the server references the unit price and stock status of each product and automatically generates a quote. The generated quote is sent to the terminal and displayed to the user. The input is product information and quantity, and the output is the quote.

[2370] Step 6:

[2371] Modify and regenerate quotes:

[2372] The user checks the quote and makes any necessary corrections. The terminal sends the corrected quote to the server. The server checks the corrected information, generates a final quote, and sends it to the terminal. The input is the corrections, and the output is the corrected quote.

[2373] Step 7:

[2374] Convert and download your quote to PDF:

[2375] Once the final quote is confirmed, the server generates the quote in PDF format and sends it to the terminal, which makes the PDF file available for download by the user. The input is the final quote and the output is a PDF file.

[2376] Step 8:

[2377] Voice and gaze input with smart glasses:

[2378] The user wears smart glasses and operates them using voice and eye gaze input. For example, if the user wants to order three items of product A and two items of product B, they input the voice input. The device sends the voice input to the server, which then automatically generates a quote. The input is voice data, and the output is a display of the quote details.

[2379] Step 9:

[2380] Convert and send quotes to PDF via voice command:

[2381] The user uses a voice command to convert the quotation into PDF format and send it. The device sends this command to the server, which then converts the quotation into PDF format and sends it. The input is a voice command, and the output is the generation and transmission of a PDF file.

[2382] Step 10:

[2383] Session End:

[2384] When the user wants to finish using the system, they click the quit button or use a voice command. The device sends a quit signal to the server, which securely stores all session data and ends the session. The device then displays a message to the user confirming the end of the session. The input is the quit command, and the output is the message confirming the end of the session.

[2385] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2386] MODE FOR CARRYING OUT THE INVENTION

[2387] The system of the present invention achieves even more advanced customer service by combining user authentication, dashboard screens, customer information management, automatic quotation generation, PDF conversion, and session termination with an emotion engine that recognizes the user's emotions.

[2388] 1. User Authentication

[2389] A user accesses the system and enters a user name and password on the login screen.

[2390] The terminal sends this authentication information to the server.

[2391] The server checks the authentication information sent against the registered information in the database, and if the check is successful, user authentication is complete.

[2392] If the authentication is successful, the server generates a dashboard screen and sends it to the terminal.

[2393] The terminal displays the generated dashboard screen to the user.

[2394] 2. Customer information management

[2395] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[2396] The terminal sends the entered information (customer's name, contact details, needs, etc.) to the server.

[2397] The server stores the information in a database.

[2398] The server searches a database for past inquiry history and related suggestions and sends the results to the terminal.

[2399] The device displays the search results for the user to review.

[2400] 3. Automatic quotation generation

[2401] The user selects a product or service on the new inquiry screen and enters the quantity.

[2402] The terminal transmits the selected product information and quantity to the server.

[2403] The server calculates the product price and delivery date based on the received information.

[2404] The server automatically generates an estimate and sends the details to the terminal.

[2405] The terminal displays the estimate contents to the user, who then checks and modifies them.

[2406] The terminal transmits the revised quotation data to the server again.

[2407] The server will generate a new quotation reflecting the corrections and send it to the terminal.

[2408] 4. Convert quotation to PDF

[2409] The user clicks the button to generate the final confirmed quotation PDF.

[2410] The terminal sends the final confirmed quotation data to the server.

[2411] The server converts the quote into PDF format.

[2412] The server sends the generated PDF to the device.

[2413] The device displays a downloadable link to the user.

[2414] 5. End of session

[2415] The user clicks the system shutdown button.

[2416] The terminal sends a termination signal to the server.

[2417] The server stores all session data securely in a database.

[2418] The server terminates the session and sends a termination confirmation message to the terminal.

[2419] The terminal displays a confirmation message to the user.

[2420] 6. Emotion engine integration

[2421] The device sends the user's operation information and text input content to the emotion engine.

[2422] The emotion engine analyzes the user's input data and operation patterns to recognize their emotional state.

[2423] The recognized emotion data is sent to the server.

[2424] The server adjusts its response and suggestions based on the recognized emotion.

[2425] The device displays the adjustments to the user.

[2426] Specific examples

[2427] Example 1: Entering customer information and responding

[2428] 1. The user logs in and displays the dashboard screen.

[2429] 2. Click the New Inquiry button and enter the customer information (name, contact information, requirements).

[2430] 3. The terminal sends the input data to the server, which stores it in a database.

[2431] 4. The server searches the past inquiry history and sends relevant suggestions to the terminal for display.

[2432] 5. The emotion engine analyzes the user's input data and operation patterns and sends the emotional state to the server.

[2433] 6. The server adjusts the suggestions and responses based on the recognized emotions, and sends them to the device for display.

[2434] Example 2: Checking and correcting quote details

[2435] 1. The user selects a product or service and enters its quantity.

[2436] 2. The terminal sends the selection information and quantity to the server, which then automatically generates a quote.

[2437] 3. The server sends the generated estimate to the terminal and the user confirms it.

[2438] 4. The emotion engine sends the analysis data to the server so that the user can make modifications based on their emotions.

[2439] 5. The server receives the revised quotation data and sends the regenerated quotation to the terminal.

[2440] The present invention realizes improved customer satisfaction and more efficient sales activities by recognizing the user's emotions and taking appropriate action based on those emotions.

[2441] The processing flow will be explained below.

[2442] Processing steps for entering and responding to customer information

[2443] Step 1:

[2444] The user logs in and displays the dashboard screen.

[2445] Step 2:

[2446] The user clicks the New Inquiry button and enters customer information (name, contact details, requirements).

[2447] Step 3:

[2448] The terminal transmits the entered customer information to the server.

[2449] Step 4:

[2450] The server stores the received customer information in a database.

[2451] Step 5:

[2452] The server retrieves the customer's past inquiry history and related offers from a database.

[2453] Step 6:

[2454] The server sends the search results to the terminal.

[2455] Step 7:

[2456] The device displays the search results for the user to review.

[2457] Step 8:

[2458] The device sends the user's input data and operation patterns to the emotion engine.

[2459] Step 9:

[2460] The emotion engine analyzes the user's emotional state and transmits the emotion data to the server.

[2461] Step 10:

[2462] The server adjusts the response method and suggestions based on the emotional data received.

[2463] Step 11:

[2464] The server sends the adjusted response methods and suggestions to the terminal.

[2465] Step 12:

[2466] The device displays the adjustments to the user.

[2467] Processing steps for reviewing and amending quote details

[2468] Step 1:

[2469] The user selects a product or service on the new inquiry screen and enters the quantity.

[2470] Step 2:

[2471] The terminal transmits the selected product information and quantity to the server.

[2472] Step 3:

[2473] The server calculates the product price and delivery date based on the data received.

[2474] Step 4:

[2475] The server automatically generates an estimate and sends the details to the terminal.

[2476] Step 5:

[2477] The terminal displays the estimate details and the user confirms them.

[2478] Step 6:

[2479] If the user wishes to amend the estimate, he / she inputs the amendments.

[2480] Step 7:

[2481] The terminal transmits the corrected quotation data to the server again.

[2482] Step 8:

[2483] The server transmits the regenerated quotation that reflects the corrections to the terminal.

[2484] Step 9:

[2485] The terminal transmits the user's emotional state regarding the content of the estimate to the emotion engine.

[2486] Step 10:

[2487] The emotion engine analyzes the user's emotion regarding the quote and transmits the emotion data to the server.

[2488] Step 11:

[2489] The server further adjusts the proposal and estimate based on the emotion data.

[2490] Step 12:

[2491] The server sends the adjusted content to the terminal.

[2492] Step 13:

[2493] The device displays the adjustments to the user.

[2494] Example 2

[2495] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2496] Conventional customer service systems include authentication, customer information management, automatic quotation generation, PDF conversion, and session management, but lack the ability to properly recognize the user's emotional state and respond accordingly. This limits their ability to improve customer satisfaction and streamline sales activities. Therefore, there is a need for a system that can realize more advanced customer service by recognizing the user's emotions and responding accordingly.

[2497] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2498] In this invention, the server includes means for accepting user authentication information and verifying the authentication information against a database for authentication, means for generating and displaying a dashboard screen for a successfully authenticated user, means for displaying a screen for inputting customer information and saving the input information, means for searching for and displaying past inquiry history and related proposals, means for automatically generating a quote and calculating and displaying a price and delivery date, means for allowing the quote to be modified, means for converting the quote into PDF format and making it available for download, means for receiving an instruction to end the session, saving the data, and ending the session, means for analyzing the user's operation information and text input content to recognize the user's emotional state, and means for adjusting a response method and proposal content based on the user's emotional state. This makes it possible to improve customer satisfaction and streamline sales activities by recognizing the user's emotions and responding based on them.

[2499] "User authentication" is the process of receiving the authentication information of a user accessing a system and verifying it against a database.

[2500] The "dashboard screen" is an operation screen that is displayed after a user logs in, and is an interface that aggregates the system's main functions and information.

[2501] "Customer information management" is the process of inputting and saving information such as customer name, contact details, and needs that users enter when making a new inquiry.

[2502] "Inquiry history search" is a function that searches the database for past customer inquiry history and displays related suggestions to the user as needed.

[2503] "Automatic quotation generation" is a process that calculates the product price and delivery date based on the product information and quantity selected by the user, and automatically generates a quotation.

[2504] "PDF Conversion" is a function that converts the final confirmed quotation into PDF format and makes it available for download by the user.

[2505] "Session termination" is a process in which, when a user finishes operating the system, all session data is saved in a database and the connection with the system is terminated.

[2506] An "emotion engine" is an algorithm or model that analyzes user operation information and text input content to recognize the user's emotional state.

[2507] "Emotional data adjustment" is the process of adjusting the system's response methods and suggestions based on the user's recognized emotional state.

[2508] The system of the present invention is a highly functional customer support system that includes user authentication, a dashboard screen, customer information management, automatic quotation generation, PDF conversion, session termination, and emotion engine integration. This system performs specific data processing and data calculations using various hardware and software such as those listed below.

[2509] User Authentication

[2510] User authentication is the first process that takes place when a user accesses a system. The user enters their username and password on the login screen, and the terminal sends the entered information to the server. The server compares the information with the registration information stored in a database such as MySQL, and if authentication is successful, user authentication is complete, and the server generates a dashboard screen and sends it to the terminal. For example, consider the case where John Smith logs in using his email address and password.

[2511] Dashboard screen

[2512] The dashboard screen is the first operation screen that is displayed after a user logs in, and allows access to key functions such as entering customer information, managing new inquiries, and creating quotes. When a user clicks the New Inquiry button on the dashboard, the terminal displays a screen for entering new customer information and sends the entered information to the server.

[2513] Customer information management

[2514] Customer information management is a function that manages information such as customer name, contact details, and needs that users enter when making a new inquiry. The server stores this information in a database and can search past inquiry history and provide related suggestions. For example, when a user manages an inquiry for customer Jane Doe, the device sends the information to the database, and the server searches past inquiry history and displays suggestions.

[2515] Automatic quote generation

[2516] Automatic quote generation is a function that automatically generates quotes when a user selects a product or service and enters its quantity. The terminal sends the selected product information and quantity to the server, and the server calculates the price and delivery date using NumPy or similar. For example, if a user inquires about 100 laptops, the server generates a quote and sends it to the terminal, where the user can confirm and modify it.

[2517] Convert quotation to PDF

[2518] The PDF conversion of quotations is a function that converts final confirmed quotations into PDF format and makes them available for download by users. The server uses a PDF library such as iText or PDFBox to convert the quotation to PDF and sends it to the terminal, where the user can obtain the PDF using a download link.

[2519] Session End

[2520] Session termination is the process that occurs when a user wants to end their system operation. When the user clicks the end button, the terminal sends a termination signal to the server, and the server saves all session data in a database. For example, you can use MongoDB to store session data and send a confirmation message to the terminal when the session ends.

[2521] Emotion engine integration

[2522] The emotion engine is a function that analyzes user operation information and text input content to recognize the user's emotional state. The server can adjust the response method and proposal content based on the emotional data sent from the emotion engine and reflect it on the device. Generative AI models such as BERT and GPT-3 are often used for emotion engines. Specific examples of prompts include "Please generate an example of customer information entered in a new inquiry" and "Please explain the step-by-step process in which a user enters product information and generates a quote based on the quantity."

[2523] The system of the present invention can improve customer satisfaction and sales efficiency by recognizing the user's emotional state and responding appropriately based on that state.

[2524] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2525] Step 1:

[2526] The user accesses the system login screen and enters their username and password.

[2527] Input: Username and Password

[2528] Data processing: The device converts input information into JSON format

[2529] Output: Transformed credentials

[2530] Step 2:

[2531] The terminal transmits the entered authentication information to the server.

[2532] Input: Credentials

[2533] Data processing: None

[2534] Output: Authentication information sent to the server

[2535] Step 3:

[2536] The server checks the submitted credentials against its database.

[2537] Input: Registration information in the database and submitted authentication information

[2538] Data operations: verifying credentials through database queries (e.g., SQL queries)

[2539] Output: Authentication result (success or failure)

[2540] Step 4:

[2541] If the authentication is successful, the server generates an authentication token, generates a dashboard screen, and sends it to the terminal.

[2542] Input: Authentication result (success)

[2543] Data processing: Generating authentication tokens, generating HTML for dashboard screens

[2544] Output: Authentication token, dashboard screen

[2545] Step 5:

[2546] The terminal receives the dashboard screen and authentication token and displays them to the user.

[2547] Input: Dashboard screen, authentication token

[2548] Data processing: None

[2549] Output: Display of dashboard screen

[2550] Step 6:

[2551] A user clicks the New Inquiry button on the dashboard and enters new customer information.

[2552] Input: Customer information (name, contact details, needs, etc.)

[2553] Data processing: The device converts input information into JSON format

[2554] Output: Transformed customer information

[2555] Step 7:

[2556] The terminal transmits the entered customer information to the server.

[2557] Input: Customer Information

[2558] Data processing: None

[2559] Output: Customer information sent to the server

[2560] Step 8:

[2561] The server stores the customer information in a database.

[2562] Input: Customer Information

[2563] Data operation: Insertion into a database (e.g., SQL INSERT statement)

[2564] Output: Status message of successful save

[2565] Step 9:

[2566] The server searches a database for past inquiry history and related suggestions and sends them to the terminal.

[2567] Input: Customer Information

[2568] Data operation: database search (e.g. SQL SELECT statement)

[2569] Output: Search results (inquiry history, proposal details)

[2570] Step 10:

[2571] The terminal displays the search results to the user.

[2572] Input: Search results

[2573] Data processing: None

[2574] Output: Search results displayed

[2575] Step 11:

[2576] The user selects a product or service on the new inquiry screen and enters the quantity.

[2577] Input: Product information, quantity

[2578] Data processing: The device converts input information into JSON format

[2579] Output: Transformed product information and quantity

[2580] Step 12:

[2581] The terminal transmits the selected product information and quantity to the server.

[2582] Input: Product information, quantity

[2583] Data processing: None

[2584] Output: Product information and quantity sent to the server

[2585] Step 13:

[2586] The server calculates the product price and delivery date and automatically generates a quotation.

[2587] Input: Product information, quantity

[2588] Data calculation: price calculation (e.g., price calculation using NumPy), delivery date calculation

[2589] Output: Generated quote

[2590] Step 14:

[2591] The server sends the estimate to the terminal and displays it to the user.

[2592] Input: Quote

[2593] Data processing: None

[2594] Output: Quote sent to the terminal

[2595] Step 15:

[2596] The user confirms and modifies the estimate content, and the terminal transmits the modified data to the server.

[2597] Input: Revised quotation data

[2598] Data processing: The device converts the correction information into JSON format

[2599] Output: Correction information sent to the server

[2600] Step 16:

[2601] The server reflects the corrections, generates a new estimate, and sends it to the terminal.

[2602] Input: Correction information

[2603] Data calculation: Reflection of correction information, regeneration of estimate

[2604] Output: Regenerated quote

[2605] Step 17:

[2606] The user clicks the button to generate the final confirmed quotation PDF.

[2607] Input: None

[2608] Data processing: None

[2609] Output: PDF generation instruction

[2610] Step 18:

[2611] The terminal sends the final confirmed quotation data to the server.

[2612] Input: Final confirmed quotation data

[2613] Data processing: None

[2614] Output: Final confirmed quote data sent to the server

[2615] Step 19:

[2616] The server converts the quote into PDF format.

[2617] Input: Final confirmed quotation data

[2618] Data operations: PDF conversion (e.g., using iText or PDFBox)

[2619] Output: PDF file

[2620] Step 20:

[2621] The server sends the generated PDF to the device and displays a download link to the user.

[2622] Input: PDF file

[2623] Data processing: None

[2624] Output: Download link

[2625] Step 21:

[2626] The user clicks the system shutdown button.

[2627] Input: Exit instruction

[2628] Data processing: None

[2629] Output: End signal

[2630] Step 22:

[2631] The terminal sends a termination signal to the server.

[2632] Input: Termination signal

[2633] Data processing: None

[2634] Output: Termination signal sent to the server

[2635] Step 23:

[2636] The server saves all session data to a database and safely terminates the session.

[2637] Input: Termination signal

[2638] Data Computing: Storing session data (e.g., using MongoDB)

[2639] Output: Exit status message

[2640] Step 24:

[2641] The server sends a completion confirmation message to the terminal, which displays it to the user.

[2642] Input: Exit status message

[2643] Data processing: None

[2644] Output: Finish confirmation message

[2645] (Application example 2)

[2646] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2647] Conventional systems have difficulty recognizing a user's emotional state based on operational information and text input, and responding accordingly. This has led to problems such as lower customer satisfaction and inefficient sales activities. Furthermore, they are unable to provide optimal product recommendations or customer support based on the user's emotional state, limiting the quality of customer support.

[2648] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for accepting user authenticati...

Claims

1. means for accepting user authentication information and verifying the authentication information against a database; A means for generating and displaying a dashboard screen for a user who has been successfully authenticated; a means for displaying a screen for inputting customer information and saving the input information; a means to search and display past inquiry history and related suggestions; A means to automatically generate quotes, calculate and display prices and delivery dates; A means for enabling the content of the estimate to be modified; A means for converting the quotation into a PDF format and making it downloadable; A means for receiving an instruction to end the session, saving the data, and ending the session; A system including:

2. 10. The system of claim 1, further comprising means for a user to input customer information for a new inquiry, store said information in a database, and retrieve and display past inquiry history and related suggestions.

3. 2. The system according to claim 1, further comprising means for calculating an estimate based on the product information and quantity selected by the user, and automatically generating an estimate.

Images