system

Abstract

We provide the system. [Solution] A means of receiving billing data from user terminals, A method for automatically translating billing data into English, A method for saving translated billing data as a PDF file, A means to make saved PDF files downloadable by users, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a conventional claim data system, manual translation work was required when Englishizing claims or claim details, which consumed a great deal of time and labor. For this reason, it was difficult for users to obtain English claims quickly, and there was a problem of reduced work efficiency. Also, additional costs and processes occurred during the process of manually creating and sending Englishized claims, which was also a problem. The present invention aims to solve these problems.

Means for Solving the Problems

[0005] This invention solves the problems of the past by providing a system that includes means for receiving billing data from a user terminal, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. Specifically, by using a translation engine to convert each item of the billing data into English and saving that data as a PDF file, the system enables users to quickly obtain an English-language invoice. Furthermore, authentication means are used to ensure that users can securely access the saved PDF file.

[0006] A "user terminal" is a computer or mobile device used by a user to send billing data to the server.

[0007] "Billing data" refers to a dataset containing information for billing users, including items such as invoice number, billing date, customer name, item, and amount.

[0008] A "server" is a computer system that processes billing data received from user terminals and manages the data in cooperation with other related systems.

[0009] "Methods for automatic translation into English" refers to a program or algorithm for automatically converting billing data from Japanese to English.

[0010] A "PDF file" is an abbreviation for Portable Document Format, and refers to an electronic document format with a fixed format and content.

[0011] "Means of storage" refers to a program or system that performs the process of saving translated data as a file on a storage medium in a specified format.

[0012] "Means of enabling downloads" refers to a function that allows users to download files stored on a server to their own devices.

[0013] A "system" is a combination of a series of devices and software that include the aforementioned constituent means and function in cooperation with each other.

[0014] A "translation engine" is software, algorithms, or a combination thereof used to convert text data into another language.

[0015] "Authentication means" refers to a procedure or system used to verify the user's identity and permissions when accessing stored files or data. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] ]>In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention relates to a system in which a user terminal sends billing data to a server, the server automatically translates the billing data into English, saves the translated billing data in PDF format, and makes it available for the user to download. A detailed explanation of each step is provided below.

[0038] First, the user enters billing data using their device and sends it to the server. The billing data includes information such as the invoice number, billing date, customer name, item, and amount.

[0039] The server receives this billing data and uses a translation engine to automatically translate each item into English. For example, "Invoice Number" is translated as "Invoice Number" and "Billing Date" as "Billing Date". This translation process is carried out by an algorithm that analyzes the text data and outputs the corresponding English.

[0040] Once the translation is complete, the server saves the translated data as a PDF file. This process uses an advanced PDF generation library to format the translated data and write it to a PDF file. The file is saved to the server's storage, and a naming convention is applied to the filename, such as "invoice_en.pdf".

[0041] To allow users to download saved PDF files, the server generates a download link and uses authentication methods to grant access rights to the user. These authentication methods verify that the user has legitimate access permissions and may include, for example, login authentication or the generation of access keys.

[0042] Ultimately, users can download a PDF file from the specified link using their device. The downloaded PDF file contains the translated billing data accurately, allowing them to quickly obtain an English invoice.

[0043] As a concrete example, a user enters billing data, such as "Invoice Number" as "12345," "Invoice Date" as "2023-10-01," "Customer Name" as "Taro Yamada," "Item" as "Service Fee," and "Amount" as "10,000 Yen," and sends this data to the server. The server receives this data, translates it into English, saves it as a PDF file, and the user downloads that file. Because this entire process is performed quickly and efficiently, users can obtain an English version of their invoice without any additional effort or cost.

[0044] The system of the present invention significantly improves operational efficiency and provides a user-friendly environment by automating conventional manual methods of English translation, PDF generation, and downloading.

[0045] The following describes the processing flow.

[0046] Step 1:

[0047] The user enters billing data using a terminal and sends it to the server. The user enters information such as the invoice number, billing date, customer name, item, and amount, and sends the data to the server by pressing the submit button.

[0048] Step 2:

[0049] The server receives the billing data sent by the user. The received data is temporarily stored in memory and prepared for subsequent processing.

[0050] Step 3:

[0051] The server passes the received billing data to the translation engine, which automatically translates each item into English. At this stage, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," and so on. The translation engine then uses a dictionary and executes an algorithm to convert the data into the corresponding English text.

[0052] Step 4:

[0053] The server saves the translated invoice data as a PDF file. The server uses an advanced PDF generation library to format the translated data and write it as a PDF file to the specified path. In this example, the file name will be "invoice_en.pdf".

[0054] Step 5:

[0055] The server sets up authentication methods to allow users to download stored PDF files. The server verifies the user's authentication information and generates a download link for legitimate users. Authentication can be done using a username, password, or temporary access key.

[0056] Step 6:

[0057] The user uses their device to access a download link sent from the server. The user opens the link using their device's browser or a dedicated application, enters their authentication information, and is authenticated.

[0058] Step 7:

[0059] The server verifies the user's authentication, and if successful, grants the user access to download the file. The user can then download the "invoice_en.pdf" file to their device and review its contents.

[0060] By following the steps outlined above, users can automatically obtain their invoice data translated into English as a PDF file. This entire process enables efficient and rapid translation and distribution of invoices into English.

[0061] (Example 1)

[0062] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0063] Traditional systems require manual translation of invoice data into English and generation as PDF files, a cumbersome and time-consuming process. This automation is particularly necessary for companies that process a large volume of invoices. Furthermore, access control to ensure secure downloads of the generated PDF files is often inadequate, and this needs improvement.

[0064] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0065] In this invention, the server includes means for receiving billing data from a user terminal, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, means for making the saved PDF file downloadable by the user, means for user access authentication, and means for generating a download link. This makes it possible to automatically translate billing data into English, generate and save it as a PDF file, and allow the user to download it securely.

[0066] "Billing data" refers to data sent from the user's terminal to the server, including information such as invoice number, billing date, customer name, item, and amount.

[0067] "Methods for automatic translation into English" refers to the translation engine and its processing mechanism for converting each item of billing data into English.

[0068] "Methods for saving as a PDF file" refers to the process and software libraries used to format the translated invoice data into English and save it as a PDF file to the server's storage.

[0069] "Means of enabling users to download" refers to a mechanism for generating and providing links that allow users to access and download PDF files generated by the server.

[0070] "User access authentication means" refers to the authentication process and the technology used to verify whether a user has legitimate access to a download link (e.g., login authentication or access key generation).

[0071] "Means of generating download links" refers to a system that generates and provides a URL for users to access PDF files generated by the server.

[0072] This invention relates to a system that transmits billing data from a user terminal to a server, which automatically translates the billing data into English, saves the translated billing data in PDF format, and allows the user to download it.

[0073] Program processing

[0074] First, the user enters billing data using a terminal and sends it to the server. This billing data includes information such as the invoice number, billing date, customer name, item, and amount. The terminal verifies the data entered by the user and performs a formal error check. If there are no errors, the data is sent to the server.

[0075] For example, the user enters the following data on their device:

[0076] Invoice number: 12345

[0077] Billing date: 2023-10-01

[0078] Customer Name: Taro Yamada

[0079] Item: Service fee

[0080] Amount: 10,000 yen

[0081] The device detects that the "Send" button has been pressed and sends the data to the server.

[0082] The server receives billing data sent by the user and automatically translates each item into English using a translation engine (e.g., Google Translate API). This translation engine includes an algorithm that analyzes the text data and converts it into the corresponding English text. For example, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," the customer name as "Yamada Taro," the item as "Service Fee," and the amount as "10,000 yen." The translated data is temporarily stored in memory.

[0083] Next, the server saves the translated data as a PDF file. Using an advanced PDF generation library (e.g., iText or Apache® PDFBox), the translated data is formatted and written to a PDF file. The file is saved to the server's storage and named something like "invoice_en.pdf". The server writes the translated data to the PDF in the format "Invoice Number: 12345, Billing Date: 2023-10-01, Customer: Yamada Taro, Item: Service Fee, Amount: 10000 yen".

[0084] Furthermore, the server generates a link that allows the user to download the generated PDF file. At the same time, it authenticates the user (e.g., login authentication or generation of access keys) and sets access rights. This ensures that the user can access the PDF file securely.

[0085] Ultimately, the user accesses a download link provided by the server using their device. The user downloads a PDF file from the link and reviews the invoice data translated into English. For example, the user accesses "https: / / example.com / download / invoice_en.pdf" on their device, saves "invoice_en.pdf" using their browser's download function, and reviews its contents.

[0086] Examples of prompts for generative AI models

[0087] The following is an example of a prompt to input into a generative AI model (e.g., ChatGPT®):

[0088] Please describe the specific steps involved in a system that translates Japanese invoice data into English, saves it as a PDF file, and allows users to download it. For example, please describe in detail the steps for a case where the invoice number is "12345", the invoice date is "2023-10-01", the customer name is "Taro Yamada", the item is "Service Usage Fee", and the amount is "10,000 yen".

[0089] By implementing the system based on this explanation, users can easily generate and download English versions of invoices. This significantly reduces the time and effort required, leading to increased operational efficiency.

[0090] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0091] Step 1:

[0092] The user enters the billing data and sends it to the server.

[0093] The user enters billing data using a terminal. Input fields include invoice number, billing date, customer name, item, and amount.

[0094] The terminal performs a formal error check on the entered data. For example, it verifies whether the entered date is in the correct format.

[0095] If there are no errors, the terminal sends the billing data to the server.

[0096] Input: Invoice number, invoice date, customer name, item, amount, etc.

[0097] Output: Billing data sent to the server

[0098] Specific examples of operation:

[0099] The user enters the following information into the form on the device and presses the "Submit" button. The device detects this and sends the data "Invoice Number: 12345, Invoice Date: 2023-10-01, Customer Name: Taro Yamada, Item: Service Usage Fee, Amount: 10,000 yen" to the server.

[0100] Step 2:

[0101] The server receives the billing data and performs the translation.

[0102] The server receives billing data sent by the user.

[0103] The server calls a translation engine (e.g., Google Translate API) to translate each item of the billing data into English.

[0104] The server receives the translation results from the translation engine and temporarily stores them in memory.

[0105] Input: Billing data sent to the server

[0106] Output: Data translated into English

[0107] Specific examples of operation:

[0108] The server receives the billing data and translates "Invoice Number" to "Invoice Number," "Billing Date" to "Billing Date," "Customer Name" to "Yamada Taro," "Item" to "Service Fee," and "Amount" to "10,000 yen." The translation results are stored in memory.

[0109] Step 3:

[0110] Save the translated data in PDF format.

[0111] The server saves the data translated into English as a PDF file.

[0112] The server uses a PDF generation library (e.g., iText or Apache PDFBox) to format the data and write it to a PDF file.

[0113] The server saves the generated PDF file to its storage with an appropriate filename (e.g., "invoice_en.pdf").

[0114] Input: Data translated into English

[0115] Output: Saved PDF file

[0116] Specific examples of operation:

[0117] The server formats the translated data, generates a PDF file named "invoice_en.pdf", and saves it to the server's storage.

[0118] Step 4:

[0119] Generate a link for the user to download and perform authentication.

[0120] The server generates a download link to the generated PDF file.

[0121] The server implements authentication measures (e.g., login authentication and access key generation) to ensure that users can access the server legitimately.

[0122] Input: Saved PDF file, user authentication information

[0123] Output: Download link, access key

[0124] Specific examples of operation:

[0125] The server generates a link "https: / / example.com / download / invoice_en.pdf", authenticates the user, and assigns an access key.

[0126] Step 5:

[0127] The user downloads a PDF file using their device.

[0128] The user uses their device to access the download link provided by the server.

[0129] The user downloads the PDF file from the link and checks its contents.

[0130] Input: Download link, access key

[0131] Output: Downloaded PDF file

[0132] Specific examples of operation:

[0133] The user accesses "https: / / example.com / download / invoice_en.pdf" on their device, downloads the PDF file "invoice_en.pdf", and checks its contents.

[0134] (Application Example 1)

[0135] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0136] Currently, online shopping sites lag behind in providing multilingual support for order confirmations and receipts, often requiring users to translate them manually. This translation and PDF generation process is time-consuming and inefficient. Furthermore, the download process for the generated files is cumbersome, raising security concerns. To address these issues, a system is needed that provides multilingual order confirmation generation and a user-friendly download function.

[0137] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0138] In this invention, the server includes means for receiving data from a user terminal, means for automatically translating order data into multiple languages, and means for saving the translated data as a PDF file. This enables users to efficiently and easily generate and download multilingual order confirmations.

[0139] A "user terminal" refers to a device used by a user, such as a smartphone or personal computer.

[0140] "Data" refers to information related to an order, including order number, order date, customer name, product, and price.

[0141] "Multilingual" refers to multiple different languages, such as English, Japanese, and French.

[0142] "Automatic translation" refers to the process of automatically converting input text data into a specified different language.

[0143] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing and transferring documents.

[0144] "Means of preservation" refers to measures taken to retain data for the long term, and specifically the process of saving files to server storage.

[0145] "Means of making files downloadable" refers to the process that allows users to transfer files to their devices via a network.

[0146] "Authentication methods" refer to methods for verifying a user's identity and granting appropriate access rights, and include passwords and access keys.

[0147] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate data.

[0148] This invention provides a system that efficiently generates and easily downloads multilingual order confirmations when users access e-commerce websites. Specifically, it implements a method for receiving data from the user's terminal, automatically translating that data into multiple languages, saving it in PDF format, and providing it to the user.

[0149] Program generation

[0150] First, the user enters their order information using a user device such as a smartphone. This information includes the order number, order date, customer name, product, and price. This data is then sent to the server.

[0151] Next, the server processes the received data. Translation engines such as the Google Translate API and iText, along with PDF generation libraries, are installed on the server. The server automatically translates the received data into the specified language using the Google Translate API. Based on the translated data, it generates an order confirmation in PDF format using iText and saves it to the server's storage.

[0152] The server generates a download link for the generated PDF file and provides it to the user. When the user downloads the file using this link, authentication using JWT or OAuth is performed as a security measure.

[0153] Explanation in natural language

[0154] This system requires a server, user terminals, the Google Translate API, the iText library, JWT, and OAuth to function. Order data sent from the user terminal is first received by the server. The server analyzes the received data and automatically translates it into multiple languages ​​using the Google Translate API. Based on the translated data, a PDF file is generated using the iText library and saved to the server's storage. A download link for the generated PDF file is provided to the user, and authentication is performed when the user clicks the link and downloads the file.

[0155] As a concrete example, a user enters data such as "Order Number" as "ABC123", "Order Date" as "2023-10-01", "Customer Name" as "Ichiro Tanaka", "Product" as "E-book", and "Amount" as "2000 yen", and sends it to the server. The server receives this data, translates it into English, and generates and saves it as a file named "Order_Confirmation_EN.pdf". The user can then easily download this file.

[0156] Example of a prompt

[0157] The prompt is as follows:

[0158] "Please translate the following order data into English and generate an order confirmation in PDF format. Data: Order Number: ABC123, Order Date: 2023-10-01, Customer Name: Ichiro Tanaka, Product: E-book, Amount: 2000 yen"

[0159] By implementing this system, users will be able to obtain multilingual order confirmations efficiently and easily.

[0160] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0161] Step 1:

[0162] The user enters order information on their smartphone or other user device. Input fields include order number, order date, customer name, product, and price. For example, the user might enter "Order Number: ABC123", "Order Date: 2023-10-01", "Customer Name: Tanaka Ichiro", "Product: E-book", and "Price: 2000 yen". The entered data is then sent from the user's device to the server.

[0163] Input: Order number, order date, customer name, product, amount

[0164] Output: Order information sent from the user terminal to the server.

[0165] Step 2:

[0166] The server receives order information sent from the user's terminal. The received data is temporarily stored in the server's memory.

[0167] Input: Order information sent from the user terminal

[0168] Output: Order information stored in the server's memory

[0169] Step 3:

[0170] The server processes the received order information and automatically translates the data into the specified language using the Google Translate API. For example, the order number "ABC123" is not translated as is, but the customer name "Ichiro Tanaka" is translated as "Ichiro Tanaka" and the product "e-book" is translated as "E-book".

[0171] Input: Order information stored in the server's memory

[0172] Output: Order information translated by the translation engine

[0173] Step 4:

[0174] The server uses the iText library to generate a PDF file based on the translated order information. The generated PDF file is saved to the server's storage with the filename "Order_Confirmation_EN.pdf".

[0175] Input: Order information translated by a translation engine

[0176] Output: PDF file saved on the server's storage.

[0177] Step 5:

[0178] The server generates a download link that allows the user to access the generated PDF file. This link is protected using JWT or OAuth authentication to ensure user security.

[0179] Input: PDF file stored on the server's storage

[0180] Output: Authenticated download link

[0181] Step 6:

[0182] The user performs the action of downloading the PDF file using the provided download link. If the authentication process is successful, the PDF file will be downloaded to the user's device.

[0183] Input: Authenticated download link

[0184] Output: PDF file downloaded to the user's terminal

[0185] In this way, a system is realized that allows users to efficiently and easily obtain multilingual order confirmations using devices such as smartphones.

[0186] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0187] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by incorporating an emotion engine that recognizes the user's emotions, this invention can provide a more flexible user interface. A detailed explanation of each step is provided below.

[0188] First, the user enters billing data using a terminal and sends it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount.

[0189] After receiving this billing data, the server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. For example, if the user is speaking in a dissatisfied tone, the emotion can be recognized as "dissatisfied."

[0190] Next, the server passes the received billing data to the translation engine, which automatically translates each item into English. For example, "Invoice Number" becomes "Invoice Number," and "Billing Date" becomes "Billing Date." The translation engine refers to its built-in dictionary and learning algorithm to output the corresponding English text.

[0191] Once the translation is complete, the server saves the translated data in PDF format. An advanced PDF generation library is used for saving, and the formatted data is saved as a file at the specified path. In this example, the file name will be "invoice_en.pdf".

[0192] To allow users to download saved PDF files, the server sets up authentication. This involves verifying the user's authentication information (e.g., username, password) and granting access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user.

[0193] Finally, the user downloads the PDF file from the specified link using their device. Once the user accesses the download link, enters their authentication information, and is authenticated, the PDF file is downloaded to their device. The user can then open the downloaded file and view the translated billing data.

[0194] For example, if a user enters billing data and the sentiment engine recognizes the user's sentiment as "dissatisfied," the server can display a warning message before performing the translation process. The data is then translated into English and saved as a PDF. The user can download the file via a link and review its contents. This entire process allows users to quickly and efficiently obtain an English-translated invoice.

[0195] The system of this invention not only improves work efficiency through automatic translation and PDF generation, but also enables flexible responses that respond to the user's emotions through the introduction of an emotion engine, thereby providing a more advanced user experience.

[0196] The following describes the processing flow.

[0197] Step 1:

[0198] The user enters billing data using a terminal and sends it to the server. The user enters information such as invoice number, billing date, customer name, item, and amount through the terminal's interface. Pressing the submit button sends the entered data to the server.

[0199] Step 2:

[0200] The server receives the billing data sent by the user. The received data is temporarily stored in memory, and preparations are made for subsequent processing.

[0201] Step 3:

[0202] The server uses an emotion engine to recognize emotions from user input data. The emotion engine performs text analysis, speech analysis, or facial recognition to determine the user's emotional state. For example, if a user is expressing dissatisfaction, that emotion will be recognized as "dissatisfied."

[0203] Step 4:

[0204] The server adjusts notifications and actions based on the emotion recognition results. For example, if the user's emotion is recognized as dissatisfaction, the server can display a warning message or send a notification to support staff.

[0205] Step 5:

[0206] The server passes the received billing data to the translation engine, which automatically translates each item into English. The server converts the invoice number to "Invoice Number," the billing date to "Billing Date," and so on. The translation engine uses an internal dictionary and machine learning algorithms to generate the corresponding English text.

[0207] Step 6:

[0208] The server saves the translated data as a PDF file. The server uses a PDF generation library to format the translated data and writes it as a PDF file to the specified path. The saved file will be named, for example, "invoice_en.pdf".

[0209] Step 7:

[0210] The server applies authentication to configure user access to downloadable PDF files. The server verifies the user's authentication information (e.g., username and password) and generates a download link for legitimate users.

[0211] Step 8:

[0212] The user accesses a download link sent from the server using their device. The user clicks the link and enters authentication information if necessary.

[0213] Step 9:

[0214] The server verifies the user's authentication, and if successful, grants the user access to download the file. Through the download link, the user can download the "invoice_en.pdf" file to their device and review the translated invoice data.

[0215] By executing these steps sequentially, users can quickly and efficiently obtain invoices translated into English. Furthermore, the emotion engine enables flexible responses that take into account the user's emotional state, providing a more sophisticated user experience.

[0216] (Example 2)

[0217] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0218] Traditional billing data management systems often require manual translation and PDF generation of billing data, resulting in decreased operational efficiency. Furthermore, rigid user interfaces that disregard user sentiment are prevalent, hindering the user experience. Additionally, there is a lack of secure access to translated data, highlighting the need for both convenience and security.

[0219] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data from a user terminal, means for analyzing the received billing data and the user's emotional state, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This enables not only rapid and efficient translation of billing data into English and conversion to PDF, but also flexible responses that respond to the user's emotions. Furthermore, it enables secure access to the PDF file.

[0220] A "user terminal" refers to a device used by a user to input and transmit billing data.

[0221] "Billing data" refers to data that includes information such as invoice number, billing date, customer name, item, and amount.

[0222] An "emotion analysis engine" is a system that analyzes user input data (facial expressions, voice, text, etc.) to recognize the user's emotional state.

[0223] A "translation engine" refers to a system or software application used to automatically translate billing data into English.

[0224] "PDF format file" is an abbreviation for Portable Document Format, and refers to a file format used to store billing data.

[0225] "Authentication means" refers to a process or system used to verify the legitimacy of a user when they access a download.

[0226] A "download link" refers to a URL or link provided to a user for downloading a saved PDF file.

[0227] "Automatic translation" refers to the process of converting text into another language using a translation engine without human intervention.

[0228] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by combining this with an emotion analysis engine that recognizes the user's emotions, this invention can provide a more flexible user interface.

[0229] First, the user uses their device to enter billing data and send it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount. To accomplish this, the user opens a browser, displays the invoice creation screen, and enters the respective information into the invoice form.

[0230] The terminal sends the entered billing data to the server using the HTTP POST method. The JSON format is typically used for transmission. For example, the terminal sends a request to the server like this: "POST / api / invoice HTTP / 1.1".

[0231] After receiving the transmitted data, the server uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." If the emotion analysis engine recognizes "dissatisfaction," it can display a warning message. For example, a message such as "Are you dissatisfied with our service?"

[0232] Next, the server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[0233] Once the translation is complete, the server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[0234] To allow users to download saved PDF files, the server sets up an authentication method. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[0235] Finally, the user downloads a PDF file from a specified link using their device. By accessing the link and entering their authentication information, the user can download the PDF file to their device and view the translated billing data.

[0236] An example of a prompt statement is as follows:

[0237] Implement a system that automatically translates user invoice data into English and saves it as a PDF. User input data will include invoice number, invoice date, customer name, item, and amount. Furthermore, include a feature that uses a sentiment analysis engine to recognize user emotions and respond accordingly. The PDF file name for the translated invoice data should be "invoice_en.pdf".

[0238] This invention allows users to obtain English-translated invoices quickly and efficiently, as well as enjoy a flexible user interface powered by an emotion analysis engine. Furthermore, it enables convenient access to PDF files while ensuring security.

[0239] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0240] Step 1:

[0241] The user enters billing data using their device. The data entered includes the invoice number, billing date, customer name, item, and amount. Specifically, the user opens the form in their browser and enters "Invoice Number: 12345", "Billing Date: 2023-10-01", "Customer Name: Taro Yamada", "Item: Product A", and "Amount: 1000 yen". Once the data is complete, they press the "Submit" button.

[0242] Input: User input of billing data (invoice number, billing date, customer name, item, amount).

[0243] Output: The entered billing data is saved to the terminal.

[0244] Step 2:

[0245] The terminal sends the entered billing data to the server using the HTTP POST method. JSON format is used for transmission. As a specific example, the terminal sends a request to the server with the command "POST / api / invoice HTTP / 1.1" and includes the following billing data in the body:

[0246] {

[0247] "Invoice number": "12345",

[0248] "Invoice Date": "2023-10-01",

[0249] "Customer Name": "Taro Yamada",

[0250] "Item": "Product A",

[0251] "Amount": "1000 yen"

[0252] }

[0253] Input: Entered billing data

[0254] Output: Billing data is sent to the server.

[0255] Step 3:

[0256] The server receives the transmitted data. Next, it uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." For example, if the emotion analysis engine recognizes "dissatisfaction," the server generates a warning message.

[0257] Input: Billing data sent to the server

[0258] Output: The user's emotional state is analyzed, and a warning message is generated (if necessary).

[0259] Step 4:

[0260] The server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[0261] Input: Billing data sent to the server

[0262] Output: Billing data translated into English

[0263] Step 5:

[0264] The server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[0265] Input: Billing data translated into English

[0266] Output: A PDF file ("invoice_en.pdf") is generated and saved.

[0267] Step 6:

[0268] The server verifies the user's authentication information and grants download access if authentication is successful. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. For example, the server uses JWT (JSON Web Token) or OAuth for authentication.

[0269] Input: User authentication information (username, password)

[0270] Output: Access rights after successful authentication

[0271] Step 7:

[0272] The server generates a download link and provides it to the user. Because this link is based on an authentication token, only authenticated users can access it. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[0273] Input: Access rights after successful authentication

[0274] Output: Generate download link

[0275] Step 8:

[0276] The user downloads a PDF file from a provided link using their device. The PDF file is downloaded to the device after the user accesses the link and enters their authentication information. The user can then open the downloaded file and view the translated billing data.

[0277] Input: Download link

[0278] Output: Download PDF file (user terminal)

[0279] (Application Example 2)

[0280] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0281] Conventional claim data management systems can translate claim data and save it in PDF format, but they have the drawback of being unable to provide a flexible user interface that takes into account the emotional state of the user. Also, there was no system that could handle multiple languages corresponding to the production lines of a factory and provide feedback according to the emotional state of the workers. Therefore, there is a need to improve the user experience and production efficiency.

[0282] Means for Solving the Problems

[0283] The specific processing by the specific processing unit 290 of the data processing apparatus 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving claim data, means for automatically translating the claim data into English, an emotion engine for recognizing the emotion of the user, means for saving the translated claim data as a PDF file, and means for making the saved PDF file downloadable by the user. Thereby, it becomes possible to provide a flexible user interface according to the emotional state of the user and to efficiently manage the automatically translated claims.

[0284] (Definition of Important Words)

[0285] The "user terminal" is a general term for electronic devices that can input claim data and transmit it to the server.

[0286] The "claim data" is data that includes information related to the claim (e.g., claim number, claim date, customer name, item, amount).

[0287] "Automatic translation" is a technology that mechanically converts claim data into multiple languages.

[0288] The "emotion engine" is an algorithm and system that analyzes input data such as the user's expression, voice, and text to recognize the emotional state of the user.

[0289] A "PDF file" is a common file format for viewing, saving, and sharing electronic documents, also known as the Portable Document Format.

[0290] "Downloadable" refers to a state where a user can receive a file from a server via the internet.

[0291] A "translation engine" is an algorithm and system that performs text translation between multiple languages.

[0292] "Authentication methods" is a general term for the technologies and processes used to verify a user's credentials and grant them access rights.

[0293] Modes for carrying out the invention

[0294] In this invention, the system operates as follows: The user terminal inputs billing data (invoice number, billing date, customer name, items, amount, etc.) and sends it to the server. The server processes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. An emotion analysis module such as DeepFace is used for this analysis.

[0295] The server then passes the billing data to a translation engine for automatic translation into English. The translation engine utilizes natural language processing technologies such as the Google Translate API. Once the translation is complete, the server saves the translated data in PDF format using the FPDF library. This process involves data formatting and PDF file generation.

[0296] To allow users to download saved PDF files, the server uses authentication methods to verify the user's credentials. Upon successful authentication, the server generates a download link and provides it to the user. The user can then access the specified link on their device, enter their authentication information, and download the PDF file.

[0297] As a concrete example, consider a scenario where a user inputs billing data containing an image file named "path_to_input_image.jpg" and submits it to the server. This image contains the billing data in Japanese. If the sentiment engine recognizes the user's sentiment as "dissatisfied," the server displays a warning message to the user before performing the translation process. Next, the server extracts the text from the image, automatically translates it, and saves it in PDF format. Finally, the user can download the PDF file via the generated link and review its contents. This entire process allows the user to quickly and efficiently obtain an English-translated invoice.

[0298] Example of a prompt:

[0299] Extract the text from the image file "path_to_input_image.jpg", translate it, and save it as a PDF file. Also, perform user sentiment analysis and provide appropriate feedback.

[0300] The system of this invention enables multilingual and emotion-responsive billing data processing and is expected to have applications in factory robots and other automated environments.

[0301] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0302] (Program processing flow)

[0303] Step 1:

[0304] Billing data is input from the user terminal and sent to the server. The input data includes the invoice number, invoice date, customer name, item, and amount. As a result, the server receives the billing data.

[0305] Step 2:

[0306] The server analyzes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine uses input data such as the user's facial expressions, voice, and text to detect emotions and determines emotional states such as "dissatisfaction" and "joy" from the analysis results.

[0307] Step 3:

[0308] Based on the determined emotional state, the server generates appropriate feedback. For example, if the user is determined to be in an "unsatisfied" emotional state, the server generates a warning message such as "Please confirm the explanation again."

[0309] Step 4:

[0310] Next, the server passes the billing data to a translation engine and performs an automatic translation into English. Using a translation engine such as the Google Translate API, each item (e.g., invoice number, invoice date, customer name, etc.) is converted into the corresponding English text. [[ID=!25]]

[0311] Step 5:

[0312] The server retrieves the translated data and uses the FPDF library to generate a PDF file. As a result, the translated data is formatted and saved as "invoice_en.pdf" in the specified folder.

[0313] Step 6:

[0314] The server uses authentication methods to verify the user's credentials in order to allow the user to download the saved PDF file. Authentication uses a username and password to confirm that the user is legitimate.

[0315] Step 7:

[0316] Upon successful authentication, the server generates a download link and provides it to the user. The user accesses the specified link using their device, enters their authentication information, and downloads the file.

[0317] Step 8:

[0318] The user accesses the download link on their device, enters their authentication information, and is authenticated. Afterward, they can download the generated PDF file to their device and review the translated billing data.

[0319] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0320] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0321] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0322] [Second Embodiment]

[0323] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0324] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0325] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0326] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0327] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0328] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0329] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0330] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0331] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0332] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0333] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0334] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0335] This invention relates to a system in which a user terminal sends billing data to a server, the server automatically translates the billing data into English, saves the translated billing data in PDF format, and makes it available for the user to download. A detailed explanation of each step is provided below.

[0336] First, the user enters billing data using their device and sends it to the server. The billing data includes information such as the invoice number, billing date, customer name, item, and amount.

[0337] The server receives this billing data and uses a translation engine to automatically translate each item into English. For example, "Invoice Number" is translated as "Invoice Number" and "Billing Date" as "Billing Date". This translation process is carried out by an algorithm that analyzes the text data and outputs the corresponding English.

[0338] Once the translation is complete, the server saves the translated data as a PDF file. This process uses an advanced PDF generation library to format the translated data and write it to a PDF file. The file is saved to the server's storage, and a naming convention is applied to the filename, such as "invoice_en.pdf".

[0339] To allow users to download saved PDF files, the server generates a download link and uses authentication methods to grant access rights to the user. These authentication methods verify that the user has legitimate access permissions and may include, for example, login authentication or the generation of access keys.

[0340] Ultimately, users can download a PDF file from the specified link using their device. The downloaded PDF file contains the translated billing data accurately, allowing them to quickly obtain an English invoice.

[0341] As a concrete example, a user enters billing data, such as "Invoice Number" as "12345," "Invoice Date" as "2023-10-01," "Customer Name" as "Taro Yamada," "Item" as "Service Fee," and "Amount" as "10,000 Yen," and sends this data to the server. The server receives this data, translates it into English, saves it as a PDF file, and the user downloads that file. Because this entire process is performed quickly and efficiently, users can obtain an English version of their invoice without any additional effort or cost.

[0342] The system of the present invention significantly improves operational efficiency and provides a user-friendly environment by automating conventional manual methods of English translation, PDF generation, and downloading.

[0343] The following describes the processing flow.

[0344] Step 1:

[0345] The user enters billing data using a terminal and sends it to the server. The user enters information such as the invoice number, billing date, customer name, item, and amount, and sends the data to the server by pressing the submit button.

[0346] Step 2:

[0347] The server receives the billing data sent by the user. The received data is temporarily stored in memory and prepared for subsequent processing.

[0348] Step 3:

[0349] The server passes the received billing data to the translation engine, which automatically translates each item into English. At this stage, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," and so on. The translation engine then uses a dictionary and executes an algorithm to convert the data into the corresponding English text.

[0350] Step 4:

[0351] The server saves the translated invoice data as a PDF file. The server uses an advanced PDF generation library to format the translated data and write it as a PDF file to the specified path. In this example, the file name will be "invoice_en.pdf".

[0352] Step 5:

[0353] The server sets up authentication methods to allow users to download stored PDF files. The server verifies the user's authentication information and generates a download link for legitimate users. Authentication can be done using a username, password, or temporary access key.

[0354] Step 6:

[0355] The user uses their device to access a download link sent from the server. The user opens the link using their device's browser or a dedicated application, enters their authentication information, and is authenticated.

[0356] Step 7:

[0357] The server verifies the user's authentication, and if successful, grants the user access to download the file. The user can then download the "invoice_en.pdf" file to their device and review its contents.

[0358] By following the steps outlined above, users can automatically obtain their invoice data translated into English as a PDF file. This entire process enables efficient and rapid translation and distribution of invoices into English.

[0359] (Example 1)

[0360] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0361] Traditional systems require manual translation of invoice data into English and generation as PDF files, a cumbersome and time-consuming process. This automation is particularly necessary for companies that process a large volume of invoices. Furthermore, access control to ensure secure downloads of the generated PDF files is often inadequate, and this needs improvement.

[0362] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0363] In this invention, the server includes means for receiving billing data from a user terminal, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, means for making the saved PDF file downloadable by the user, means for user access authentication, and means for generating a download link. This makes it possible to automatically translate billing data into English, generate and save it as a PDF file, and allow the user to download it securely.

[0364] "Billing data" refers to data sent from the user's terminal to the server, including information such as invoice number, billing date, customer name, item, and amount.

[0365] "Methods for automatic translation into English" refers to the translation engine and its processing mechanism for converting each item of billing data into English.

[0366] "Methods for saving as a PDF file" refers to the process and software libraries used to format the translated invoice data into English and save it as a PDF file to the server's storage.

[0367] "Means of enabling users to download" refers to a mechanism for generating and providing links that allow users to access and download PDF files generated by the server.

[0368] "User access authentication means" refers to the authentication process and the technology used to verify whether a user has legitimate access to a download link (e.g., login authentication or access key generation).

[0369] "Means of generating download links" refers to a system that generates and provides a URL for users to access PDF files generated by the server.

[0370] This invention relates to a system that transmits billing data from a user terminal to a server, which automatically translates the billing data into English, saves the translated billing data in PDF format, and allows the user to download it.

[0371] Program processing

[0372] First, the user enters billing data using a terminal and sends it to the server. This billing data includes information such as the invoice number, billing date, customer name, item, and amount. The terminal verifies the data entered by the user and performs a formal error check. If there are no errors, the data is sent to the server.

[0373] For example, the user enters the following data on their device:

[0374] Invoice number: 12345

[0375] Billing date: 2023-10-01

[0376] Customer Name: Taro Yamada

[0377] Item: Service fee

[0378] Amount: 10,000 yen

[0379] The device detects that the "Send" button has been pressed and sends the data to the server.

[0380] The server receives billing data sent by the user and automatically translates each item into English using a translation engine (e.g., Google Translate API). This translation engine includes an algorithm that analyzes the text data and converts it into the corresponding English text. For example, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," the customer name as "Yamada Taro," the item as "Service Fee," and the amount as "10,000 yen." The translated data is temporarily stored in memory.

[0381] Next, the server saves the translated data as a PDF file. Using an advanced PDF generation library (e.g., iText or Apache PDFBox), the translated data is formatted and written to a PDF file. The file is saved to the server's storage and named something like "invoice_en.pdf". The server writes the translated data to the PDF in the format "Invoice Number: 12345, Billing Date: 2023-10-01, Customer: Yamada Taro, Item: Service Fee, Amount: 10000 yen".

[0382] Furthermore, the server generates a link that allows the user to download the generated PDF file. At the same time, it authenticates the user (e.g., login authentication or generation of access keys) and sets access rights. This ensures that the user can access the PDF file securely.

[0383] Ultimately, the user accesses a download link provided by the server using their device. The user downloads a PDF file from the link and reviews the invoice data translated into English. For example, the user accesses "https: / / example.com / download / invoice_en.pdf" on their device, saves "invoice_en.pdf" using their browser's download function, and reviews its contents.

[0384] Examples of prompts for generative AI models

[0385] The following is an example of a prompt to input into a generative AI model (e.g., ChatGPT):

[0386] Please describe the specific steps involved in a system that translates Japanese invoice data into English, saves it as a PDF file, and allows users to download it. For example, please describe in detail the steps for a case where the invoice number is "12345", the invoice date is "2023-10-01", the customer name is "Taro Yamada", the item is "Service Usage Fee", and the amount is "10,000 yen".

[0387] By implementing the system based on this explanation, users can easily generate and download English versions of invoices. This significantly reduces the time and effort required, leading to increased operational efficiency.

[0388] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0389] Step 1:

[0390] The user enters the billing data and sends it to the server.

[0391] The user enters billing data using a terminal. Input fields include invoice number, billing date, customer name, item, and amount.

[0392] The terminal performs a formal error check on the entered data. For example, it verifies whether the entered date is in the correct format.

[0393] If there are no errors, the terminal sends the billing data to the server.

[0394] Input: Invoice number, invoice date, customer name, item, amount, etc.

[0395] Output: Billing data sent to the server

[0396] Specific examples of operation:

[0397] The user enters the following information into the form on the device and presses the "Submit" button. The device detects this and sends the data "Invoice Number: 12345, Invoice Date: 2023-10-01, Customer Name: Taro Yamada, Item: Service Usage Fee, Amount: 10,000 yen" to the server.

[0398] Step 2:

[0399] The server receives the billing data and performs the translation.

[0400] The server receives billing data sent by the user.

[0401] The server calls a translation engine (e.g., Google Translate API) to translate each item of the billing data into English.

[0402] The server receives the translation results from the translation engine and temporarily stores them in memory.

[0403] Input: Billing data sent to the server

[0404] Output: Data translated into English

[0405] Specific examples of operation:

[0406] The server receives the billing data and translates "Invoice Number" to "Invoice Number," "Billing Date" to "Billing Date," "Customer Name" to "Yamada Taro," "Item" to "Service Fee," and "Amount" to "10,000 yen." The translation results are stored in memory.

[0407] Step 3:

[0408] Save the translated data in PDF format.

[0409] The server saves the data translated into English as a PDF file.

[0410] The server uses a PDF generation library (e.g., iText or Apache PDFBox) to format the data and write it to a PDF file.

[0411] The server saves the generated PDF file to its storage with an appropriate filename (e.g., "invoice_en.pdf").

[0412] Input: Data translated into English

[0413] Output: Saved PDF file

[0414] Specific examples of operation:

[0415] The server formats the translated data, generates a PDF file named "invoice_en.pdf", and saves it to the server's storage.

[0416] Step 4:

[0417] Generate a link for the user to download and perform authentication.

[0418] The server generates a download link to the generated PDF file.

[0419] The server implements authentication measures (e.g., login authentication and access key generation) to ensure that users can access the server legitimately.

[0420] Input: Saved PDF file, user authentication information

[0421] Output: Download link, access key

[0422] Specific examples of operation:

[0423] The server generates a link "https: / / example.com / download / invoice_en.pdf", authenticates the user, and assigns an access key.

[0424] Step 5:

[0425] The user downloads a PDF file using their device.

[0426] The user uses their device to access the download link provided by the server.

[0427] The user downloads the PDF file from the link and checks its contents.

[0428] Input: Download link, access key

[0429] Output: Downloaded PDF file

[0430] Specific examples of operation:

[0431] The user accesses "https: / / example.com / download / invoice_en.pdf" on their device, downloads the PDF file "invoice_en.pdf", and checks its contents.

[0432] (Application Example 1)

[0433] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0434] Currently, online shopping sites lag behind in providing multilingual support for order confirmations and receipts, often requiring users to translate them manually. This translation and PDF generation process is time-consuming and inefficient. Furthermore, the download process for the generated files is cumbersome, raising security concerns. To address these issues, a system is needed that provides multilingual order confirmation generation and a user-friendly download function.

[0435] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0436] In this invention, the server includes means for receiving data from a user terminal, means for automatically translating order data into multiple languages, and means for saving the translated data as a PDF file. This enables users to efficiently and easily generate and download multilingual order confirmations.

[0437] A "user terminal" refers to a device used by a user, such as a smartphone or personal computer.

[0438] "Data" refers to information related to an order, including order number, order date, customer name, product, and price.

[0439] "Multilingual" refers to multiple different languages, such as English, Japanese, and French.

[0440] "Automatic translation" refers to the process of automatically converting input text data into a specified different language.

[0441] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing and transferring documents.

[0442] "Means of preservation" refers to measures taken to retain data for the long term, and specifically the process of saving files to server storage.

[0443] "Means of making files downloadable" refers to the process that allows users to transfer files to their devices via a network.

[0444] "Authentication methods" refer to methods for verifying a user's identity and granting appropriate access rights, and include passwords and access keys.

[0445] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate data.

[0446] This invention provides a system that efficiently generates and easily downloads multilingual order confirmations when users access e-commerce websites. Specifically, it implements a method for receiving data from the user's terminal, automatically translating that data into multiple languages, saving it in PDF format, and providing it to the user.

[0447] Program generation

[0448] First, the user enters their order information using a user device such as a smartphone. This information includes the order number, order date, customer name, product, and price. This data is then sent to the server.

[0449] Next, the server processes the received data. Translation engines such as the Google Translate API and iText, along with PDF generation libraries, are installed on the server. The server automatically translates the received data into the specified language using the Google Translate API. Based on the translated data, it generates an order confirmation in PDF format using iText and saves it to the server's storage.

[0450] The server generates a download link for the generated PDF file and provides it to the user. When the user downloads the file using this link, authentication using JWT or OAuth is performed as a security measure.

[0451] Explanation in natural language

[0452] This system requires a server, user terminals, the Google Translate API, the iText library, JWT, and OAuth to function. Order data sent from the user terminal is first received by the server. The server analyzes the received data and automatically translates it into multiple languages ​​using the Google Translate API. Based on the translated data, a PDF file is generated using the iText library and saved to the server's storage. A download link for the generated PDF file is provided to the user, and authentication is performed when the user clicks the link and downloads the file.

[0453] As a concrete example, a user enters data such as "Order Number" as "ABC123", "Order Date" as "2023-10-01", "Customer Name" as "Ichiro Tanaka", "Product" as "E-book", and "Amount" as "2000 yen", and sends it to the server. The server receives this data, translates it into English, and generates and saves it as a file named "Order_Confirmation_EN.pdf". The user can then easily download this file.

[0454] Example of a prompt

[0455] The prompt is as follows:

[0456] "Please translate the following order data into English and generate an order confirmation in PDF format. Data: Order Number: ABC123, Order Date: 2023-10-01, Customer Name: Ichiro Tanaka, Product: E-book, Amount: 2000 yen"

[0457] By implementing this system, users will be able to obtain multilingual order confirmations efficiently and easily.

[0458] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0459] Step 1:

[0460] The user enters order information on their smartphone or other user device. Input fields include order number, order date, customer name, product, and price. For example, the user might enter "Order Number: ABC123", "Order Date: 2023-10-01", "Customer Name: Tanaka Ichiro", "Product: E-book", and "Price: 2000 yen". The entered data is then sent from the user's device to the server.

[0461] Input: Order number, order date, customer name, product, amount

[0462] Output: Order information sent from the user terminal to the server.

[0463] Step 2:

[0464] The server receives order information sent from the user's terminal. The received data is temporarily stored in the server's memory.

[0465] Input: Order information sent from the user terminal

[0466] Output: Order information stored in the server's memory

[0467] Step 3:

[0468] The server processes the received order information and automatically translates the data into the specified language using the Google Translate API. For example, the order number "ABC123" is not translated as is, but the customer name "Ichiro Tanaka" is translated as "Ichiro Tanaka" and the product "e-book" is translated as "E-book".

[0469] Input: Order information stored in the server's memory

[0470] Output: Order information translated by the translation engine

[0471] Step 4:

[0472] The server uses the iText library to generate a PDF file based on the translated order information. The generated PDF file is saved to the server's storage with the filename "Order_Confirmation_EN.pdf".

[0473] Input: Order information translated by a translation engine

[0474] Output: PDF file saved on the server's storage.

[0475] Step 5:

[0476] The server generates a download link that allows the user to access the generated PDF file. This link is protected using JWT or OAuth authentication to ensure user security.

[0477] Input: PDF file stored on the server's storage

[0478] Output: Authenticated download link

[0479] Step 6:

[0480] The user performs the action of downloading the PDF file using the provided download link. If the authentication process is completed successfully, the PDF file will be downloaded to the user's device.

[0481] Input: Authenticated download link

[0482] Output: PDF file downloaded to the user's terminal

[0483] In this way, a system is realized that allows users to efficiently and easily obtain multilingual order confirmations using devices such as smartphones.

[0484] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0485] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by incorporating an emotion engine that recognizes the user's emotions, this invention can provide a more flexible user interface. A detailed explanation of each step is provided below.

[0486] First, the user enters billing data using a terminal and sends it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount.

[0487] After receiving this billing data, the server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. For example, if the user is speaking in a dissatisfied tone, the emotion can be recognized as "dissatisfied."

[0488] Next, the server passes the received billing data to the translation engine, which automatically translates each item into English. For example, "Invoice Number" becomes "Invoice Number," and "Billing Date" becomes "Billing Date." The translation engine refers to its built-in dictionary and learning algorithm to output the corresponding English text.

[0489] Once the translation is complete, the server saves the translated data in PDF format. An advanced PDF generation library is used for saving, and the formatted data is saved as a file at the specified path. In this example, the file name will be "invoice_en.pdf".

[0490] To allow users to download saved PDF files, the server sets up authentication. This involves verifying the user's authentication information (e.g., username, password) and granting access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user.

[0491] Finally, the user downloads the PDF file from the specified link using their device. Once the user accesses the download link, enters their authentication information, and is authenticated, the PDF file is downloaded to their device. The user can then open the downloaded file and view the translated billing data.

[0492] For example, if a user enters billing data and the sentiment engine recognizes the user's sentiment as "dissatisfied," the server can display a warning message before performing the translation process. The data is then translated into English and saved as a PDF. The user can download the file via a link and review its contents. This entire process allows users to quickly and efficiently obtain an English-translated invoice.

[0493] The system of this invention not only improves work efficiency through automatic translation and PDF generation, but also enables flexible responses that respond to the user's emotions through the introduction of an emotion engine, thereby providing a more advanced user experience.

[0494] The following describes the processing flow.

[0495] Step 1:

[0496] The user enters billing data using a terminal and sends it to the server. The user enters information such as invoice number, billing date, customer name, item, and amount through the terminal's interface. Pressing the submit button sends the entered data to the server.

[0497] Step 2:

[0498] The server receives the billing data sent by the user. The received data is temporarily stored in memory, and preparations are made for subsequent processing.

[0499] Step 3:

[0500] The server uses an emotion engine to recognize emotions from user input data. The emotion engine performs text analysis, speech analysis, or facial recognition to determine the user's emotional state. For example, if a user is expressing dissatisfaction, that emotion will be recognized as "dissatisfied."

[0501] Step 4:

[0502] The server adjusts notifications and actions based on the emotion recognition results. For example, if the user's emotion is recognized as dissatisfaction, the server can display a warning message or send a notification to support staff.

[0503] Step 5:

[0504] The server passes the received billing data to the translation engine, which automatically translates each item into English. The server converts the invoice number to "Invoice Number," the billing date to "Billing Date," and so on. The translation engine uses its internal dictionary and machine learning algorithms to generate the corresponding English text.

[0505] Step 6:

[0506] The server saves the translated data as a PDF file. The server uses a PDF generation library to format the translated data and writes it as a PDF file to the specified path. The saved file will be named, for example, "invoice_en.pdf".

[0507] Step 7:

[0508] The server applies authentication to configure user access to downloadable PDF files. The server verifies the user's authentication information (e.g., username and password) and generates a download link for legitimate users.

[0509] Step 8:

[0510] The user accesses a download link sent from the server using their device. The user clicks the link and enters authentication information if necessary.

[0511] Step 9:

[0512] The server verifies the user's authentication, and if successful, grants the user access to download the file. Through the download link, the user can download the "invoice_en.pdf" file to their device and review the translated invoice data.

[0513] By executing these steps sequentially, users can quickly and efficiently obtain invoices translated into English. Furthermore, the emotion engine enables flexible responses that take into account the user's emotional state, providing a more sophisticated user experience.

[0514] (Example 2)

[0515] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0516] Traditional billing data management systems often require manual translation and PDF generation of billing data, resulting in decreased operational efficiency. Furthermore, rigid user interfaces that disregard user sentiment are prevalent, hindering the user experience. Additionally, there is a lack of secure access to translated data, highlighting the need for both convenience and security.

[0517] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data from a user terminal, means for analyzing the received billing data and the user's emotional state, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This enables not only rapid and efficient translation of billing data into English and conversion to PDF, but also flexible responses that respond to the user's emotions. Furthermore, it enables secure access to the PDF file.

[0518] A "user terminal" refers to a device used by a user to input and transmit billing data.

[0519] "Billing data" refers to data that includes information such as invoice number, billing date, customer name, item, and amount.

[0520] An "emotion analysis engine" is a system that analyzes user input data (facial expressions, voice, text, etc.) to recognize the user's emotional state.

[0521] A "translation engine" refers to a system or software application used to automatically translate billing data into English.

[0522] "PDF format file" is an abbreviation for Portable Document Format, and refers to a file format used to store billing data.

[0523] "Authentication means" refers to a process or system used to verify the legitimacy of a user when they access a download.

[0524] A "download link" refers to a URL or link provided to a user for downloading a saved PDF file.

[0525] "Automatic translation" refers to the process of converting text into another language using a translation engine without human intervention.

[0526] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by combining this with an emotion analysis engine that recognizes the user's emotions, this invention can provide a more flexible user interface.

[0527] First, the user uses their device to enter billing data and send it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount. To accomplish this, the user opens a browser, displays the invoice creation screen, and enters the respective information into the invoice form.

[0528] The terminal sends the entered billing data to the server using the HTTP POST method. The JSON format is typically used for transmission. For example, the terminal sends a request to the server like this: "POST / api / invoice HTTP / 1.1".

[0529] After receiving the transmitted data, the server uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." If the emotion analysis engine recognizes "dissatisfaction," it can display a warning message. For example, a message such as "Are you dissatisfied with our service?"

[0530] Next, the server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[0531] Once the translation is complete, the server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[0532] To allow users to download saved PDF files, the server sets up an authentication method. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[0533] Finally, the user downloads a PDF file from a specified link using their device. By accessing the link and entering their authentication information, the user can download the PDF file to their device and view the translated billing data.

[0534] An example of a prompt statement is as follows:

[0535] Implement a system that automatically translates user invoice data into English and saves it as a PDF. User input data will include invoice number, invoice date, customer name, item, and amount. Furthermore, include a feature that uses a sentiment analysis engine to recognize user emotions and respond accordingly. The PDF file name for the translated invoice data should be "invoice_en.pdf".

[0536] This invention allows users to obtain English-translated invoices quickly and efficiently, as well as enjoy a flexible user interface powered by an emotion analysis engine. Furthermore, it enables convenient access to PDF files while ensuring security.

[0537] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0538] Step 1:

[0539] The user enters billing data using their device. The data entered includes the invoice number, billing date, customer name, item, and amount. Specifically, the user opens the form in their browser and enters "Invoice Number: 12345", "Billing Date: 2023-10-01", "Customer Name: Taro Yamada", "Item: Product A", and "Amount: 1000 yen". Once the data is complete, they press the "Submit" button.

[0540] Input: User input of billing data (invoice number, billing date, customer name, item, amount).

[0541] Output: The entered billing data is saved to the terminal.

[0542] Step 2:

[0543] The terminal sends the entered billing data to the server using the HTTP POST method. JSON format is used for transmission. As a specific example, the terminal sends a request to the server with the command "POST / api / invoice HTTP / 1.1", including the following billing data in the body:

[0544] {

[0545] "Invoice number": "12345",

[0546] "Invoice Date": "2023-10-01",

[0547] "Customer Name": "Taro Yamada",

[0548] "Item": "Product A",

[0549] "Amount": "1000 yen"

[0550] }

[0551] Input: Entered billing data

[0552] Output: Billing data is sent to the server.

[0553] Step 3:

[0554] The server receives the transmitted data. Next, it uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." For example, if the emotion analysis engine recognizes "dissatisfaction," the server generates a warning message.

[0555] Input: Billing data sent to the server

[0556] Output: The user's emotional state is analyzed, and a warning message is generated (if necessary).

[0557] Step 4:

[0558] The server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[0559] Input: Billing data sent to the server

[0560] Output: Billing data translated into English

[0561] Step 5:

[0562] The server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[0563] Input: Billing data translated into English

[0564] Output: A PDF file ("invoice_en.pdf") is generated and saved.

[0565] Step 6:

[0566] The server verifies the user's authentication information and grants download access if authentication is successful. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. For example, the server uses JWT (JSON Web Token) or OAuth for authentication.

[0567] Input: User authentication information (username, password)

[0568] Output: Access rights after successful authentication

[0569] Step 7:

[0570] The server generates a download link and provides it to the user. Because this link is based on an authentication token, only authenticated users can access it. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[0571] Input: Access rights after successful authentication

[0572] Output: Generate download link

[0573] Step 8:

[0574] The user downloads a PDF file from a provided link using their device. The PDF file is downloaded to the device after the user accesses the link and enters their authentication information. The user can then open the downloaded file and view the translated billing data.

[0575] Input: Download link

[0576] Output: Download PDF file (user terminal)

[0577] (Application Example 2)

[0578] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0579] Traditional billing data management systems can translate and save billing data in PDF format, but they lack the ability to provide a flexible user interface that takes into account the user's emotional state. Furthermore, there were no systems that offered multilingual support for factory production lines or provided feedback tailored to the emotional state of workers. Therefore, there is a need for improved user experience and increased production efficiency.

[0580] Means for solving the problem

[0581] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data, means for automatically translating the billing data into English, an emotion engine for recognizing the user's emotions, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This makes it possible to provide a flexible user interface that responds to the user's emotional state and to efficiently manage automatically translated invoices.

[0582] (Definitions of important words)

[0583] A "user terminal" is a general term for electronic devices that can input billing data and send it to a server.

[0584] "Billing data" refers to data that includes information related to an invoice (e.g., invoice number, invoice date, customer name, items, amount).

[0585] "Automatic translation" is a technology that mechanically converts billing data into multiple languages.

[0586] An "emotion engine" is an algorithm and system that analyzes input data such as the user's facial expressions, voice, and text to recognize the user's emotional state.

[0587] A "PDF file" is a common file format for viewing, saving, and sharing electronic documents, also known as the Portable Document Format.

[0588] "Downloadable" refers to a state where a user can receive a file from a server via the internet.

[0589] A "translation engine" is an algorithm and system that performs text translation between multiple languages.

[0590] "Authentication methods" is a general term for the technologies and processes used to verify a user's credentials and grant them access rights.

[0591] Modes for carrying out the invention

[0592] In this invention, the system operates as follows: The user terminal inputs billing data (invoice number, billing date, customer name, items, amount, etc.) and sends it to the server. The server processes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. An emotion analysis module such as DeepFace is used for this analysis.

[0593] The server then passes the billing data to a translation engine for automatic translation into English. The translation engine utilizes natural language processing technologies such as the Google Translate API. Once the translation is complete, the server saves the translated data in PDF format using the FPDF library. This process involves data formatting and PDF file generation.

[0594] To allow users to download saved PDF files, the server uses authentication methods to verify the user's credentials. Upon successful authentication, the server generates a download link and provides it to the user. The user can then access the specified link on their device, enter their authentication information, and download the PDF file.

[0595] As a concrete example, consider a scenario where a user inputs billing data containing an image file named "path_to_input_image.jpg" and submits it to the server. This image contains the billing data in Japanese. If the sentiment engine recognizes the user's sentiment as "dissatisfied," the server displays a warning message to the user before performing the translation process. Next, the server extracts the text from the image, automatically translates it, and saves it in PDF format. Finally, the user can download the PDF file via the generated link and review its contents. This entire process allows the user to quickly and efficiently obtain an English-translated invoice.

[0596] Example of a prompt:

[0597] Extract the text from the image file "path_to_input_image.jpg", translate it, and save it as a PDF file. Also, perform user sentiment analysis and provide appropriate feedback.

[0598] The system of this invention enables multilingual and emotion-responsive billing data processing and is expected to have applications in factory robots and other automated environments.

[0599] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0600] (Program processing flow)

[0601] Step 1:

[0602] Billing data is entered from the user's terminal and sent to the server. The entered data includes the invoice number, billing date, customer name, item, and amount. The server then receives the billing data.

[0603] Step 2:

[0604] The server analyzes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine uses input data such as the user's facial expressions, voice, and text to detect emotions and determines the emotional state, such as "dissatisfied" or "happy," from the analysis results.

[0605] Step 3:

[0606] The server generates appropriate feedback based on the determined emotional state. For example, if the server determines that the user is in a "dissatisfied" emotional state, it will generate a warning message such as "Please review the explanation again."

[0607] Step 4:

[0608] Next, the server passes the billing data to a translation engine for automatic translation into English. Using a translation engine such as the Google Translate API, each item (e.g., invoice number, billing date, customer name, etc.) is converted into the corresponding English text.

[0609] Step 5:

[0610] The server retrieves the translated data and generates a PDF file using the FPDF library. This formats the translated data, and it is saved as "invoice_en.pdf" in the specified folder.

[0611] Step 6:

[0612] The server uses authentication methods to verify the user's credentials in order to allow the user to download the saved PDF file. Authentication uses a username and password to confirm that the user is legitimate.

[0613] Step 7:

[0614] Upon successful authentication, the server generates a download link and provides it to the user. The user accesses the specified link using their device, enters their authentication information, and downloads the file.

[0615] Step 8:

[0616] The user accesses the download link on their device, enters their authentication information, and is authenticated. Afterward, they can download the generated PDF file to their device and review the translated billing data.

[0617] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0618] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0619] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0620] [Third Embodiment]

[0621] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0622] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0623] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0624] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0625] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0626] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0627] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0628] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0629] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0630] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0631] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0632] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0633] This invention relates to a system in which a user terminal sends billing data to a server, the server automatically translates the billing data into English, saves the translated billing data in PDF format, and makes it available for the user to download. A detailed explanation of each step is provided below.

[0634] First, the user enters billing data using their device and sends it to the server. The billing data includes information such as the invoice number, billing date, customer name, item, and amount.

[0635] The server receives this billing data and uses a translation engine to automatically translate each item into English. For example, "Invoice Number" is translated as "Invoice Number" and "Billing Date" as "Billing Date". This translation process is carried out by an algorithm that analyzes the text data and outputs the corresponding English.

[0636] Once the translation is complete, the server saves the translated data as a PDF file. This process uses an advanced PDF generation library to format the translated data and write it to a PDF file. The file is saved to the server's storage, and a naming convention is applied to the filename, such as "invoice_en.pdf".

[0637] To allow users to download saved PDF files, the server generates a download link and uses authentication methods to grant access rights to the user. These authentication methods verify that the user has legitimate access permissions and may include, for example, login authentication or the generation of access keys.

[0638] Ultimately, users can download a PDF file from the specified link using their device. The downloaded PDF file contains the translated billing data accurately, allowing them to quickly obtain an English invoice.

[0639] As a concrete example, a user enters billing data, such as "Invoice Number" as "12345," "Invoice Date" as "2023-10-01," "Customer Name" as "Taro Yamada," "Item" as "Service Fee," and "Amount" as "10,000 Yen," and sends this data to the server. The server receives this data, translates it into English, saves it as a PDF file, and the user downloads that file. Because this entire process is performed quickly and efficiently, users can obtain an English version of their invoice without any additional effort or cost.

[0640] The system of the present invention significantly improves operational efficiency and provides a user-friendly environment by automating conventional manual methods of English translation, PDF generation, and downloading.

[0641] The following describes the processing flow.

[0642] Step 1:

[0643] The user enters billing data using a terminal and sends it to the server. The user enters information such as the invoice number, billing date, customer name, item, and amount, and sends the data to the server by pressing the submit button.

[0644] Step 2:

[0645] The server receives the billing data sent by the user. The received data is temporarily stored in memory and prepared for subsequent processing.

[0646] Step 3:

[0647] The server passes the received billing data to the translation engine, which automatically translates each item into English. At this stage, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," and so on. The translation engine then uses a dictionary and executes an algorithm to convert the data into the corresponding English text.

[0648] Step 4:

[0649] The server saves the translated invoice data as a PDF file. The server uses an advanced PDF generation library to format the translated data and write it as a PDF file to the specified path. In this example, the file name will be "invoice_en.pdf".

[0650] Step 5:

[0651] The server sets up authentication methods to allow users to download stored PDF files. The server verifies the user's authentication information and generates a download link for legitimate users. Authentication can be done using a username, password, or temporary access key.

[0652] Step 6:

[0653] The user uses their device to access a download link sent from the server. The user opens the link using their device's browser or a dedicated application, enters their authentication information, and is authenticated.

[0654] Step 7:

[0655] The server verifies the user's authentication, and if successful, grants the user access to download the file. The user can then download the "invoice_en.pdf" file to their device and review its contents.

[0656] By following the steps outlined above, users can automatically obtain their invoice data translated into English as a PDF file. This entire process enables efficient and rapid translation and distribution of invoices into English.

[0657] (Example 1)

[0658] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0659] Traditional systems require manual translation of invoice data into English and generation as PDF files, a cumbersome and time-consuming process. This automation is particularly necessary for companies that process a large volume of invoices. Furthermore, access control to ensure secure downloads of the generated PDF files is often inadequate, and this needs improvement.

[0660] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0661] In this invention, the server includes means for receiving billing data from a user terminal, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, means for making the saved PDF file downloadable by the user, means for user access authentication, and means for generating a download link. This makes it possible to automatically translate billing data into English, generate and save it as a PDF file, and allow the user to download it securely.

[0662] "Billing data" refers to data sent from the user's terminal to the server, including information such as invoice number, billing date, customer name, item, and amount.

[0663] "Methods for automatic translation into English" refers to the translation engine and its processing mechanism for converting each item of billing data into English.

[0664] "Methods for saving as a PDF file" refers to the process and software libraries used to format the translated invoice data into English and save it as a PDF file to the server's storage.

[0665] "Means of enabling users to download" refers to a mechanism for generating and providing links that allow users to access and download PDF files generated by the server.

[0666] "User access authentication means" refers to the authentication process and the technology used to verify whether a user has legitimate access to a download link (e.g., login authentication or access key generation).

[0667] "Means of generating download links" refers to a system that generates and provides a URL for users to access PDF files generated by the server.

[0668] This invention relates to a system that transmits billing data from a user terminal to a server, which automatically translates the billing data into English, saves the translated billing data in PDF format, and allows the user to download it.

[0669] Program processing

[0670] First, the user enters billing data using a terminal and sends it to the server. This billing data includes information such as the invoice number, billing date, customer name, item, and amount. The terminal verifies the data entered by the user and performs a formal error check. If there are no errors, the data is sent to the server.

[0671] For example, the user enters the following data on their device:

[0672] Invoice number: 12345

[0673] Billing date: 2023-10-01

[0674] Customer Name: Taro Yamada

[0675] Item: Service fee

[0676] Amount: 10,000 yen

[0677] The device detects that the "Send" button has been pressed and sends the data to the server.

[0678] The server receives billing data sent by the user and automatically translates each item into English using a translation engine (e.g., Google Translate API). This translation engine includes an algorithm that analyzes the text data and converts it into the corresponding English text. For example, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," the customer name as "Yamada Taro," the item as "Service Fee," and the amount as "10,000 yen." The translated data is temporarily stored in memory.

[0679] Next, the server saves the translated data as a PDF file. Using an advanced PDF generation library (e.g., iText or Apache PDFBox), the translated data is formatted and written to a PDF file. The file is saved to the server's storage and named something like "invoice_en.pdf". The server writes the translated data to the PDF in the format "Invoice Number: 12345, Billing Date: 2023-10-01, Customer: Yamada Taro, Item: Service Fee, Amount: 10000 yen".

[0680] Furthermore, the server generates a link that allows the user to download the generated PDF file. At the same time, it authenticates the user (e.g., login authentication or generation of access keys) and sets access rights. This ensures that the user can access the PDF file securely.

[0681] Ultimately, the user accesses a download link provided by the server using their device. The user downloads a PDF file from the link and reviews the invoice data translated into English. For example, the user accesses "https: / / example.com / download / invoice_en.pdf" on their device, saves "invoice_en.pdf" using their browser's download function, and reviews its contents.

[0682] Examples of prompts for generative AI models

[0683] The following is an example of a prompt to input into a generative AI model (e.g., ChatGPT):

[0684] Please describe the specific steps involved in a system that translates Japanese invoice data into English, saves it as a PDF file, and allows users to download it. For example, please describe in detail the steps for a case where the invoice number is "12345", the invoice date is "2023-10-01", the customer name is "Taro Yamada", the item is "Service Usage Fee", and the amount is "10,000 yen".

[0685] By implementing the system based on this explanation, users can easily generate and download English versions of invoices. This significantly reduces the time and effort required, leading to increased operational efficiency.

[0686] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0687] Step 1:

[0688] The user enters the billing data and sends it to the server.

[0689] The user enters billing data using a terminal. Input fields include invoice number, billing date, customer name, item, and amount.

[0690] The terminal performs a formal error check on the entered data. For example, it verifies whether the entered date is in the correct format.

[0691] If there are no errors, the terminal sends the billing data to the server.

[0692] Input: Invoice number, invoice date, customer name, item, amount, etc.

[0693] Output: Billing data sent to the server

[0694] Specific examples of operation:

[0695] The user enters the following information into the form on the device and presses the "Submit" button. The device detects this and sends the data "Invoice Number: 12345, Invoice Date: 2023-10-01, Customer Name: Taro Yamada, Item: Service Usage Fee, Amount: 10,000 yen" to the server.

[0696] Step 2:

[0697] The server receives the billing data and performs the translation.

[0698] The server receives billing data sent by the user.

[0699] The server calls a translation engine (e.g., Google Translate API) to translate each item of the billing data into English.

[0700] The server receives the translation results from the translation engine and temporarily stores them in memory.

[0701] Input: Billing data sent to the server

[0702] Output: Data translated into English

[0703] Specific examples of operation:

[0704] The server receives the billing data and translates "Invoice Number" to "Invoice Number," "Billing Date" to "Billing Date," "Customer Name" to "Yamada Taro," "Item" to "Service Fee," and "Amount" to "10,000 yen." The translation results are stored in memory.

[0705] Step 3:

[0706] Save the translated data in PDF format.

[0707] The server saves the data translated into English as a PDF file.

[0708] The server uses a PDF generation library (e.g., iText or Apache PDFBox) to format the data and write it to a PDF file.

[0709] The server saves the generated PDF file to its storage with an appropriate filename (e.g., "invoice_en.pdf").

[0710] Input: Data translated into English

[0711] Output: Saved PDF file

[0712] Specific examples of operation:

[0713] The server formats the translated data, generates a PDF file named "invoice_en.pdf", and saves it to the server's storage.

[0714] Step 4:

[0715] Generate a link for the user to download and perform authentication.

[0716] The server generates a download link to the generated PDF file.

[0717] The server implements authentication measures (e.g., login authentication and access key generation) to ensure that users can access the server legitimately.

[0718] Input: Saved PDF file, user authentication information

[0719] Output: Download link, access key

[0720] Specific examples of operation:

[0721] The server generates a link "https: / / example.com / download / invoice_en.pdf", authenticates the user, and assigns an access key.

[0722] Step 5:

[0723] The user downloads a PDF file using their device.

[0724] The user uses their device to access the download link provided by the server.

[0725] The user downloads the PDF file from the link and checks its contents.

[0726] Input: Download link, access key

[0727] Output: Downloaded PDF file

[0728] Specific examples of operation:

[0729] The user accesses "https: / / example.com / download / invoice_en.pdf" on their device, downloads the PDF file "invoice_en.pdf", and checks its contents.

[0730] (Application Example 1)

[0731] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0732] Currently, online shopping sites lag behind in providing multilingual support for order confirmations and receipts, often requiring users to translate them manually. This translation and PDF generation process is time-consuming and inefficient. Furthermore, the download process for the generated files is cumbersome, raising security concerns. To address these issues, a system is needed that provides multilingual order confirmation generation and a user-friendly download function.

[0733] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0734] In this invention, the server includes means for receiving data from a user terminal, means for automatically translating order data into multiple languages, and means for saving the translated data as a PDF file. This enables users to efficiently and easily generate and download multilingual order confirmations.

[0735] A "user terminal" refers to a device used by a user, such as a smartphone or personal computer.

[0736] "Data" refers to information related to an order, including order number, order date, customer name, product, and price.

[0737] "Multilingual" refers to multiple different languages, such as English, Japanese, and French.

[0738] "Automatic translation" refers to the process of automatically converting input text data into a specified different language.

[0739] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing and transferring documents.

[0740] "Means of preservation" refers to measures taken to retain data for the long term, and specifically the process of saving files to server storage.

[0741] "Means of making files downloadable" refers to the process that allows users to transfer files to their devices via a network.

[0742] "Authentication methods" refer to methods for verifying a user's identity and granting appropriate access rights, and include passwords and access keys.

[0743] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate data.

[0744] This invention provides a system that efficiently generates and easily downloads multilingual order confirmations when users access e-commerce websites. Specifically, it implements a method for receiving data from the user's terminal, automatically translating that data into multiple languages, saving it in PDF format, and providing it to the user.

[0745] Program generation

[0746] First, the user enters their order information using a user device such as a smartphone. This information includes the order number, order date, customer name, product, and price. This data is then sent to the server.

[0747] Next, the server processes the received data. Translation engines such as the Google Translate API and iText, along with PDF generation libraries, are installed on the server. The server automatically translates the received data into the specified language using the Google Translate API. Based on the translated data, it generates an order confirmation in PDF format using iText and saves it to the server's storage.

[0748] The server generates a download link for the generated PDF file and provides it to the user. When the user downloads the file using this link, authentication using JWT or OAuth is performed as a security measure.

[0749] Explanation in natural language

[0750] This system requires a server, user terminals, the Google Translate API, the iText library, JWT, and OAuth to function. Order data sent from the user terminal is first received by the server. The server analyzes the received data and automatically translates it into multiple languages ​​using the Google Translate API. Based on the translated data, a PDF file is generated using the iText library and saved to the server's storage. A download link for the generated PDF file is provided to the user, and authentication is performed when the user clicks the link and downloads the file.

[0751] As a concrete example, a user enters data such as "Order Number" as "ABC123", "Order Date" as "2023-10-01", "Customer Name" as "Ichiro Tanaka", "Product" as "E-book", and "Amount" as "2000 yen", and sends it to the server. The server receives this data, translates it into English, and generates and saves it as a file named "Order_Confirmation_EN.pdf". The user can then easily download this file.

[0752] Example of a prompt

[0753] The prompt is as follows:

[0754] "Please translate the following order data into English and generate an order confirmation in PDF format. Data: Order Number: ABC123, Order Date: 2023-10-01, Customer Name: Ichiro Tanaka, Product: E-book, Amount: 2000 yen"

[0755] By implementing this system, users will be able to obtain multilingual order confirmations efficiently and easily.

[0756] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0757] Step 1:

[0758] The user enters order information on their smartphone or other user device. Input fields include order number, order date, customer name, product, and price. For example, the user might enter "Order Number: ABC123", "Order Date: 2023-10-01", "Customer Name: Tanaka Ichiro", "Product: E-book", and "Price: 2000 yen". The entered data is then sent from the user's device to the server.

[0759] Input: Order number, order date, customer name, product, amount

[0760] Output: Order information sent from the user terminal to the server.

[0761] Step 2:

[0762] The server receives order information sent from the user's terminal. The received data is temporarily stored in the server's memory.

[0763] Input: Order information sent from the user terminal

[0764] Output: Order information stored in the server's memory

[0765] Step 3:

[0766] The server processes the received order information and automatically translates the data into the specified language using the Google Translate API. For example, the order number "ABC123" is not translated as is, but the customer name "Ichiro Tanaka" is translated as "Ichiro Tanaka" and the product "e-book" is translated as "E-book".

[0767] Input: Order information stored in the server's memory

[0768] Output: Order information translated by the translation engine

[0769] Step 4:

[0770] The server uses the iText library to generate a PDF file based on the translated order information. The generated PDF file is saved to the server's storage with the filename "Order_Confirmation_EN.pdf".

[0771] Input: Order information translated by a translation engine

[0772] Output: PDF file saved on the server's storage.

[0773] Step 5:

[0774] The server generates a download link that allows the user to access the generated PDF file. This link is protected using JWT or OAuth authentication to ensure user security.

[0775] Input: PDF file stored on the server's storage

[0776] Output: Authenticated download link

[0777] Step 6:

[0778] The user performs the action of downloading the PDF file using the provided download link. If the authentication process is completed successfully, the PDF file will be downloaded to the user's device.

[0779] Input: Authenticated download link

[0780] Output: PDF file downloaded to the user's terminal

[0781] In this way, a system is realized that allows users to efficiently and easily obtain multilingual order confirmations using devices such as smartphones.

[0782] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0783] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by incorporating an emotion engine that recognizes the user's emotions, this invention can provide a more flexible user interface. A detailed explanation of each step is provided below.

[0784] First, the user enters billing data using a terminal and sends it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount.

[0785] After receiving this billing data, the server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. For example, if the user is speaking in a dissatisfied tone, the emotion can be recognized as "dissatisfied."

[0786] Next, the server passes the received billing data to the translation engine, which automatically translates each item into English. For example, "Invoice Number" becomes "Invoice Number," and "Billing Date" becomes "Billing Date." The translation engine refers to its built-in dictionary and learning algorithm to output the corresponding English text.

[0787] Once the translation is complete, the server saves the translated data in PDF format. An advanced PDF generation library is used for saving, and the formatted data is saved as a file at the specified path. In this example, the file name will be "invoice_en.pdf".

[0788] To allow users to download saved PDF files, the server sets up authentication. This involves verifying the user's authentication information (e.g., username, password) and granting access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user.

[0789] Finally, the user downloads the PDF file from the specified link using their device. Once the user accesses the download link, enters their authentication information, and is authenticated, the PDF file is downloaded to their device. The user can then open the downloaded file and view the translated billing data.

[0790] For example, if a user enters billing data and the sentiment engine recognizes the user's sentiment as "dissatisfied," the server can display a warning message before performing the translation process. The data is then translated into English and saved as a PDF. The user can download the file via a link and review its contents. This entire process allows users to quickly and efficiently obtain an English-translated invoice.

[0791] The system of this invention not only improves work efficiency through automatic translation and PDF generation, but also enables flexible responses that respond to the user's emotions through the introduction of an emotion engine, thereby providing a more advanced user experience.

[0792] The following describes the processing flow.

[0793] Step 1:

[0794] The user enters billing data using a terminal and sends it to the server. The user enters information such as invoice number, billing date, customer name, item, and amount through the terminal's interface. Pressing the submit button sends the entered data to the server.

[0795] Step 2:

[0796] The server receives the billing data sent by the user. The received data is temporarily stored in memory, and preparations are made for subsequent processing.

[0797] Step 3:

[0798] The server uses an emotion engine to recognize emotions from user input data. The emotion engine performs text analysis, speech analysis, or facial recognition to determine the user's emotional state. For example, if a user is expressing dissatisfaction, that emotion will be recognized as "dissatisfied."

[0799] Step 4:

[0800] The server adjusts notifications and actions based on the emotion recognition results. For example, if the user's emotion is recognized as dissatisfaction, the server can display a warning message or send a notification to support staff.

[0801] Step 5:

[0802] The server passes the received billing data to the translation engine, which automatically translates each item into English. The server converts the invoice number to "Invoice Number," the billing date to "Billing Date," and so on. The translation engine uses its internal dictionary and machine learning algorithms to generate the corresponding English text.

[0803] Step 6:

[0804] The server saves the translated data as a PDF file. The server uses a PDF generation library to format the translated data and writes it as a PDF file to the specified path. The saved file will be named, for example, "invoice_en.pdf".

[0805] Step 7:

[0806] The server applies authentication to configure user access to downloadable PDF files. The server verifies the user's authentication information (e.g., username and password) and generates a download link for legitimate users.

[0807] Step 8:

[0808] The user accesses a download link sent from the server using their device. The user clicks the link and enters authentication information if necessary.

[0809] Step 9:

[0810] The server verifies the user's authentication, and if successful, grants the user access to download the file. Through the download link, the user can download the "invoice_en.pdf" file to their device and review the translated invoice data.

[0811] By executing these steps sequentially, users can quickly and efficiently obtain invoices translated into English. Furthermore, the emotion engine enables flexible responses that take into account the user's emotional state, providing a more sophisticated user experience.

[0812] (Example 2)

[0813] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0814] Traditional billing data management systems often require manual translation and PDF generation of billing data, resulting in decreased operational efficiency. Furthermore, rigid user interfaces that disregard user sentiment are prevalent, hindering the user experience. Additionally, there is a lack of secure access to translated data, highlighting the need for both convenience and security.

[0815] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data from a user terminal, means for analyzing the received billing data and the user's emotional state, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This enables not only rapid and efficient translation of billing data into English and conversion to PDF, but also flexible responses that respond to the user's emotions. Furthermore, it enables secure access to the PDF file.

[0816] A "user terminal" refers to a device used by a user to input and transmit billing data.

[0817] "Billing data" refers to data that includes information such as invoice number, billing date, customer name, item, and amount.

[0818] An "emotion analysis engine" is a system that analyzes user input data (facial expressions, voice, text, etc.) to recognize the user's emotional state.

[0819] A "translation engine" refers to a system or software application used to automatically translate billing data into English.

[0820] "PDF format file" is an abbreviation for Portable Document Format, and refers to a file format used to store billing data.

[0821] "Authentication means" refers to a process or system used to verify the legitimacy of a user when they access a download.

[0822] A "download link" refers to a URL or link provided to a user for downloading a saved PDF file.

[0823] "Automatic translation" refers to the process of converting text into another language using a translation engine without human intervention.

[0824] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by combining this with an emotion analysis engine that recognizes the user's emotions, this invention can provide a more flexible user interface.

[0825] First, the user uses their device to enter billing data and send it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount. To accomplish this, the user opens a browser, displays the invoice creation screen, and enters the respective information into the invoice form.

[0826] The terminal sends the entered billing data to the server using the HTTP POST method. The JSON format is typically used for transmission. For example, the terminal sends a request to the server like this: "POST / api / invoice HTTP / 1.1".

[0827] After receiving the transmitted data, the server uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." If the emotion analysis engine recognizes "dissatisfaction," it can display a warning message. For example, a message such as "Are you dissatisfied with our service?"

[0828] Next, the server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[0829] Once the translation is complete, the server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[0830] To allow users to download saved PDF files, the server sets up an authentication method. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[0831] Finally, the user downloads a PDF file from a specified link using their device. By accessing the link and entering their authentication information, the user can download the PDF file to their device and view the translated billing data.

[0832] An example of a prompt statement is as follows:

[0833] Implement a system that automatically translates user invoice data into English and saves it as a PDF. User input data will include invoice number, invoice date, customer name, item, and amount. Furthermore, include a feature that uses a sentiment analysis engine to recognize user emotions and respond accordingly. The PDF file name for the translated invoice data should be "invoice_en.pdf".

[0834] This invention allows users to obtain English-translated invoices quickly and efficiently, as well as enjoy a flexible user interface powered by an emotion analysis engine. Furthermore, it enables convenient access to PDF files while ensuring security.

[0835] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0836] Step 1:

[0837] The user enters billing data using their device. The data entered includes the invoice number, billing date, customer name, item, and amount. Specifically, the user opens the form in their browser and enters "Invoice Number: 12345", "Billing Date: 2023-10-01", "Customer Name: Taro Yamada", "Item: Product A", and "Amount: 1000 yen". Once the data is complete, they press the "Submit" button.

[0838] Input: User input of billing data (invoice number, billing date, customer name, item, amount).

[0839] Output: The entered billing data is saved to the terminal.

[0840] Step 2:

[0841] The terminal sends the entered billing data to the server using the HTTP POST method. JSON format is used for transmission. As a specific example, the terminal sends a request to the server with the command "POST / api / invoice HTTP / 1.1", including the following billing data in the body:

[0842] {

[0843] "Invoice number": "12345",

[0844] "Invoice Date": "2023-10-01",

[0845] "Customer Name": "Taro Yamada",

[0846] "Item": "Product A",

[0847] "Amount": "1000 yen"

[0848] }

[0849] Input: Entered billing data

[0850] Output: Billing data is sent to the server.

[0851] Step 3:

[0852] The server receives the transmitted data. Next, it uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." For example, if the emotion analysis engine recognizes "dissatisfaction," the server generates a warning message.

[0853] Input: Billing data sent to the server

[0854] Output: The user's emotional state is analyzed, and a warning message is generated (if necessary).

[0855] Step 4:

[0856] The server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[0857] Input: Billing data sent to the server

[0858] Output: Billing data translated into English

[0859] Step 5:

[0860] The server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[0861] Input: Billing data translated into English

[0862] Output: A PDF file ("invoice_en.pdf") is generated and saved.

[0863] Step 6:

[0864] The server verifies the user's authentication information and grants download access if authentication is successful. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. For example, the server uses JWT (JSON Web Token) or OAuth for authentication.

[0865] Input: User authentication information (username, password)

[0866] Output: Access rights after successful authentication

[0867] Step 7:

[0868] The server generates a download link and provides it to the user. Because this link is based on an authentication token, only authenticated users can access it. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[0869] Input: Access rights after successful authentication

[0870] Output: Generate download link

[0871] Step 8:

[0872] The user downloads a PDF file from a provided link using their device. The PDF file is downloaded to the device after the user accesses the link and enters their authentication information. The user can then open the downloaded file and view the translated billing data.

[0873] Input: Download link

[0874] Output: Download PDF file (user terminal)

[0875] (Application Example 2)

[0876] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0877] Traditional billing data management systems can translate and save billing data in PDF format, but they lack the ability to provide a flexible user interface that takes into account the user's emotional state. Furthermore, there were no systems that offered multilingual support for factory production lines or provided feedback tailored to the emotional state of workers. Therefore, there is a need for improved user experience and increased production efficiency.

[0878] Means for solving the problem

[0879] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data, means for automatically translating the billing data into English, an emotion engine for recognizing the user's emotions, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This makes it possible to provide a flexible user interface that responds to the user's emotional state and to efficiently manage automatically translated invoices.

[0880] (Definitions of important words)

[0881] A "user terminal" is a general term for electronic devices that can input billing data and send it to a server.

[0882] "Billing data" refers to data that includes information related to an invoice (e.g., invoice number, invoice date, customer name, items, amount).

[0883] "Automatic translation" is a technology that mechanically converts billing data into multiple languages.

[0884] An "emotion engine" is an algorithm and system that analyzes input data such as the user's facial expressions, voice, and text to recognize the user's emotional state.

[0885] A "PDF file" is a common file format for viewing, saving, and sharing electronic documents, also known as the Portable Document Format.

[0886] "Downloadable" refers to a state where a user can receive a file from a server via the internet.

[0887] A "translation engine" is an algorithm and system that performs text translation between multiple languages.

[0888] "Authentication methods" is a general term for the technologies and processes used to verify a user's credentials and grant them access rights.

[0889] Modes for carrying out the invention

[0890] In this invention, the system operates as follows: The user terminal inputs billing data (invoice number, billing date, customer name, items, amount, etc.) and sends it to the server. The server processes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. An emotion analysis module such as DeepFace is used for this analysis.

[0891] The server then passes the billing data to a translation engine for automatic translation into English. The translation engine utilizes natural language processing technologies such as the Google Translate API. Once the translation is complete, the server saves the translated data in PDF format using the FPDF library. This process involves data formatting and PDF file generation.

[0892] To allow users to download saved PDF files, the server uses authentication methods to verify the user's credentials. Upon successful authentication, the server generates a download link and provides it to the user. The user can then access the specified link on their device, enter their authentication information, and download the PDF file.

[0893] As a concrete example, consider a scenario where a user inputs billing data containing an image file named "path_to_input_image.jpg" and submits it to the server. This image contains the billing data in Japanese. If the sentiment engine recognizes the user's sentiment as "dissatisfied," the server displays a warning message to the user before performing the translation process. Next, the server extracts the text from the image, automatically translates it, and saves it in PDF format. Finally, the user can download the PDF file via the generated link and review its contents. This entire process allows the user to quickly and efficiently obtain an English-translated invoice.

[0894] Example of a prompt:

[0895] Extract the text from the image file "path_to_input_image.jpg", translate it, and save it as a PDF file. Also, perform user sentiment analysis and provide appropriate feedback.

[0896] The system of this invention enables multilingual and emotion-responsive billing data processing and is expected to have applications in factory robots and other automated environments.

[0897] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0898] (Program processing flow)

[0899] Step 1:

[0900] Billing data is entered from the user's terminal and sent to the server. The entered data includes the invoice number, billing date, customer name, item, and amount. The server then receives the billing data.

[0901] Step 2:

[0902] The server analyzes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine uses input data such as the user's facial expressions, voice, and text to detect emotions and determines the emotional state, such as "dissatisfied" or "happy," from the analysis results.

[0903] Step 3:

[0904] The server generates appropriate feedback based on the determined emotional state. For example, if the server determines that the user is in a "dissatisfied" emotional state, it will generate a warning message such as "Please review the explanation again."

[0905] Step 4:

[0906] Next, the server passes the billing data to a translation engine for automatic translation into English. Using a translation engine such as the Google Translate API, each item (e.g., invoice number, billing date, customer name, etc.) is converted into the corresponding English text.

[0907] Step 5:

[0908] The server retrieves the translated data and generates a PDF file using the FPDF library. This formats the translated data, and it is saved as "invoice_en.pdf" in the specified folder.

[0909] Step 6:

[0910] The server uses authentication methods to verify the user's credentials in order to allow the user to download the saved PDF file. Authentication uses a username and password to confirm that the user is legitimate.

[0911] Step 7:

[0912] Upon successful authentication, the server generates a download link and provides it to the user. The user accesses the specified link using their device, enters their authentication information, and downloads the file.

[0913] Step 8:

[0914] The user accesses the download link on their device, enters their authentication information, and is authenticated. Afterward, they can download the generated PDF file to their device and review the translated billing data.

[0915] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0916] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0917] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0918] [Fourth Embodiment]

[0919] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0920] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0921] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0922] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0923] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0924] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0925] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0926] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0927] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0928] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0929] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0930] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0931] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0932] This invention relates to a system in which a user terminal sends billing data to a server, the server automatically translates the billing data into English, saves the translated billing data in PDF format, and makes it available for the user to download. A detailed explanation of each step is provided below.

[0933] First, the user enters billing data using their device and sends it to the server. The billing data includes information such as the invoice number, billing date, customer name, item, and amount.

[0934] The server receives this billing data and uses a translation engine to automatically translate each item into English. For example, "Invoice Number" is translated as "Invoice Number" and "Billing Date" as "Billing Date". This translation process is carried out by an algorithm that analyzes the text data and outputs the corresponding English.

[0935] Once the translation is complete, the server saves the translated data as a PDF file. This process uses an advanced PDF generation library to format the translated data and write it to a PDF file. The file is saved to the server's storage, and a naming convention is applied to the filename, such as "invoice_en.pdf".

[0936] To allow users to download saved PDF files, the server generates a download link and uses authentication methods to grant access rights to the user. These authentication methods verify that the user has legitimate access permissions and may include, for example, login authentication or the generation of access keys.

[0937] Ultimately, users can download a PDF file from the specified link using their device. The downloaded PDF file contains the translated billing data accurately, allowing them to quickly obtain an English invoice.

[0938] As a concrete example, a user enters billing data, such as "Invoice Number" as "12345," "Invoice Date" as "2023-10-01," "Customer Name" as "Taro Yamada," "Item" as "Service Fee," and "Amount" as "10,000 Yen," and sends this data to the server. The server receives this data, translates it into English, saves it as a PDF file, and the user downloads that file. Because this entire process is performed quickly and efficiently, users can obtain an English version of their invoice without any additional effort or cost.

[0939] The system of the present invention significantly improves operational efficiency and provides a user-friendly environment by automating conventional manual methods of English translation, PDF generation, and downloading.

[0940] The following describes the processing flow.

[0941] Step 1:

[0942] The user enters billing data using a terminal and sends it to the server. The user enters information such as the invoice number, billing date, customer name, item, and amount, and sends the data to the server by pressing the submit button.

[0943] Step 2:

[0944] The server receives the billing data sent by the user. The received data is temporarily stored in memory and prepared for subsequent processing.

[0945] Step 3:

[0946] The server passes the received billing data to the translation engine, which automatically translates each item into English. At this stage, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," and so on. The translation engine then uses a dictionary and executes an algorithm to convert the data into the corresponding English text.

[0947] Step 4:

[0948] The server saves the translated invoice data as a PDF file. The server uses an advanced PDF generation library to format the translated data and write it as a PDF file to the specified path. In this example, the file name will be "invoice_en.pdf".

[0949] Step 5:

[0950] The server sets up authentication methods to allow users to download stored PDF files. The server verifies the user's authentication information and generates a download link for legitimate users. Authentication can be done using a username, password, or temporary access key.

[0951] Step 6:

[0952] The user uses their device to access a download link sent from the server. The user opens the link using their device's browser or a dedicated application, enters their authentication information, and is authenticated.

[0953] Step 7:

[0954] The server verifies the user's authentication, and if successful, grants the user access to download the file. The user can then download the "invoice_en.pdf" file to their device and review its contents.

[0955] By following the steps outlined above, users can automatically obtain their invoice data translated into English as a PDF file. This entire process enables efficient and rapid translation and distribution of invoices into English.

[0956] (Example 1)

[0957] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0958] Traditional systems require manual translation of invoice data into English and generation as PDF files, a cumbersome and time-consuming process. This automation is particularly necessary for companies that process a large volume of invoices. Furthermore, access control to ensure secure downloads of the generated PDF files is often inadequate, and this needs improvement.

[0959] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0960] In this invention, the server includes means for receiving billing data from a user terminal, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, means for making the saved PDF file downloadable by the user, means for user access authentication, and means for generating a download link. This makes it possible to automatically translate billing data into English, generate and save it as a PDF file, and allow the user to download it securely.

[0961] "Billing data" refers to data sent from the user's terminal to the server, including information such as invoice number, billing date, customer name, item, and amount.

[0962] "Methods for automatic translation into English" refers to the translation engine and its processing mechanism for converting each item of billing data into English.

[0963] "Methods for saving as a PDF file" refers to the process and software libraries used to format the translated invoice data into English and save it as a PDF file to the server's storage.

[0964] "Means of enabling users to download" refers to a mechanism for generating and providing links that allow users to access and download PDF files generated by the server.

[0965] "User access authentication means" refers to the authentication process and the technology used to verify whether a user has legitimate access to a download link (e.g., login authentication or access key generation).

[0966] "Means of generating download links" refers to a system that generates and provides a URL for users to access PDF files generated by the server.

[0967] This invention relates to a system that transmits billing data from a user terminal to a server, which automatically translates the billing data into English, saves the translated billing data in PDF format, and allows the user to download it.

[0968] Program processing

[0969] First, the user enters billing data using a terminal and sends it to the server. This billing data includes information such as the invoice number, billing date, customer name, item, and amount. The terminal verifies the data entered by the user and performs a formal error check. If there are no errors, the data is sent to the server.

[0970] For example, the user enters the following data on their device:

[0971] Invoice number: 12345

[0972] Billing date: 2023-10-01

[0973] Customer Name: Taro Yamada

[0974] Item: Service fee

[0975] Amount: 10,000 yen

[0976] The device detects that the "Send" button has been pressed and sends the data to the server.

[0977] The server receives billing data sent by the user and automatically translates each item into English using a translation engine (e.g., Google Translate API). This translation engine includes an algorithm that analyzes the text data and converts it into the corresponding English text. For example, the invoice number is translated as "Invoice Number," the billing date as "Billing Date," the customer name as "Yamada Taro," the item as "Service Fee," and the amount as "10,000 yen." The translated data is temporarily stored in memory.

[0978] Next, the server saves the translated data as a PDF file. Using an advanced PDF generation library (e.g., iText or Apache PDFBox), the translated data is formatted and written to a PDF file. The file is saved to the server's storage and named something like "invoice_en.pdf". The server writes the translated data to the PDF in the format "Invoice Number: 12345, Billing Date: 2023-10-01, Customer: Yamada Taro, Item: Service Fee, Amount: 10000 yen".

[0979] Furthermore, the server generates a link that allows the user to download the generated PDF file. At the same time, it authenticates the user (e.g., login authentication or generation of access keys) and sets access rights. This ensures that the user can access the PDF file securely.

[0980] Ultimately, the user accesses a download link provided by the server using their device. The user downloads a PDF file from the link and reviews the invoice data translated into English. For example, the user accesses "https: / / example.com / download / invoice_en.pdf" on their device, saves "invoice_en.pdf" using their browser's download function, and reviews its contents.

[0981] Examples of prompts for generative AI models

[0982] The following is an example of a prompt to input into a generative AI model (e.g., ChatGPT):

[0983] Please describe the specific steps involved in a system that translates Japanese invoice data into English, saves it as a PDF file, and allows users to download it. For example, please describe in detail the steps for a case where the invoice number is "12345", the invoice date is "2023-10-01", the customer name is "Taro Yamada", the item is "Service Usage Fee", and the amount is "10,000 yen".

[0984] By implementing the system based on this explanation, users can easily generate and download English versions of invoices. This significantly reduces the time and effort required, leading to increased operational efficiency.

[0985] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0986] Step 1:

[0987] The user enters the billing data and sends it to the server.

[0988] The user enters billing data using a terminal. Input fields include invoice number, billing date, customer name, item, and amount.

[0989] The terminal performs a formal error check on the entered data. For example, it verifies whether the entered date is in the correct format.

[0990] If there are no errors, the terminal sends the billing data to the server.

[0991] Input: Invoice number, invoice date, customer name, item, amount, etc.

[0992] Output: Billing data sent to the server

[0993] Specific examples of operation:

[0994] The user enters the following information into the form on the device and presses the "Submit" button. The device detects this and sends the data "Invoice Number: 12345, Invoice Date: 2023-10-01, Customer Name: Taro Yamada, Item: Service Usage Fee, Amount: 10,000 yen" to the server.

[0995] Step 2:

[0996] The server receives the billing data and performs the translation.

[0997] The server receives billing data sent by the user.

[0998] The server calls a translation engine (e.g., Google Translate API) to translate each item of the billing data into English.

[0999] The server receives the translation results from the translation engine and temporarily stores them in memory.

[1000] Input: Billing data sent to the server

[1001] Output: Data translated into English

[1002] Specific examples of operation:

[1003] The server receives the billing data and translates "Invoice Number" to "Invoice Number," "Billing Date" to "Billing Date," "Customer Name" to "Yamada Taro," "Item" to "Service Fee," and "Amount" to "10,000 yen." The translation results are stored in memory.

[1004] Step 3:

[1005] Save the translated data in PDF format.

[1006] The server saves the data translated into English as a PDF file.

[1007] The server uses a PDF generation library (e.g., iText or Apache PDFBox) to format the data and write it to a PDF file.

[1008] The server saves the generated PDF file to its storage with an appropriate filename (e.g., "invoice_en.pdf").

[1009] Input: Data translated into English

[1010] Output: Saved PDF file

[1011] Specific examples of operation:

[1012] The server formats the translated data, generates a PDF file named "invoice_en.pdf", and saves it to the server's storage.

[1013] Step 4:

[1014] Generate a link for the user to download and perform authentication.

[1015] The server generates a download link to the generated PDF file.

[1016] The server implements authentication measures (e.g., login authentication and access key generation) to ensure that users can access the server legitimately.

[1017] Input: Saved PDF file, user authentication information

[1018] Output: Download link, access key

[1019] Specific examples of operation:

[1020] The server generates a link "https: / / example.com / download / invoice_en.pdf", authenticates the user, and assigns an access key.

[1021] Step 5:

[1022] The user downloads a PDF file using their device.

[1023] The user uses their device to access the download link provided by the server.

[1024] The user downloads the PDF file from the link and checks its contents.

[1025] Input: Download link, access key

[1026] Output: Downloaded PDF file

[1027] Specific examples of operation:

[1028] The user accesses "https: / / example.com / download / invoice_en.pdf" on their device, downloads the PDF file "invoice_en.pdf", and checks its contents.

[1029] (Application Example 1)

[1030] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1031] Currently, online shopping sites lag behind in providing multilingual support for order confirmations and receipts, often requiring users to translate them manually. This translation and PDF generation process is time-consuming and inefficient. Furthermore, the download process for the generated files is cumbersome, raising security concerns. To address these issues, a system is needed that provides multilingual order confirmation generation and a user-friendly download function.

[1032] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1033] In this invention, the server includes means for receiving data from a user terminal, means for automatically translating order data into multiple languages, and means for saving the translated data as a PDF file. This enables users to efficiently and easily generate and download multilingual order confirmations.

[1034] A "user terminal" refers to a device used by a user, such as a smartphone or personal computer.

[1035] "Data" refers to information related to an order, including order number, order date, customer name, product, and price.

[1036] "Multilingual" refers to multiple different languages, such as English, Japanese, and French.

[1037] "Automatic translation" refers to the process of automatically converting input text data into a specified different language.

[1038] "PDF format" is an abbreviation for Portable Document Format, and refers to a file format for electronically storing and transferring documents.

[1039] "Means of preservation" refers to measures taken to retain data for the long term, and specifically the process of saving files to server storage.

[1040] "Means of making files downloadable" refers to the process that allows users to transfer files to their devices via a network.

[1041] "Authentication methods" refer to methods for verifying a user's identity and granting appropriate access rights, and include passwords and access keys.

[1042] A "generative AI model" refers to an algorithm or system that uses artificial intelligence to generate data.

[1043] This invention provides a system that efficiently generates and easily downloads multilingual order confirmations when users access e-commerce websites. Specifically, it implements a method for receiving data from the user's terminal, automatically translating that data into multiple languages, saving it in PDF format, and providing it to the user.

[1044] Program generation

[1045] First, the user enters their order information using a user device such as a smartphone. This information includes the order number, order date, customer name, product, and price. This data is then sent to the server.

[1046] Next, the server processes the received data. Translation engines such as the Google Translate API and iText, along with PDF generation libraries, are installed on the server. The server automatically translates the received data into the specified language using the Google Translate API. Based on the translated data, it generates an order confirmation in PDF format using iText and saves it to the server's storage.

[1047] The server generates a download link for the generated PDF file and provides it to the user. When the user downloads the file using this link, authentication using JWT or OAuth is performed as a security measure.

[1048] Explanation in natural language

[1049] This system requires a server, user terminals, the Google Translate API, the iText library, JWT, and OAuth to function. Order data sent from the user terminal is first received by the server. The server analyzes the received data and automatically translates it into multiple languages ​​using the Google Translate API. Based on the translated data, a PDF file is generated using the iText library and saved to the server's storage. A download link for the generated PDF file is provided to the user, and authentication is performed when the user clicks the link and downloads the file.

[1050] As a concrete example, a user enters data such as "Order Number" as "ABC123", "Order Date" as "2023-10-01", "Customer Name" as "Ichiro Tanaka", "Product" as "E-book", and "Amount" as "2000 yen", and sends it to the server. The server receives this data, translates it into English, and generates and saves it as a file named "Order_Confirmation_EN.pdf". The user can then easily download this file.

[1051] Example of a prompt

[1052] The prompt is as follows:

[1053] "Please translate the following order data into English and generate an order confirmation in PDF format. Data: Order Number: ABC123, Order Date: 2023-10-01, Customer Name: Ichiro Tanaka, Product: E-book, Amount: 2000 yen"

[1054] By implementing this system, users will be able to obtain multilingual order confirmations efficiently and easily.

[1055] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1056] Step 1:

[1057] The user enters order information on their smartphone or other user device. Input fields include order number, order date, customer name, product, and price. For example, the user might enter "Order Number: ABC123", "Order Date: 2023-10-01", "Customer Name: Tanaka Ichiro", "Product: E-book", and "Price: 2000 yen". The entered data is then sent from the user's device to the server.

[1058] Input: Order number, order date, customer name, product, amount

[1059] Output: Order information sent from the user terminal to the server.

[1060] Step 2:

[1061] The server receives order information sent from the user's terminal. The received data is temporarily stored in the server's memory.

[1062] Input: Order information sent from the user terminal

[1063] Output: Order information stored in the server's memory

[1064] Step 3:

[1065] The server processes the received order information and automatically translates the data into the specified language using the Google Translate API. For example, the order number "ABC123" is not translated as is, but the customer name "Ichiro Tanaka" is translated as "Ichiro Tanaka" and the product "e-book" is translated as "E-book".

[1066] Input: Order information stored in the server's memory

[1067] Output: Order information translated by the translation engine

[1068] Step 4:

[1069] The server uses the iText library to generate a PDF file based on the translated order information. The generated PDF file is saved to the server's storage with the filename "Order_Confirmation_EN.pdf".

[1070] Input: Order information translated by a translation engine

[1071] Output: PDF file saved on the server's storage.

[1072] Step 5:

[1073] The server generates a download link that allows the user to access the generated PDF file. This link is protected using JWT or OAuth authentication to ensure user security.

[1074] Input: PDF file stored on the server's storage

[1075] Output: Authenticated download link

[1076] Step 6:

[1077] The user performs the action of downloading the PDF file using the provided download link. If the authentication process is completed successfully, the PDF file will be downloaded to the user's device.

[1078] Input: Authenticated download link

[1079] Output: PDF file downloaded to the user's terminal

[1080] In this way, a system is realized that allows users to efficiently and easily obtain multilingual order confirmations using devices such as smartphones.

[1081] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1082] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by incorporating an emotion engine that recognizes the user's emotions, this invention can provide a more flexible user interface. A detailed explanation of each step is provided below.

[1083] First, the user enters billing data using a terminal and sends it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount.

[1084] After receiving this billing data, the server uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. For example, if the user is speaking in a dissatisfied tone, the emotion can be recognized as "dissatisfied."

[1085] Next, the server passes the received billing data to the translation engine, which automatically translates each item into English. For example, "Invoice Number" becomes "Invoice Number," and "Billing Date" becomes "Billing Date." The translation engine refers to its built-in dictionary and learning algorithm to output the corresponding English text.

[1086] Once the translation is complete, the server saves the translated data in PDF format. An advanced PDF generation library is used for saving, and the formatted data is saved as a file at the specified path. In this example, the file name will be "invoice_en.pdf".

[1087] To allow users to download saved PDF files, the server sets up authentication. This involves verifying the user's authentication information (e.g., username, password) and granting access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user.

[1088] Finally, the user downloads the PDF file from the specified link using their device. Once the user accesses the download link, enters their authentication information, and is authenticated, the PDF file is downloaded to their device. The user can then open the downloaded file and view the translated billing data.

[1089] For example, if a user enters billing data and the sentiment engine recognizes the user's sentiment as "dissatisfied," the server can display a warning message before performing the translation process. The data is then translated into English and saved as a PDF. The user can download the file via a link and review its contents. This entire process allows users to quickly and efficiently obtain an English-translated invoice.

[1090] The system of this invention not only improves work efficiency through automatic translation and PDF generation, but also enables flexible responses that respond to the user's emotions through the introduction of an emotion engine, thereby providing a more advanced user experience.

[1091] The following describes the processing flow.

[1092] Step 1:

[1093] The user enters billing data using a terminal and sends it to the server. The user enters information such as invoice number, billing date, customer name, item, and amount through the terminal's interface. Pressing the submit button sends the entered data to the server.

[1094] Step 2:

[1095] The server receives the billing data sent by the user. The received data is temporarily stored in memory, and preparations are made for subsequent processing.

[1096] Step 3:

[1097] The server uses an emotion engine to recognize emotions from user input data. The emotion engine performs text analysis, speech analysis, or facial recognition to determine the user's emotional state. For example, if a user is expressing dissatisfaction, that emotion will be recognized as "dissatisfied."

[1098] Step 4:

[1099] The server adjusts notifications and actions based on the emotion recognition results. For example, if the user's emotion is recognized as dissatisfaction, the server can display a warning message or send a notification to support staff.

[1100] Step 5:

[1101] The server passes the received billing data to the translation engine, which automatically translates each item into English. The server converts the invoice number to "Invoice Number," the billing date to "Billing Date," and so on. The translation engine uses its internal dictionary and machine learning algorithms to generate the corresponding English text.

[1102] Step 6:

[1103] The server saves the translated data as a PDF file. The server uses a PDF generation library to format the translated data and writes it as a PDF file to the specified path. The saved file will be named, for example, "invoice_en.pdf".

[1104] Step 7:

[1105] The server applies authentication to configure user access to downloadable PDF files. The server verifies the user's authentication information (e.g., username and password) and generates a download link for legitimate users.

[1106] Step 8:

[1107] The user accesses a download link sent from the server using their device. The user clicks the link and enters authentication information if necessary.

[1108] Step 9:

[1109] The server verifies the user's authentication, and if successful, grants the user access to download the file. Through the download link, the user can download the "invoice_en.pdf" file to their device and review the translated invoice data.

[1110] By executing these steps sequentially, users can quickly and efficiently obtain invoices translated into English. Furthermore, the emotion engine enables flexible responses that take into account the user's emotional state, providing a more sophisticated user experience.

[1111] (Example 2)

[1112] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1113] Traditional billing data management systems often require manual translation and PDF generation of billing data, resulting in decreased operational efficiency. Furthermore, rigid user interfaces that disregard user sentiment are prevalent, hindering the user experience. Additionally, there is a lack of secure access to translated data, highlighting the need for both convenience and security.

[1114] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data from a user terminal, means for analyzing the received billing data and the user's emotional state, means for automatically translating the billing data into English, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This enables not only rapid and efficient translation of billing data into English and conversion to PDF, but also flexible responses that respond to the user's emotions. Furthermore, it enables secure access to the PDF file.

[1115] A "user terminal" refers to a device used by a user to input and transmit billing data.

[1116] "Billing data" refers to data that includes information such as invoice number, billing date, customer name, item, and amount.

[1117] An "emotion analysis engine" is a system that analyzes user input data (facial expressions, voice, text, etc.) to recognize the user's emotional state.

[1118] A "translation engine" refers to a system or software application used to automatically translate billing data into English.

[1119] "PDF format file" is an abbreviation for Portable Document Format, and refers to a file format used to store billing data.

[1120] "Authentication means" refers to a process or system used to verify the legitimacy of a user when they access a download.

[1121] A "download link" refers to a URL or link provided to a user for downloading a saved PDF file.

[1122] "Automatic translation" refers to the process of converting text into another language using a translation engine without human intervention.

[1123] This invention relates to a system in which a server receives billing data transmitted from a user terminal, automatically translates the data into English, saves the translated billing data in PDF format, and makes it available for the user to download. Furthermore, by combining this with an emotion analysis engine that recognizes the user's emotions, this invention can provide a more flexible user interface.

[1124] First, the user uses their device to enter billing data and send it to the server. The data entered by the user includes information such as the invoice number, billing date, customer name, item, and amount. To accomplish this, the user opens a browser, displays the invoice creation screen, and enters the respective information into the invoice form.

[1125] The terminal sends the entered billing data to the server using the HTTP POST method. The JSON format is typically used for transmission. For example, the terminal sends a request to the server like this: "POST / api / invoice HTTP / 1.1".

[1126] After receiving the transmitted data, the server uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." If the emotion analysis engine recognizes "dissatisfaction," it can display a warning message. For example, a message such as "Are you dissatisfied with our service?"

[1127] Next, the server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[1128] Once the translation is complete, the server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[1129] To allow users to download saved PDF files, the server sets up an authentication method. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. If authentication is successful, the server generates a download link and provides it to the user. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[1130] Finally, the user downloads a PDF file from a specified link using their device. By accessing the link and entering their authentication information, the user can download the PDF file to their device and view the translated billing data.

[1131] An example of a prompt statement is as follows:

[1132] Implement a system that automatically translates user invoice data into English and saves it as a PDF. User input data will include invoice number, invoice date, customer name, item, and amount. Furthermore, include a feature that uses a sentiment analysis engine to recognize user emotions and respond accordingly. The PDF file name for the translated invoice data should be "invoice_en.pdf".

[1133] This invention allows users to obtain English-translated invoices quickly and efficiently, as well as enjoy a flexible user interface powered by an emotion analysis engine. Furthermore, it enables convenient access to PDF files while ensuring security.

[1134] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1135] Step 1:

[1136] The user enters billing data using their device. The data entered includes the invoice number, billing date, customer name, item, and amount. Specifically, the user opens the form in their browser and enters "Invoice Number: 12345", "Billing Date: 2023-10-01", "Customer Name: Taro Yamada", "Item: Product A", and "Amount: 1000 yen". Once the data is complete, they press the "Submit" button.

[1137] Input: User input of billing data (invoice number, billing date, customer name, item, amount).

[1138] Output: The entered billing data is saved to the terminal.

[1139] Step 2:

[1140] The terminal sends the entered billing data to the server using the HTTP POST method. JSON format is used for transmission. As a specific example, the terminal sends a request to the server with the command "POST / api / invoice HTTP / 1.1", including the following billing data in the body:

[1141] {

[1142] "Invoice number": "12345",

[1143] "Invoice Date": "2023-10-01",

[1144] "Customer Name": "Taro Yamada",

[1145] "Item": "Product A",

[1146] "Amount": "1000 yen"

[1147] }

[1148] Input: Entered billing data

[1149] Output: Billing data is sent to the server.

[1150] Step 3:

[1151] The server receives the transmitted data. Next, it uses an emotion analysis engine to recognize the user's emotional state. The emotion analysis engine analyzes the user's facial expressions, voice, and text to recognize emotions such as "dissatisfaction." For example, if the emotion analysis engine recognizes "dissatisfaction," the server generates a warning message.

[1152] Input: Billing data sent to the server

[1153] Output: The user's emotional state is analyzed, and a warning message is generated (if necessary).

[1154] Step 4:

[1155] The server passes the received billing data to a translation engine, which automatically translates each item into English. The translation engine uses the Google Translate API or other automatic translation systems. For example, "12345" is translated as "Invoice Number: 12345", and "2023-10-01" is translated as "Billing Date: 2023-10-01".

[1156] Input: Billing data sent to the server

[1157] Output: Billing data translated into English

[1158] Step 5:

[1159] The server saves the translated data in PDF format. Advanced PDF generation libraries (e.g., iText, Apache PDFBox) are used for saving. The generated file name is typically "invoice_en.pdf". The server saves this file to the specified path.

[1160] Input: Billing data translated into English

[1161] Output: A PDF file ("invoice_en.pdf") is generated and saved.

[1162] Step 6:

[1163] The server verifies the user's authentication information and grants download access if authentication is successful. The authentication process verifies the user's authentication information (username, password) and grants access rights to legitimate users. For example, the server uses JWT (JSON Web Token) or OAuth for authentication.

[1164] Input: User authentication information (username, password)

[1165] Output: Access rights after successful authentication

[1166] Step 7:

[1167] The server generates a download link and provides it to the user. Because this link is based on an authentication token, only authenticated users can access it. For example, the generated link might be "https: / / example.com / download / invoice_en.pdf".

[1168] Input: Access rights after successful authentication

[1169] Output: Generate download link

[1170] Step 8:

[1171] The user downloads a PDF file from a provided link using their device. The PDF file is downloaded to the device after the user accesses the link and enters their authentication information. The user can then open the downloaded file and view the translated billing data.

[1172] Input: Download link

[1173] Output: Download PDF file (user terminal)

[1174] (Application Example 2)

[1175] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1176] Traditional billing data management systems can translate and save billing data in PDF format, but they lack the ability to provide a flexible user interface that takes into account the user's emotional state. Furthermore, there were no systems that offered multilingual support for factory production lines or provided feedback tailored to the emotional state of workers. Therefore, there is a need for improved user experience and increased production efficiency.

[1177] Means for solving the problem

[1178] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving billing data, means for automatically translating the billing data into English, an emotion engine for recognizing the user's emotions, means for saving the translated billing data as a PDF file, and means for making the saved PDF file downloadable by the user. This makes it possible to provide a flexible user interface that responds to the user's emotional state and to efficiently manage automatically translated invoices.

[1179] (Definitions of important words)

[1180] A "user terminal" is a general term for electronic devices that can input billing data and send it to a server.

[1181] "Billing data" refers to data that includes information related to an invoice (e.g., invoice number, invoice date, customer name, items, amount).

[1182] "Automatic translation" is a technology that mechanically converts billing data into multiple languages.

[1183] An "emotion engine" is an algorithm and system that analyzes input data such as the user's facial expressions, voice, and text to recognize the user's emotional state.

[1184] A "PDF file" is a common file format for viewing, saving, and sharing electronic documents, also known as the Portable Document Format.

[1185] "Downloadable" refers to a state where a user can receive a file from a server via the internet.

[1186] A "translation engine" is an algorithm and system that performs text translation between multiple languages.

[1187] "Authentication methods" is a general term for the technologies and processes used to verify a user's credentials and grant them access rights.

[1188] Modes for carrying out the invention

[1189] In this invention, the system operates as follows: The user terminal inputs billing data (invoice number, billing date, customer name, items, amount, etc.) and sends it to the server. The server processes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine analyzes input data such as the user's facial expressions, voice, and text to determine what emotional state the user is in. An emotion analysis module such as DeepFace is used for this analysis.

[1190] The server then passes the billing data to a translation engine for automatic translation into English. The translation engine utilizes natural language processing technologies such as the Google Translate API. Once the translation is complete, the server saves the translated data in PDF format using the FPDF library. This process involves data formatting and PDF file generation.

[1191] To allow users to download saved PDF files, the server uses authentication methods to verify the user's credentials. Upon successful authentication, the server generates a download link and provides it to the user. The user can then access the specified link on their device, enter their authentication information, and download the PDF file.

[1192] As a concrete example, consider a scenario where a user inputs billing data containing an image file named "path_to_input_image.jpg" and submits it to the server. This image contains the billing data in Japanese. If the sentiment engine recognizes the user's sentiment as "dissatisfied," the server displays a warning message to the user before performing the translation process. Next, the server extracts the text from the image, automatically translates it, and saves it in PDF format. Finally, the user can download the PDF file via the generated link and review its contents. This entire process allows the user to quickly and efficiently obtain an English-translated invoice.

[1193] Example of a prompt:

[1194] Extract the text from the image file "path_to_input_image.jpg", translate it, and save it as a PDF file. Also, perform user sentiment analysis and provide appropriate feedback.

[1195] The system of this invention enables multilingual and emotion-responsive billing data processing and is expected to have applications in factory robots and other automated environments.

[1196] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1197] (Program processing flow)

[1198] Step 1:

[1199] Billing data is entered from the user's terminal and sent to the server. The entered data includes the invoice number, billing date, customer name, item, and amount. The server then receives the billing data.

[1200] Step 2:

[1201] The server analyzes the received billing data and uses an emotion engine to recognize the user's emotional state. The emotion engine uses input data such as the user's facial expressions, voice, and text to detect emotions and determines the emotional state, such as "dissatisfied" or "happy," from the analysis results.

[1202] Step 3:

[1203] The server generates appropriate feedback based on the determined emotional state. For example, if the server determines that the user is in a "dissatisfied" emotional state, it will generate a warning message such as "Please review the explanation again."

[1204] Step 4:

[1205] Next, the server passes the billing data to a translation engine for automatic translation into English. Using a translation engine such as the Google Translate API, each item (e.g., invoice number, billing date, customer name, etc.) is converted into the corresponding English text.

[1206] Step 5:

[1207] The server retrieves the translated data and generates a PDF file using the FPDF library. This formats the translated data, and it is saved as "invoice_en.pdf" in the specified folder.

[1208] Step 6:

[1209] The server uses authentication methods to verify the user's credentials in order to allow the user to download the saved PDF file. Authentication uses a username and password to confirm that the user is legitimate.

[1210] Step 7:

[1211] Upon successful authentication, the server generates a download link and provides it to the user. The user accesses the specified link using their device, enters their authentication information, and downloads the file.

[1212] Step 8:

[1213] The user accesses the download link on their device, enters their authentication information, and is authenticated. Afterward, they can download the generated PDF file to their device and review the translated billing data.

[1214] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1215] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1216] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1217] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1218] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1219] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1220] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1221] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1222] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1223] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1224] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1225] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1226] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1227] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1228] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1229] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1230] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1231] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1232] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1233] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1234] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[1235] The following is further disclosed regarding the embodiments described above.

[1236] (Claim 1)

[1237] A means of receiving billing data from user terminals,

[1238] A method for automatically translating billing data into English,

[1239] A method for saving translated billing data as a PDF file,

[1240] A means to make saved PDF files downloadable by users,

[1241] A system that includes this.

[1242] (Claim 2)

[1243] The system according to claim 1, comprising a translation engine for converting each item of translated billing data into English.

[1244] (Claim 3)

[1245] The system according to claim 1, including an authentication means for a user to access a downloadable PDF file.

[1246] "Example 1"

[1247] (Claim 1)

[1248] A means of receiving billing data from user terminals,

[1249] A method for automatically translating billing data into English,

[1250] A method for saving translated billing data as a PDF file,

[1251] A means to make saved PDF files downloadable by users,

[1252] User access authentication method,

[1253] A means of generating a download link,

[1254] A system that includes this.

[1255] (Claim 2)

[1256] The system according to claim 1, comprising a translation engine for converting each item of translated billing data into English.

[1257] (Claim 3)

[1258] The system according to claim 1, including an authentication means for a user to access a downloadable PDF file.

[1259] "Application Example 1"

[1260] (Claim 1)

[1261] A means of receiving data from the user terminal,

[1262] A method for automatically translating order data into multiple languages,

[1263] A method for saving translated data as a PDF file,

[1264] A means to make saved PDF files downloadable by users,

[1265] A means of setting access rights for users using authentication means,

[1266] A system that includes this.

[1267] (Claim 2)

[1268] The system according to claim 1, comprising a translation engine that automatically translates data using a generative AI model.

[1269] (Claim 3)

[1270] The system according to claim 1, including an authentication means for a user to access a downloadable PDF file.

[1271] "Example 2 of combining an emotion engine"

[1272] (Claim 1)

[1273] A means of receiving billing data from user terminals,

[1274] A means for analyzing received billing data and the user's emotional state,

[1275] A method for automatically translating billing data into English,

[1276] A method for saving translated billing data as a PDF file,

[1277] A means to make saved PDF files downloadable by users,

[1278] A system that includes this.

[1279] (Claim 2)

[1280] The system according to claim 1, comprising a translation engine for converting each item of translated billing data into English.

[1281] (Claim 3)

[1282] The system according to claim 1, comprising an emotion analysis engine for recognizing the emotional state of a user.

[1283] (Claim 4)

[1284] The system according to claim 1, including an authentication means for a user to access a downloadable PDF file.

[1285] "Application example 2 when combining with an emotional engine"

[1286] (Claim 1)

[1287] A means of receiving billing data from user terminals,

[1288] A method for automatically translating billing data into English,

[1289] An emotion engine for recognizing user emotions,

[1290] A method for saving translated billing data as a PDF file,

[1291] A means to make saved PDF files downloadable by users,

[1292] A system that includes this.

[1293] (Claim 2)

[1294] The system according to claim 1, comprising a translation engine for converting each item of translated billing data into English.

[1295] (Claim 3)

[1296] The system according to claim 1, including an authentication means for a user to access a downloadable PDF file. [Explanation of symbols]

[1297] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving billing data from user terminals, A method for automatically translating billing data into English, A method for saving translated billing data as a PDF file, A means to make saved PDF files downloadable by users, A system that includes this.

2. The system according to claim 1, comprising a translation engine for converting each item of translated billing data into English.

3. The system according to claim 1, including authentication means for a user to access a downloadable PDF file.

Images