system

Abstract

We provide the system. [Solution] An interface means for the user to select official documents and input personal information, A means of encrypting and transmitting the entered personal information, A means for receiving and decrypting encrypted data, A generative artificial intelligence system that verifies the integrity of received data, inserts the data into a template for official documents, and automatically generates documents. A method for generating and saving official documents in PDF format, A system including means for sending an access URL for a generated document to a user's terminal.

Description

Technical Field

[0002] , , , , , ,

[0004] , , , , , ,

[0005] , , , , ,

[0003] , , , ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Currently, manual data entry and confirmation are essential for creating official documents, which takes time and effort. Also, the burden of human errors associated with manual entry and data consistency checks is significant. There is a need to automate such cumbersome operations and provide a user-friendly system. Furthermore, ensuring security in data transmission and reception is also important.

Means for Solving the Problems

[0005] The present invention solves these problems through a system that includes an interface means for the user to select official documents and input personal information, means for encrypting and transmitting the input personal information, means for receiving and decrypting encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating documents by inserting the data into an official document template, means for generating and saving the generated official documents in PDF format, and means for sending an access URL for the generated documents to the user's terminal.

[0006] Furthermore, the system includes additional user authentication methods, enhancing security by verifying authentication information to authenticate users. Additionally, a preview mechanism has been added to allow users to review the entered data, reducing errors during data entry. This improves the overall efficiency and reliability of the automated public document generation process.

[0007] A "user" refers to a person who uses the system to select official documents and enter personal information.

[0008] "Official documents" refer to official documents issued by the government or local authorities, such as resident registration certificates and health insurance cards.

[0009] "Interface means" refers to components that provide screens or forms for users to select official documents and enter personal information.

[0010] "Methods for encrypting and transmitting" refers to a function that encrypts personal information entered by the user and securely transmits it to the server.

[0011] "Means of receiving and decrypting" refers to the function that allows a server to receive encrypted data and decrypt it back into its original format.

[0012] "Generative artificial intelligence means" refers to artificial intelligence technology used to automatically generate official documents by inserting data into templates based on received data.

[0013] "Methods for generating and saving in PDF format" refers to the function for generating and saving official documents as electronic files in PDF format.

[0014] "Means of sending access URLs" refers to a function for sending the access URL of the generated PDF file to the user's terminal.

[0015] "User authentication means" refers to a function that authenticates users using authentication information such as a user ID and password when they access a system.

[0016] "Preview functionality" refers to a feature that displays a preview screen so that users can check the content of the data they have entered beforehand. [Brief explanation of the drawing]

[0017] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9]Shows an emotion map to which a plurality of emotions are mapped. [Figure 10] Shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.

Mode for Carrying Out the Invention

[0018] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0019] First, the language used in the following description will be described.

[0020] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0021] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0022] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0023] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0025] [First Embodiment]

[0026] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0027] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0030] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0037] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0038] This invention relates to an automated system for generating official documents, and more particularly to a method and system for automatically generating official documents using artificial intelligence based on data entered by a user. A detailed configuration for implementing this system is described below.

[0039] System Overview

[0040] This system is broadly composed of user terminals corresponding to use cases, servers that process data, and generative artificial intelligence that generates data.

[0041] 1. Data entry from users

[0042] The terminal provides an interface screen for users to select official documents and enter personal information (such as name, address, and date of birth). This screen is designed to be user-friendly and allow for easy input of necessary information.

[0043] The user selects the required official documents and enters personal information into the form. This information is entered according to the input form provided by the terminal.

[0044] 2. Data transmission and decryption

[0045] The terminal displays the entered personal information on a confirmation screen, and after the user confirms it, it structures the data in JSON format, encrypts it, and sends it to the server.

[0046] The server receives the encrypted data and decrypts it using a predetermined encryption method. Once the data decryption is complete, it proceeds to the next data integrity check.

[0047] 3. Data integrity check and automatic generation

[0048] The server verifies the integrity of the decrypted data and checks for any missing information or formatting errors. If errors are found, it generates an error message and sends it back to the terminal.

[0049] If there are no problems, the data is passed to a generative AI. This AI automatically generates documents by appropriately arranging the received data based on pre-trained templates of official documents.

[0050] 4. Document generation and storage

[0051] The generative AI generates automatically created official documents in PDF format and sends them back to the server. PDF is a widely used format with high readability and compatibility.

[0052] The server saves the generated PDF file to a designated directory and generates an access URL. This URL is for the user to access the document later.

[0053] 5. Sending and downloading documents

[0054] The server sends the access URL for the generated PDF file to the user's terminal.

[0055] The device displays the received URL to the user, and the user can download the document by clicking this URL.

[0056] Specific example: Generating a resident registration certificate

[0057] As a concrete example, the case of a user obtaining a resident registration certificate is explained below.

[0058] 1. The user operates the device and selects "Certificate of Residence" on the official document selection screen.

[0059] 2. The terminal displays a form prompting the user to enter necessary information such as their name, address, and date of birth.

[0060] 3. The user enters information such as "Taro Yamada" and "1-2-3 Minato-ku, Tokyo" into the form, checks the details on the confirmation screen, and clicks the submit button.

[0061] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[0062] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[0063] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[0064] 7. The generative AI inserts data into a resident registration form template and generates a resident registration form in PDF format.

[0065] 8. The server saves the generated PDF and generates an access URL.

[0066] 9. The server sends the access URL to the terminal.

[0067] 10. The terminal displays a URL to the user, who clicks the URL to download the resident registration certificate and prints it if necessary.

[0068] The above describes a specific embodiment of the method for automatically generating official documents using the system of the present invention. This system streamlines the creation of official documents and reduces the risk of user errors.

[0069] The following describes the processing flow.

[0070] Step 1:

[0071] Users log in to the system by entering their user ID and password.

[0072] Step 2:

[0073] The terminal sends the entered authentication information to the server and makes an authentication request.

[0074] Step 3:

[0075] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[0076] Step 4:

[0077] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[0078] Step 5:

[0079] The user selects the necessary documents, such as their resident registration certificate, and clicks the "Next" button.

[0080] Step 6:

[0081] The terminal displays a form for entering the necessary information for the document (such as name, address, and date of birth).

[0082] Step 7:

[0083] The user enters their personal information into the input form on the device and clicks the button to proceed to the confirmation screen.

[0084] Step 8:

[0085] The terminal displays the entered data on a confirmation screen, allowing the user to review the content.

[0086] Step 9:

[0087] The user reviews the data on the confirmation screen and clicks the submit button.

[0088] Step 10:

[0089] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[0090] Step 11:

[0091] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[0092] Step 12:

[0093] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[0094] Step 13:

[0095] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[0096] Step 14:

[0097] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[0098] Step 15:

[0099] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[0100] Step 16:

[0101] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[0102] Step 17:

[0103] The server sends back the access URL for the generated PDF file to the terminal.

[0104] Step 18:

[0105] The device displays the received URL to the user and shows a confirmation message.

[0106] Step 19:

[0107] The user clicks the displayed URL to download the PDF file and save it locally.

[0108] Step 20:

[0109] Users can print downloaded PDF files as needed and use them as official documents.

[0110] (Example 1)

[0111] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0112] Traditional methods for generating official documents required users to manually input information and create the documents themselves. This process was time-consuming and carried a high risk of input errors. Furthermore, if the format or content of the document was inaccurate, it had to be recreated, making it highly inefficient. Therefore, there was a need for a system that could easily input information through a user-friendly interface and generate official documents accurately and automatically using artificial intelligence.

[0113] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0114] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for structuring the input personal information in JSON format, encrypting it, and transmitting it, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and detecting missing information or format errors, a generative artificial intelligence means for automatically generating documents by inserting the received data into an official document template, means for generating and saving the generated official document in PDF format, and means for generating an access URL for the generated document and sending it to the user's terminal. As a result, the user can easily input the necessary information, and based on that information, it becomes possible to generate official documents quickly and accurately.

[0115] An "interface means" is a functional device provided for users to select official documents and input personal information.

[0116] "JSON format" is an abbreviation for JavaScript (registered trademark) Object Notation, and is a lightweight data exchange format for structuring, storing, or transferring data.

[0117] "Encryption" is a technology that converts data into a format that is difficult to analyze, thereby preventing unauthorized access and information leaks.

[0118] A "server" is a computer system that receives, decrypts, processes, and stores data over a network.

[0119] "Decryption" is the process of restoring encrypted data to its original format.

[0120] "Consistency check" is a process to verify that received data is complete and conforms to the specified format.

[0121] "Generative artificial intelligence means" refers to artificial intelligence technology that automatically processes data based on pre-learned templates to generate official documents.

[0122] "PDF format" is an abbreviation for Portable Document Format, a file format for consistently displaying and printing documents on various devices.

[0123] An "access URL" is the web address used to access the generated official document.

[0124] Hardware and software necessary for carrying out the invention

[0125] This invention is a system for automatically generating official documents, constructed using a user terminal, a server, and generative artificial intelligence (AI). The user terminal is a device that the user can operate, such as a personal computer, smartphone, or tablet. The server is a computing system that receives, decrypts, checks the integrity of data, generates documents, and stores them. The generative AI is a machine learning model that has the function of automatically processing data and generating official documents.

[0126] System Overview

[0127] This system automatically generates official documents using the following procedure.

[0128] Data entry from users

[0129] The terminal provides an interface for selecting official documents and entering personal information (e.g., name, address, date of birth). This interface is designed to be easy for the user to operate.

[0130] Specific example: The user operates the terminal and selects "Resident Registration," then enters "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990" into the input form on the screen.

[0131] Data transmission and decryption

[0132] The terminal structures the entered information in JSON format and encrypts the data using an encryption algorithm such as AES (Advanced Encryption Standard). The encrypted data is sent to the server. The server receives this data and decrypts it back into the original data using a decryption algorithm.

[0133] Specific example: After the user confirms the input content and presses the submit button, the device structures the data in JSON format, encrypts it with AES, and sends it to the server.

[0134] Data integrity check and automatic generation

[0135] The server checks the integrity of the decrypted data. It verifies that the data is complete and free from missing information or formatting errors. If errors are found, the server generates an error message and sends it back to the terminal.

[0136] Once the server confirms that the data is free of problems, it passes the data to the generative AI. The generative AI then automatically generates the document by inserting the data based on a template of a public document that it has learned in advance.

[0137] Specific example: The server performs a consistency check on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," then passes it to a generative AI, which generates a resident registration certificate in PDF format based on a template.

[0138] Document generation and storage

[0139] The generative AI generates automatically created official documents in PDF format and sends them back to the server. The server saves these PDF files to a designated directory and generates an access URL.

[0140] Specific example: A generative AI generates a resident registration form in PDF format and sends it back to the server, which then saves it and generates an access URL.

[0141] Sending and downloading documents

[0142] The server sends an access URL to the user's terminal. The terminal displays the URL to the user, who can then click on it to download the document.

[0143] Specific example: A user clicks a URL sent from the server to download a resident registration certificate and prints it if necessary.

[0144] Examples of prompts to input into a generative AI model

[0145] "Based on the following information, please appropriately insert the data into the resident registration form template to generate a PDF file. Name: Taro Yamada, Address: 1-2-3 Minato-ku, Tokyo, Date of Birth: January 1, 1990."

[0146] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0147] Step 1:

[0148] The terminal displays an interface for selecting official documents and entering personal information. The data entered by the user (e.g., name, address, date of birth) is entered into the interface. The entered data is temporarily stored on the terminal, and the process proceeds to the next step.

[0149] Step 2:

[0150] The user selects an official document and enters the required information (e.g., name, address, date of birth) into the input form. The entered data is saved in the device's memory, and confirmation is requested. The user confirms the entered information by clicking the submit button and proceeds to the next step.

[0151] Step 3:

[0152] The terminal structures the data entered by the user in JSON format. The structured JSON data is encrypted using the AES encryption algorithm. The encrypted data is then sent to the server. The input is JSON data, and the output is encrypted data.

[0153] Step 4:

[0154] The server receives encrypted data sent from the terminal. It decrypts the received encrypted data using the AES decryption algorithm. The input is encrypted data, and the output is decrypted data (in JSON format).

[0155] Step 5:

[0156] The server checks the integrity of the decrypted data. Specifically, it verifies that no data is missing and that the format is correct. Depending on the errors detected, an error message is generated and sent back to the terminal. Data that has been verified as integrity proceeds to the next step. The input is the decrypted data, and the output is the integrity check result (data to proceed to the next step if no errors are found).

[0157] Step 6:

[0158] The server passes data that has passed an integrity check to the generative AI. The generative AI uses a pre-trained public document template to appropriately arrange the passed data. Specific example: The generative AI inserts a resident registration form into the template based on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," and issues instructions to generate a PDF. The input is data that has passed an integrity check, and the output is the PDF generation instruction.

[0159] Step 7:

[0160] The generative AI generates official documents in PDF format and returns the generated PDF file to the server. The input is a PDF generation instruction, and the output is a PDF file.

[0161] Step 8:

[0162] The server saves the generated PDF file to a designated directory. It then generates an access URL for the saved PDF file, saves this URL, and proceeds to the next step. The input is a PDF file, and the output is an access URL.

[0163] Step 9:

[0164] The server sends the access URL for the generated document to the user's terminal. The input is the access URL, and the output is the transmission of the URL to the user's terminal.

[0165] Step 10:

[0166] The terminal displays the received access URL, and the user downloads the document by clicking it. The user prints the downloaded document as needed. The input is the access URL, and the output is the download and printing of the official document.

[0167] (Application Example 1)

[0168] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0169] Logistics centers and delivery operations require the creation of a wide variety of shipping documents, receipts, and delivery labels, and this process is time-consuming. Furthermore, manual data entry and creation processes are prone to human error, necessitating frequent corrections. Additionally, while digital storage and rapid access to documents are required, existing systems struggle to fully meet these needs. Given this background, there is a need for an automated system for generating official documents efficiently within logistics centers.

[0170] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0171] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating documents by inserting the data into logistics-related document templates, means for generating and saving the generated logistics-related documents in PDF format, means for sending an access URL for the generated documents to the user terminal, and access means for downloading and printing the generated documents. This enables increased efficiency in document creation and a reduction in human error.

[0172] A "user" refers to an individual or company that uses the system to select official documents or logistics-related documents and enter personal information.

[0173] "Official documents" refer to official documents issued by government agencies or public institutions.

[0174] "Interface means" refers to the parts of a system that provide user-friendly screens and functions for users to input personal information, select documents, and so on.

[0175] "Personal information" refers to information that identifies a specific individual, such as a user's name, address, and date of birth.

[0176] "Encryption" is a technology that transforms data using a specific algorithm to protect it and prevent it from being deciphered by third parties.

[0177] "Sending" refers to the process of transferring data entered by the user to the server.

[0178] "Decryption" is the process of restoring encrypted data to its original format.

[0179] "Consistency" refers to a state in which data is complete, accurate, and maintains consistency.

[0180] A "template" is a pre-defined document with a specific format and layout.

[0181] "Generative artificial intelligence means" refers to the system component that uses machine learning and AI technology to automatically generate official documents and logistics-related documents.

[0182] "PDF format" is an abbreviation for Portable Document Format, a file format that allows a document to be displayed and printed on different devices and applications while maintaining its original appearance.

[0183] "Saving" refers to the process of retaining generated data and documents and making them accessible later.

[0184] An "access URL" is a web address that allows a user to access a generated document via the internet.

[0185] "Download and print methods" refers to applications and functions that allow users to save generated documents to their local device or to print them physically.

[0186] "Logistics-related documents" refers to all official documents related to logistics and delivery operations, such as shipping documents, receipts, and delivery labels.

[0187] This invention is a system aimed at improving the efficiency of document generation in logistics centers, and automatically generates shipping documents and receipts based on user input data. A specific embodiment of the system is shown below.

[0188] System Overview

[0189] This system is broadly composed of user terminals, servers, and generative artificial intelligence (generative AI). It automatically generates logistics-related documents primarily through the following steps.

[0190] 1. Data entry from users

[0191] The system provides an interface on the user's terminal for selecting logistics-related documents such as shipping documents and receipts, and for entering necessary personal information (e.g., shipping address, product information). This screen is implemented using React Native and features a user-friendly UI.

[0192] 2. Data transmission and decryption

[0193] The terminal displays the entered personal information on a confirmation screen, then constructs the data in JSON format, encrypts it, and sends it to the server. The latest encryption technology is used. The server receives this data using Node.js and Express and decrypts it using a predetermined encryption method.

[0194] 3. Data integrity check and automatic generation

[0195] The server uses Python and Pandas to verify the integrity of the decrypted data, checking for missing information or formatting errors. If errors are found, an error message is generated and sent back to the terminal. If there are no problems, the data is passed to a generative AI (OpenAI® API). This AI automatically generates documents by appropriately arranging the data received from the user, based on pre-trained logistics-related document templates.

[0196] 4. Document generation and storage

[0197] The generation AI automatically generates logistics-related documents in PDF format and sends them back to the server. PDFKit is used for PDF generation. The server saves the generated PDF files to AWS® S3 and generates an access URL.

[0198] 5. Sending and downloading documents

[0199] The server sends an access URL for the generated PDF file to the user's terminal. The terminal displays the received URL to the user, who can click this URL to download the document and print it if necessary.

[0200] Specific example

[0201] As a concrete example, the following shows a case where a user generates shipping documents.

[0202] 1. The user operates the terminal and selects "Shipping Documents" on the logistics-related document selection screen.

[0203] 2. The terminal displays a form that prompts the user to enter necessary information such as the shipping address and product information.

[0204] 3. The user enters information such as "1-2-3 C-cho, B-city, A-prefecture", "electronic components", and "1000 pieces" into the form, checks the contents on the confirmation screen, and clicks the submit button.

[0205] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[0206] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[0207] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[0208] 7. The generative AI inserts data into a shipping document template and generates a shipping document in PDF format.

[0209] 8. The server saves the generated PDF and generates an access URL.

[0210] 9. The server sends the access URL to the terminal.

[0211] 10. The terminal displays a URL to the user, who clicks the URL to download the shipping documents and print them as needed.

[0212] Example of a prompt

[0213] Please generate the shipping document based on the following user input: Shipping destination: "1-2-3 C-cho, B-city, A-prefecture"; Shipping origin: "5-1-60 F-cho, E-city, D-prefecture"; Product: "Electronic components"; Quantity: "1000 pieces"; Shipping date: "2023-10-15"

[0214] The above describes a specific embodiment for carrying out the present invention. This system significantly improves the efficiency of the document creation process at logistics centers and reduces human error.

[0215] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0216] Step 1:

[0217] The user opens the smartphone app and selects "Shipping Documents" on the logistics document selection screen. The user enters the necessary information, such as the shipping address, product information, quantity, and shipping date. This entered data will be used in the next step.

[0218] Input: Shipping address, product information, quantity, shipping date

[0219] Output: Input data confirmation screen

[0220] Step 2:

[0221] The terminal displays the entered information to the user on a confirmation screen, prompting the user to review the content and click the submit button. When the user clicks the submit button, the entered data is structured in JSON format and encrypted using AES.

[0222] Input: User-confirmed input data

[0223] Output: Encrypted JSON data

[0224] Step 3:

[0225] The terminal sends encrypted JSON data to the server via the HTTPS protocol. The server receives the encrypted data and decrypts it using a predetermined AES key.

[0226] Input: Encrypted JSON data

[0227] Output: Decrypted JSON data

[0228] Step 4:

[0229] The server retrieves the decrypted JSON data and uses Python and Pandas to check the data's integrity. If there is missing information or an incorrect format, it generates an error message and sends it back to the terminal.

[0230] Input: Decrypted JSON data

[0231] Output: Integrity check result (success or error)

[0232] Step 5:

[0233] If there are no problems with the data, the server passes the consistent data to a generative AI (OpenAI API) and requests the automatic generation of logistics-related documents. The generative AI generates the documents by appropriately arranging the user data based on a document template that has been trained in advance.

[0234] Input: Consistent JSON data

[0235] Output: Data from the generated shipping documents

[0236] Step 6:

[0237] The generative AI creates automatically generated shipping documents in PDF format and sends them back to the server. The server uses PDFKit to save the generated PDF files. The saved PDF files are uploaded to AWS S3, and an access URL is generated.

[0238] Input: Data from the generated shipping document

[0239] Output: AWS S3 access URL

[0240] Step 7:

[0241] The server sends the terminal an access URL for the generated shipping documents. The terminal displays the received URL to the user.

[0242] Input: AWS S3 access URL

[0243] Output: Access URL displayed on the user's terminal

[0244] Step 8:

[0245] The user clicks the access URL displayed on their device and downloads the shipping documents using a browser or dedicated app. If necessary, they print the downloaded shipping documents.

[0246] Input: User click operation

[0247] Output: Downloadable and printed shipping documents

[0248] The above outlines the processing flow of the system program that implements the application example. The system performs appropriate data processing and calculations based on the data entered at each step, ultimately generating logistics-related documents.

[0249] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0250] This invention relates to a system capable of automatically generating official documents and recognizing user emotions to adjust the interface accordingly. In particular, it relates to a method and system for improving the user experience by protecting user-input data and adjusting the interface according to user emotions in a series of processes for generating official documents.

[0251] Overall system configuration

[0252] This system consists of user terminals, servers, generative artificial intelligence, and emotion engines as its main components.

[0253] 1. Data entry from users

[0254] The device provides an interface for selecting official documents and entering personal information. It incorporates an emotion engine that recognizes emotions in real time from the user's facial expressions and voice.

[0255] Users select necessary official documents, such as their resident registration certificate, and enter their personal information into a form provided by the system. During this process, the emotion engine monitors the user's emotions as they input the information.

[0256] 2. User emotion recognition and interface adjustment

[0257] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it detects that the user is stressed, it adjusts how the interface is displayed.

[0258] The device receives feedback from the emotion engine and automatically adjusts the interface based on the user's emotions. For example, if the user is feeling stressed, it may simplify navigation or display encouraging messages.

[0259] 3. Data transmission and decryption

[0260] The device encrypts the personal information entered by the user and sends it to the server.

[0261] The server receives the encrypted data and performs the decryption process.

[0262] 4. Data integrity check and automatic generation

[0263] The server verifies the data integrity of the received personal information, and if there are no errors, it passes the data to the generative artificial intelligence.

[0264] Generative artificial intelligence appropriately inserts data into templates for official documents and executes an automated generation process.

[0265] 5. Document generation and storage

[0266] The generative artificial intelligence outputs the generated document in PDF format and sends it back to the server.

[0267] The server saves the PDF file and generates a URL that the user can access.

[0268] 6. Sending and downloading documents

[0269] The server sends the device an access URL for the generated PDF file.

[0270] The device displays the URL to the user and shows a confirmation message.

[0271] Users click the URL to download the generated official document and print it if necessary.

[0272] Specific example: Generating a resident registration certificate

[0273] As a specific example, we will explain the procedure for a user to obtain a resident registration certificate.

[0274] 1. The user enters their user ID and password to log in to the system and selects "Resident Registration Certificate".

[0275] 2. The device displays a screen for selecting official documents and a data entry form. Simultaneously, an emotion engine monitors the user's facial expressions and voice to recognize their emotions.

[0276] 3. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen.

[0277] 4. The emotion engine analyzes the emotional data the user is inputting, and if the user is feeling stressed, the device changes the interface to a simplified display method.

[0278] 5. The user checks the input content on the confirmation screen and clicks the send button.

[0279] 6. The terminal structures the confirmed data in JSON format, encrypts it, and sends it to the server.

[0280] 7. The server receives the encrypted data, performs decryption processing, and checks the data integrity.

[0281] 8. If there is no problem with the data integrity, the server passes the data to the generative artificial intelligence to automatically generate a resident's certificate.

[0282] 9. The generative artificial intelligence generates a resident's certificate in PDF format and returns it to the server.

[0283] 10. The server saves the file, generates an access URL, and sends it to the terminal.

[0284] 11. The terminal displays the URL to the user, and the user clicks the URL to download the PDF file.

[0285] 12. The user checks the generated resident's certificate and prints it if necessary.

[0286] The processing flow will be described below.

[0287] Step 1:

[0288] The user enters the user ID and password to log in to the system.

[0289] Step 2:

[0290] The terminal sends the input authentication information to the server to make an authentication request.

[0291] Step 3:

[0292] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[0293] Step 4:

[0294] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[0295] Step 5:

[0296] The user selects the necessary official documents, such as their resident registration certificate, and clicks the "Next" button.

[0297] Step 6:

[0298] The device displays a form for entering necessary information for the document (such as name, address, and date of birth). At this time, the emotion engine begins to analyze the user's facial expressions and voice in real time.

[0299] Step 7:

[0300] The user enters personal information into the input form on the device. While the user is entering information, the emotion engine monitors their emotions, and if stress or confusion is detected, the device displays a message of support.

[0301] Step 8:

[0302] The terminal displays the entered data on a confirmation screen, allowing the user to review the content. Simultaneously, the emotion engine re-analyzes the user's emotions and adjusts the interface as needed.

[0303] Step 9:

[0304] The user reviews the data on the confirmation screen and clicks the submit button.

[0305] Step 10:

[0306] The terminal structures the input data in JSON format in response to the click of the confirmation button, encrypts it, and sends it to the server.

[0307] Step 11:

[0308] The server receives the encrypted data, performs decryption processing, and returns it to the original data format.

[0309] Step 12:

[0310] The server checks the integrity of the received data and confirms whether there are any deficiencies in the information or errors in the format.

[0311] Step 13:

[0312] The server confirms that there are no problems with the data and passes the data with confirmed integrity to the generative AI.

[0313] Step 14:

[0314] The generative AI inserts the data into the templates of official documents such as resident registers and executes the automatic generation process.

[0315] Step 15: ]>

[0316] The generative AI outputs the generated document in PDF format and returns the file to the server.

[0317] Step 16:

[0318] The server saves the PDF file in a predetermined directory and generates a URL accessible to the user.

[0319] Step 17:

[0320] The server returns the access URL of the generated PDF file to the terminal.

[0321] Step 18:

[0322] The device displays the received URL to the user and shows a confirmation message.

[0323] Step 19:

[0324] The user clicks the displayed URL to download the PDF file and save it locally.

[0325] Step 20:

[0326] Users can print downloaded PDF files as needed and use them as official documents.

[0327] (Example 2)

[0328] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0329] The process of obtaining official documents typically requires manual data entry and verification, which is time-consuming and labor-intensive. Furthermore, it often lacks consideration for reducing user emotional stress, resulting in a poor user experience. Additionally, ensuring the security and integrity of input data is crucial.

[0330] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0331] In this invention, the server includes means for selecting official documents from the user, a screen for inputting personal information, means for encrypting and transmitting the entered personal information, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and automatically generating a document by inserting the data into an official document template using a generation AI, means for generating and saving the generated official document in PDF format, means for transmitting access information of the generated document to the user terminal, means for recognizing the user's emotions and adjusting the interface, and means for adjusting the user terminal's operation screen based on feedback from the emotion recognition means. This makes it possible for the user to efficiently obtain official documents without experiencing stress.

[0332] A "user" refers to an individual or organization that uses the system to obtain official documents.

[0333] "Official documents" are documents issued by the government or public institutions, and examples include resident registration certificates and other official documents.

[0334] "Screen-based means" refers to computer screens or interfaces used by users to select official documents and enter necessary personal information.

[0335] "Encryption" refers to the technology of transforming data using specific algorithms to protect it from unauthorized access or tampering by third parties.

[0336] "Transmission means" refers to protocols and technologies (for example, internet communication) used to send data from a user terminal to a server.

[0337] "Decryption" refers to the process of restoring encrypted data to its original state.

[0338] "Data integrity" refers to the process of ensuring that data is accurate, complete, and free from unexpected changes or inconsistencies.

[0339] "Generative AI means" refers to a function that uses artificial intelligence technology to appropriately insert a user's personal information into a template for an official document and automatically generate the document.

[0340] "PDF format" is a file format developed by Adobe, and refers to a standard format for electronically saving and displaying documents.

[0341] "Access information" refers to URLs or links that allow users to download or view generated public documents.

[0342] "Emotion recognition means" refers to technologies and devices that analyze a user's emotions in real time from their facial expressions and voice to determine the user's emotional state.

[0343] An "operation screen" is a screen that allows a user to interact with the system, and it is displayed through an application or web browser.

[0344] This invention relates to a system for the automatic generation of official documents and for recognizing user emotions and adjusting the interface accordingly. The system facilitates the processes of user selection of official documents, input of personal information, data encryption and transmission, decryption, data integrity verification, automatic generation, and document storage and transmission.

[0345] This system is mainly composed of the following components:

[0346] 1. User terminal

[0347] 2. Server

[0348] 3. Generation AI

[0349] 4. Emotion Recognition Engine

[0350] User terminal

[0351] The user terminal provides an interface for selecting official documents and entering personal information. This interface incorporates an emotion recognition engine that analyzes the user's facial expressions and voice in real time to determine their emotions. This allows the system to appropriately adjust the user interface when the user is experiencing stress.

[0352] server

[0353] The server is responsible for primary data processing and storage. Specifically, it receives encrypted data sent from user terminals and performs decryption. It also verifies data integrity and, if there are no problems, passes the data to the generation AI. Furthermore, it saves the generated public documents in PDF format, generates a URL accessible to the user, and sends it to the user terminal.

[0354] Generation AI

[0355] The generation AI is a program that automatically generates documents by appropriately inserting received user data into official document templates. This program has a pre-existing set of official document templates and has the function of selecting the appropriate template and inserting data based on user instructions.

[0356] Emotion recognition engine

[0357] The emotion recognition engine analyzes the user's facial expressions and voice to recognize their emotions in real time. Based on this information, the interface display and operation flow can be adjusted. For example, if the user is feeling stressed, the interface can be simplified and adjusted to make it easier for the user to operate.

[0358] Specific example

[0359] As a specific example, the procedure for a user obtaining a resident registration certificate is described. The user logs into the system by entering their user ID and password and selects the resident registration certificate. Next, the user terminal displays a public document selection screen and a data entry form. Simultaneously, the emotion recognition engine monitors the user's facial expressions and voice and recognizes their emotions. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen. The emotion recognition engine analyzes the emotional data while the user is entering information, and if the user is experiencing stress, the terminal changes to a simplified interface display. After the user confirms the entered information on the confirmation screen and clicks the submit button, the terminal structures the confirmed data in JSON format, encrypts it, and sends it to the server.

[0360] The server receives encrypted data, decrypts it, and checks its integrity. If there are no problems with data integrity, it passes the data to the generation AI, which automatically generates a resident registration certificate. The generation AI generates the resident registration certificate in PDF format and sends it back to the server. The server saves the file, generates an access URL, and sends it to the terminal. The terminal displays the URL to the user, who clicks the URL to download the PDF file. The user reviews the generated resident registration certificate and prints it if necessary.

[0361] Example of a prompt

[0362] Please automatically generate official documents (e.g., resident registration certificates) based on customer data.

[0363] Input data:

[0364] Name: Taro Yamada

[0365] Address: 123-4 Shibuya-ku, Tokyo

[0366] Date of birth: January 1, 1990

[0367] Output format: PDF

[0368] By inputting this prompt into the generation AI, it is possible to automatically and accurately generate the specified public document.

[0369] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0370] Step 1: The user selects an official document and enters personal information.

[0371] Specific actions:

[0372] Input: The user logs into the system using their user ID and password, and selects the type of official document (e.g., resident registration certificate).

[0373] The terminal displays the input form for the selected official document.

[0374] The user enters personal information such as their name, address, and date of birth into the displayed form.

[0375] Data processing and calculations:

[0376] The device transmits the entered personal information to the emotion recognition system in real time.

[0377] The emotion recognition system analyzes the user's facial expressions and voice to evaluate their emotional state.

[0378] Output: User-entered personal information and real-time updated sentiment data.

[0379] Specific actions:

[0380] If the emotion recognition engine analyzes the user's facial expressions and determines that they may be experiencing stress, the device will display a message saying "Simplifying input" and simplify the form.

[0381] Step 2: Confirm and submit input data

[0382] Specific actions:

[0383] Input: The user reviews the entered data and clicks the submit button.

[0384] The terminal structures the verified data into JSON format.

[0385] Data processing and calculations:

[0386] The device encrypts the structured data using the AES encryption algorithm.

[0387] Encrypted data is sent to the server.

[0388] Output: Encrypted personal data.

[0389] Specific actions:

[0390] The terminal converts the input data into JSON format, encrypts it with AES, and then sends it to the server.

[0391] Step 3: Receiving and decrypting encrypted data

[0392] Specific actions:

[0393] Input: The server receives encrypted data.

[0394] The server decrypts the received data using the AES decryption key.

[0395] Data processing and calculations:

[0396] The server verifies the integrity of the received data. Specifically, it checks whether each field is entered in the correct format.

[0397] Output: Personal information data with verified integrity.

[0398] Specific actions:

[0399] The server decrypts the encrypted data and performs an integrity check.

[0400] Step 4: Automated generation of official documents

[0401] Specific actions:

[0402] Input: Personal information data whose integrity has been verified.

[0403] The server passes the data to a data generation AI, which then inserts the data into a public document template to generate the document.

[0404] Data processing and calculations:

[0405] The generation AI selects the appropriate template and inserts the data.

[0406] The generation process is executed to generate the document in PDF format.

[0407] Output: The generated official document in PDF format.

[0408] Specific actions:

[0409] The generation AI inserts data into a template and generates a resident registration certificate in PDF format.

[0410] Step 5: Save the generated document and generate a URL

[0411] Specific actions:

[0412] Input: Generated official document in PDF format.

[0413] The server saves the PDF file and generates a URL that the user can access.

[0414] Data processing and calculations:

[0415] The server saves the PDF file to storage.

[0416] Generate an access URL and send it to the user's terminal.

[0417] Output: The access URL for the generated document.

[0418] Specific actions:

[0419] The server saves the PDF file, generates an access URL, and sends it to the terminal.

[0420] Step 6: Download and review the document

[0421] Specific actions:

[0422] Input: The access URL received by the user's terminal.

[0423] The device displays the URL to the user and shows a confirmation message.

[0424] Data processing and calculations:

[0425] The user clicks the URL to download the generated public document.

[0426] Print the document as needed.

[0427] Output: Public documents available for download by users.

[0428] Specific actions:

[0429] The device displays a message and URL stating, "Your resident registration certificate has been generated. Please click the link below to download it." The user clicks the URL, downloads the PDF file, reviews its contents, and prints it.

[0430] (Application Example 2)

[0431] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0432] Traditional public document generation systems often caused user stress, particularly during registration procedures for electronic payment services, resulting in a poor user experience. Furthermore, the protection of user input data was sometimes insufficient, raising security concerns. These issues need to be resolved to improve both user convenience and security.

[0433] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0434] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for recognizing the user's facial expressions and voice in real time and adjusting the interface according to their emotions, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating the document by inserting the data into an official document template, means for generating and saving the generated official document in PDF format, and means for sending an access URL for the generated document to the user's terminal. This makes it possible for the user to easily and securely generate official documents with an interface optimized according to their emotions.

[0435] "Selection of official documents by the user" refers to the act of a user selecting the necessary official documents using a designated interface.

[0436] "An interface for entering personal information" refers to an interface provided to a user for entering personal information such as their name, address, and date of birth.

[0437] "Means for recognizing user facial expressions and voice in real time" refers to methods for analyzing a user's facial expressions and voice to recognize their emotions in real time.

[0438] "Means for adjusting the interface" refers to means for automatically adjusting the interface to improve the user experience based on the results of user emotion recognition.

[0439] "Means for encrypting and transmitting entered personal information" refers to a method for encrypting personal information entered by a user and securely transmitting it to the server.

[0440] "Means for receiving and decrypting encrypted data" refers to means for receiving encrypted data and decrypting it.

[0441] "Means for verifying the integrity of received data" refers to means for verifying the accuracy and completeness of received data.

[0442] A "template for official documents" is a format used to generate official documents.

[0443] "Generative artificial intelligence means" refers to artificial intelligence means for automatically generating official documents based on templates.

[0444] "Means for generating and saving public documents in PDF format" refers to means for generating and saving public documents in PDF file format.

[0445] "Means for sending the access URL of the generated document to the user's terminal" refers to means for sending the access URL of the generated PDF file to the user's terminal.

[0446] This invention relates to a system for easily and securely generating official documents required by users in electronic payment services. The system includes means for user data input, emotion recognition, data encryption, automatic document generation, saving in PDF format, and transmission via an access point.

[0447] System Overview

[0448] This system consists of the following main components:

[0449] User terminal

[0450] server

[0451] Generative artificial intelligence

[0452] Emotional Engine

[0453] User terminal

[0454] The user terminal serves as an interface, providing screens for selecting official documents and entering personal information. It also uses a camera and microphone to capture the user's facial expressions and voice, providing this data to the emotion engine. The emotion engine then analyzes this data to recognize emotions.

[0455] Emotional Engine

[0456] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it determines that the user is stressed, the device will make adjustments such as simplifying the interface.

[0457] Data encryption and transmission

[0458] Personal information entered by users is encrypted on the device and securely transmitted to the server. The latest encryption technology (e.g., AES) is used to maintain a high level of security.

[0459] Server Processing

[0460] The server reliably decrypts the received encrypted data and then verifies its integrity. Afterward, it passes the data to a generative artificial intelligence system, which inserts the data into a public document template to automatically generate the document.

[0461] Generation and storage of official documents

[0462] Generative artificial intelligence generates official documents in PDF format based on given data. The generated PDFs are stored on a server, and an access URL is generated. This URL is sent to the user's device, allowing them to easily access and download the documents.

[0463] Specific example: Generating a resident registration certificate

[0464] Follow these steps to generate your resident registration certificate.

[0465] 1. The user selects the required official documents when registering for the electronic payment service.

[0466] 2. The device displays a screen for entering personal information, and an emotion engine monitors the user's facial expressions and voice.

[0467] 3. The user enters personal information such as their name, address, and date of birth.

[0468] 4. The emotion engine analyzes the user's emotions and adjusts the interface as needed.

[0469] 5. The entered data is encrypted and sent to the server.

[0470] 6. The server decrypts the data and verifies its integrity.

[0471] 7. The data whose consistency has been verified is passed to the generative artificial intelligence and inserted into the resident registration template.

[0472] 8. The generative artificial intelligence generates a resident registration form in PDF format and saves it to the server.

[0473] 9. The server sends the access URL for the generated PDF file to the terminal.

[0474] 10. The user clicks the URL displayed on their device to download the resident registration certificate.

[0475] Hardware and software to use

[0476] The user terminal is equipped with a high-performance camera and microphone, and software for emotion recognition (e.g., OpenCV, EmotionRecognizer). The server has software for data encryption and decryption (e.g., AES library), and the generative artificial intelligence incorporates an AI model for generating official documents (e.g., DocumentGenerator).

[0477] Example of a prompt

[0478] "Please generate prompts for the generative AI model in the following format:

[0479] 1. Name: [User input]

[0480] 2. Address: [User input]

[0481] 3. Date of birth: [User input]

[0482] Please generate a resident registration certificate as an official document.

[0483] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0484] Step 1:

[0485] The user selects the required official documents when registering for the electronic payment service. The terminal displays a screen for selecting the official documents. It receives the user's selection information as input and saves the type of selected official document to the terminal's memory as output.

[0486] Step 2:

[0487] The device displays a screen for entering personal information. Simultaneously, it uses its camera and microphone to capture the user's facial expressions and voice, and sends them to the emotion engine. It receives video and audio data from the camera and microphone as input, and obtains real-time emotion recognition results as output.

[0488] Step 3:

[0489] The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. It receives video and audio data as input, performs image and audio analysis as data processing, and provides feedback to the device regarding the user's emotional state (e.g., stress, relaxation) as output.

[0490] Step 4:

[0491] The device adjusts the interface according to the user's emotions based on feedback from the emotion engine. Specifically, if the user's emotion is recognized as stress, the interface is simplified and an encouraging message is displayed. It receives the emotion recognition result as input and displays the adjusted interface or message as output.

[0492] Step 5:

[0493] The user enters personal information such as their name, address, and date of birth. The terminal receives the user's input data, structures it, and stores it in the terminal's memory. It receives personal information such as name, address, and date of birth as input and generates structured data (e.g., in JSON format) as output.

[0494] Step 6:

[0495] The device encrypts structured personal information and sends it to the server. It uses the latest encryption technology (e.g., AES). It receives structured data as input, performs encryption as data processing, and sends the encrypted data to the server as output.

[0496] Step 7:

[0497] The server receives encrypted data and decrypts it. It receives encrypted data as input, performs decryption as data processing, and obtains decrypted data as output.

[0498] Step 8:

[0499] The server verifies the integrity of the decrypted data. It receives the decrypted data as input, performs an integrity check (e.g., comparing hash values) as a data operation, and obtains the integrity verification result as output. If the integrity is confirmed, it proceeds to the next step.

[0500] Step 9:

[0501] The server passes the data, whose integrity has been verified, to a generative artificial intelligence (AI) system, which then inserts the data into a public document template to automatically generate the document. It receives decrypted data as input, performs data processing including data insertion into the template and document generation, and outputs a generated PDF document.

[0502] Step 10:

[0503] The server saves the generated public documents in PDF format. It receives the generated PDF documents as input and saves them to server storage as output.

[0504] Step 11:

[0505] The server generates an access URL for the generated PDF file and sends it to the user's terminal. It receives the PDF file's save path as input, processes the data to generate the access URL, and sends the generated access URL to the user's terminal as output.

[0506] Step 12:

[0507] The user clicks the URL displayed on their device to download the generated official document. The system receives the access URL as input, performs a data calculation to download the PDF file, and obtains the downloaded PDF file as output.

[0508] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0509] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0510] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0511] [Second Embodiment]

[0512] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0513] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0514] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0515] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0516] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0517] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0518] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0519] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0520] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0521] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0522] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0523] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0524] This invention relates to an automated system for generating official documents, and more particularly to a method and system for automatically generating official documents using artificial intelligence based on data entered by a user. A detailed configuration for implementing this system is described below.

[0525] System Overview

[0526] This system is broadly composed of user terminals corresponding to use cases, servers that process data, and generative artificial intelligence that generates data.

[0527] 1. Data entry from users

[0528] The terminal provides an interface screen for users to select official documents and enter personal information (such as name, address, and date of birth). This screen is designed to be user-friendly and allow for easy input of necessary information.

[0529] The user selects the required official documents and enters personal information into the form. This information is entered according to the input form provided by the terminal.

[0530] 2. Data transmission and decryption

[0531] The terminal displays the entered personal information on a confirmation screen, and after the user confirms it, it structures the data in JSON format, encrypts it, and sends it to the server.

[0532] The server receives the encrypted data and decrypts it using a predetermined encryption method. Once the data decryption is complete, it proceeds to the next data integrity check.

[0533] 3. Data integrity check and automatic generation

[0534] The server verifies the integrity of the decrypted data and checks for any missing information or formatting errors. If errors are found, it generates an error message and sends it back to the terminal.

[0535] If there are no problems, the data is passed to a generative AI. This AI automatically generates documents by appropriately arranging the received data based on pre-trained templates of official documents.

[0536] 4. Document generation and storage

[0537] The generative AI generates automatically created official documents in PDF format and sends them back to the server. PDF is a widely used format with high readability and compatibility.

[0538] The server saves the generated PDF file to a designated directory and generates an access URL. This URL is for the user to access the document later.

[0539] 5. Sending and downloading documents

[0540] The server sends the access URL for the generated PDF file to the user's terminal.

[0541] The device displays the received URL to the user, and the user can download the document by clicking this URL.

[0542] Specific example: Generating a resident registration certificate

[0543] As a concrete example, the case of a user obtaining a resident registration certificate is explained below.

[0544] 1. The user operates the device and selects "Certificate of Residence" on the official document selection screen.

[0545] 2. The terminal displays a form prompting the user to enter necessary information such as their name, address, and date of birth.

[0546] 3. The user enters information such as "Taro Yamada" and "1-2-3 Minato-ku, Tokyo" into the form, checks the details on the confirmation screen, and clicks the submit button.

[0547] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[0548] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[0549] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[0550] 7. The generative AI inserts data into a resident registration form template and generates a resident registration form in PDF format.

[0551] 8. The server saves the generated PDF and generates an access URL.

[0552] 9. The server sends the access URL to the terminal.

[0553] 10. The terminal displays a URL to the user, who clicks the URL to download the resident registration certificate and prints it if necessary.

[0554] The above describes a specific embodiment of the method for automatically generating official documents using the system of the present invention. This system streamlines the creation of official documents and reduces the risk of user errors.

[0555] The following describes the processing flow.

[0556] Step 1:

[0557] Users log in to the system by entering their user ID and password.

[0558] Step 2:

[0559] The terminal sends the entered authentication information to the server and makes an authentication request.

[0560] Step 3:

[0561] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[0562] Step 4:

[0563] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[0564] Step 5:

[0565] The user selects the necessary documents, such as their resident registration certificate, and clicks the "Next" button.

[0566] Step 6:

[0567] The terminal displays a form for entering the necessary information for the document (such as name, address, and date of birth).

[0568] Step 7:

[0569] The user enters their personal information into the input form on the device and clicks the button to proceed to the confirmation screen.

[0570] Step 8:

[0571] The terminal displays the entered data on a confirmation screen, allowing the user to review the content.

[0572] Step 9:

[0573] The user reviews the data on the confirmation screen and clicks the submit button.

[0574] Step 10:

[0575] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[0576] Step 11:

[0577] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[0578] Step 12:

[0579] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[0580] Step 13:

[0581] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[0582] Step 14:

[0583] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[0584] Step 15:

[0585] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[0586] Step 16:

[0587] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[0588] Step 17:

[0589] The server sends back the access URL for the generated PDF file to the terminal.

[0590] Step 18:

[0591] The device displays the received URL to the user and shows a confirmation message.

[0592] Step 19:

[0593] The user clicks the displayed URL to download the PDF file and save it locally.

[0594] Step 20:

[0595] Users can print downloaded PDF files as needed and use them as official documents.

[0596] (Example 1)

[0597] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0598] Traditional methods for generating official documents required users to manually input information and create the documents themselves. This process was time-consuming and carried a high risk of input errors. Furthermore, if the format or content of the document was inaccurate, it had to be recreated, making it highly inefficient. Therefore, there was a need for a system that could easily input information through a user-friendly interface and generate official documents accurately and automatically using artificial intelligence.

[0599] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0600] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for structuring the input personal information in JSON format, encrypting it, and transmitting it, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and detecting missing information or format errors, a generative artificial intelligence means for automatically generating documents by inserting the received data into an official document template, means for generating and saving the generated official document in PDF format, and means for generating an access URL for the generated document and sending it to the user's terminal. As a result, the user can easily input the necessary information, and based on that information, it becomes possible to generate official documents quickly and accurately.

[0601] An "interface means" is a functional device provided for users to select official documents and input personal information.

[0602] "JSON format" is an abbreviation for JavaScript Object Notation, and it is a lightweight data exchange format for structuring, storing, or transferring data.

[0603] "Encryption" is a technology that converts data into a format that is difficult to analyze, thereby preventing unauthorized access and information leaks.

[0604] A "server" is a computer system that receives, decrypts, processes, and stores data over a network.

[0605] "Decryption" is the process of restoring encrypted data to its original format.

[0606] "Consistency check" is a process to verify that received data is complete and conforms to the specified format.

[0607] "Generative artificial intelligence means" refers to artificial intelligence technology that automatically processes data based on pre-learned templates to generate official documents.

[0608] "PDF format" is an abbreviation for Portable Document Format, a file format for consistently displaying and printing documents on various devices.

[0609] An "access URL" is the web address used to access the generated official document.

[0610] Hardware and software necessary for carrying out the invention

[0611] This invention is a system for automatically generating official documents, constructed using a user terminal, a server, and generative artificial intelligence (AI). The user terminal is a device that the user can operate, such as a personal computer, smartphone, or tablet. The server is a computing system that receives, decrypts, checks the integrity of data, generates documents, and stores them. The generative AI is a machine learning model that has the function of automatically processing data and generating official documents.

[0612] System Overview

[0613] This system automatically generates official documents using the following procedure.

[0614] Data entry from users

[0615] The terminal provides an interface for selecting official documents and entering personal information (e.g., name, address, date of birth). This interface is designed to be easy for the user to operate.

[0616] Specific example: The user operates the terminal and selects "Resident Registration," then enters "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990" into the input form on the screen.

[0617] Data transmission and decryption

[0618] The terminal structures the entered information in JSON format and encrypts the data using an encryption algorithm such as AES (Advanced Encryption Standard). The encrypted data is sent to the server. The server receives this data and decrypts it back into the original data using a decryption algorithm.

[0619] Specific example: After the user confirms the input content and presses the submit button, the device structures the data in JSON format, encrypts it with AES, and sends it to the server.

[0620] Data integrity check and automatic generation

[0621] The server checks the integrity of the decrypted data. It verifies that the data is complete and free from missing information or formatting errors. If errors are found, the server generates an error message and sends it back to the terminal.

[0622] Once the server confirms that the data is free of problems, it passes the data to the generative AI. The generative AI then automatically generates the document by inserting the data based on a template of a public document that it has learned in advance.

[0623] Specific example: The server performs a consistency check on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," then passes it to a generative AI, which generates a resident registration certificate in PDF format based on a template.

[0624] Document generation and storage

[0625] The generative AI generates automatically created official documents in PDF format and sends them back to the server. The server saves these PDF files to a designated directory and generates an access URL.

[0626] Specific example: A generative AI generates a resident registration form in PDF format and sends it back to the server, which then saves it and generates an access URL.

[0627] Sending and downloading documents

[0628] The server sends an access URL to the user's terminal. The terminal displays the URL to the user, who can then click on it to download the document.

[0629] Specific example: A user clicks a URL sent from the server to download a resident registration certificate and prints it if necessary.

[0630] Examples of prompts to input into a generative AI model

[0631] "Based on the following information, please appropriately insert the data into the resident registration form template to generate a PDF file. Name: Taro Yamada, Address: 1-2-3 Minato-ku, Tokyo, Date of Birth: January 1, 1990."

[0632] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0633] Step 1:

[0634] The terminal displays an interface for selecting official documents and entering personal information. The data entered by the user (e.g., name, address, date of birth) is entered into the interface. The entered data is temporarily stored on the terminal, and the process proceeds to the next step.

[0635] Step 2:

[0636] The user selects an official document and enters the required information (e.g., name, address, date of birth) into the input form. The entered data is saved in the device's memory, and confirmation is requested. The user confirms the entered information by clicking the submit button and proceeds to the next step.

[0637] Step 3:

[0638] The terminal structures the data entered by the user in JSON format. The structured JSON data is encrypted using the AES encryption algorithm. The encrypted data is then sent to the server. The input is JSON data, and the output is encrypted data.

[0639] Step 4:

[0640] The server receives encrypted data sent from the terminal. It decrypts the received encrypted data using the AES decryption algorithm. The input is encrypted data, and the output is decrypted data (in JSON format).

[0641] Step 5:

[0642] The server checks the integrity of the decrypted data. Specifically, it verifies that no data is missing and that the format is correct. Depending on the errors detected, an error message is generated and sent back to the terminal. Data that has been verified as integrity proceeds to the next step. The input is the decrypted data, and the output is the integrity check result (data to proceed to the next step if no errors are found).

[0643] Step 6:

[0644] The server passes data that has passed an integrity check to the generative AI. The generative AI uses a pre-trained public document template to appropriately arrange the passed data. Specific example: The generative AI inserts a resident registration form into the template based on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," and issues instructions to generate a PDF. The input is data that has passed an integrity check, and the output is the PDF generation instruction.

[0645] Step 7:

[0646] The generative AI generates official documents in PDF format and returns the generated PDF file to the server. The input is a PDF generation instruction, and the output is a PDF file.

[0647] Step 8:

[0648] The server saves the generated PDF file to a designated directory. It then generates an access URL for the saved PDF file, saves this URL, and proceeds to the next step. The input is a PDF file, and the output is an access URL.

[0649] Step 9:

[0650] The server sends the access URL for the generated document to the user's terminal. The input is the access URL, and the output is the transmission of the URL to the user's terminal.

[0651] Step 10:

[0652] The terminal displays the received access URL, and the user downloads the document by clicking it. The user prints the downloaded document as needed. The input is the access URL, and the output is the download and printing of the official document.

[0653] (Application Example 1)

[0654] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0655] Logistics centers and delivery operations require the creation of a wide variety of shipping documents, receipts, and delivery labels, and this process is time-consuming. Furthermore, manual data entry and creation processes are prone to human error, necessitating frequent corrections. Additionally, while digital storage and rapid access to documents are required, existing systems struggle to fully meet these needs. Given this background, there is a need for an automated system for generating official documents efficiently within logistics centers.

[0656] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0657] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating documents by inserting the data into logistics-related document templates, means for generating and saving the generated logistics-related documents in PDF format, means for sending an access URL for the generated documents to the user terminal, and access means for downloading and printing the generated documents. This enables increased efficiency in document creation and a reduction in human error.

[0658] A "user" refers to an individual or company that uses the system to select official documents or logistics-related documents and enter personal information.

[0659] "Official documents" refer to official documents issued by government agencies or public institutions.

[0660] "Interface means" refers to the parts of a system that provide user-friendly screens and functions for users to input personal information, select documents, and so on.

[0661] "Personal information" refers to information that identifies a specific individual, such as a user's name, address, and date of birth.

[0662] "Encryption" is a technology that transforms data using a specific algorithm to protect it and prevent it from being deciphered by third parties.

[0663] "Sending" refers to the process of transferring data entered by the user to the server.

[0664] "Decryption" is the process of restoring encrypted data to its original format.

[0665] "Consistency" refers to a state in which data is complete, accurate, and maintains consistency.

[0666] A "template" is a pre-defined document with a specific format and layout.

[0667] "Generative artificial intelligence means" refers to the system component that uses machine learning and AI technology to automatically generate official documents and logistics-related documents.

[0668] "PDF format" is an abbreviation for Portable Document Format, a file format that allows a document to be displayed and printed on different devices and applications while maintaining its original appearance.

[0669] "Saving" refers to the process of retaining generated data and documents and making them accessible later.

[0670] An "access URL" is a web address that allows a user to access a generated document via the internet.

[0671] "Download and print methods" refers to applications and functions that allow users to save generated documents to their local device or to print them physically.

[0672] "Logistics-related documents" refers to all official documents related to logistics and delivery operations, such as shipping documents, receipts, and delivery labels.

[0673] This invention is a system aimed at improving the efficiency of document generation in logistics centers, and automatically generates shipping documents and receipts based on user input data. A specific embodiment of the system is shown below.

[0674] System Overview

[0675] This system is broadly composed of user terminals, servers, and generative artificial intelligence (generative AI). It automatically generates logistics-related documents primarily through the following steps.

[0676] 1. Data entry from users

[0677] The system provides an interface on the user's terminal for selecting logistics-related documents such as shipping documents and receipts, and for entering necessary personal information (e.g., shipping address, product information). This screen is implemented using React Native and features a user-friendly UI.

[0678] 2. Data transmission and decryption

[0679] The terminal displays the entered personal information on a confirmation screen, then constructs the data in JSON format, encrypts it, and sends it to the server. The latest encryption technology is used. The server receives this data using Node.js and Express and decrypts it using a predetermined encryption method.

[0680] 3. Data integrity check and automatic generation

[0681] The server uses Python and Pandas to verify the integrity of the decrypted data, checking for missing information or formatting errors. If errors are found, an error message is generated and sent back to the terminal. If there are no problems, the data is passed to a generative AI (OpenAI API). This AI automatically generates documents by appropriately arranging the data received from the user, based on pre-trained logistics-related document templates.

[0682] 4. Document generation and storage

[0683] The generation AI automatically generates logistics-related documents in PDF format and sends them back to the server. PDFKit is used for PDF generation. The server saves the generated PDF files to AWS S3 and generates an access URL.

[0684] 5. Sending and downloading documents

[0685] The server sends an access URL for the generated PDF file to the user's terminal. The terminal displays the received URL to the user, who can click this URL to download the document and print it if necessary.

[0686] Specific example

[0687] As a concrete example, the following shows a case where a user generates shipping documents.

[0688] 1. The user operates the terminal and selects "Shipping Documents" on the logistics-related document selection screen.

[0689] 2. The terminal displays a form that prompts the user to enter necessary information such as the shipping address and product information.

[0690] 3. The user enters information such as "1-2-3 C-cho, B-city, A-prefecture", "electronic components", and "1000 pieces" into the form, checks the contents on the confirmation screen, and clicks the submit button.

[0691] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[0692] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[0693] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[0694] 7. The generative AI inserts data into a shipping document template and generates a shipping document in PDF format.

[0695] 8. The server saves the generated PDF and generates an access URL.

[0696] 9. The server sends the access URL to the terminal.

[0697] 10. The terminal displays a URL to the user, who clicks the URL to download the shipping documents and print them as needed.

[0698] Example of a prompt

[0699] Please generate the shipping document based on the following user input: Shipping destination: "1-2-3 C-cho, B-city, A-prefecture"; Shipping origin: "5-1-60 F-cho, E-city, D-prefecture"; Product: "Electronic components"; Quantity: "1000 pieces"; Shipping date: "2023-10-15"

[0700] The above describes a specific embodiment for carrying out the present invention. This system significantly improves the efficiency of the document creation process at logistics centers and reduces human error.

[0701] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0702] Step 1:

[0703] The user opens the smartphone app and selects "Shipping Documents" on the logistics document selection screen. The user enters the necessary information, such as the shipping address, product information, quantity, and shipping date. This entered data will be used in the next step.

[0704] Input: Shipping address, product information, quantity, shipping date

[0705] Output: Input data confirmation screen

[0706] Step 2:

[0707] The terminal displays the entered information to the user on a confirmation screen, prompting the user to review the content and click the submit button. When the user clicks the submit button, the entered data is structured in JSON format and encrypted using AES.

[0708] Input: User-confirmed input data

[0709] Output: Encrypted JSON data

[0710] Step 3:

[0711] The terminal sends encrypted JSON data to the server via the HTTPS protocol. The server receives the encrypted data and decrypts it using a predetermined AES key.

[0712] Input: Encrypted JSON data

[0713] Output: Decrypted JSON data

[0714] Step 4:

[0715] The server retrieves the decrypted JSON data and uses Python and Pandas to check the data's integrity. If there is missing information or an incorrect format, it generates an error message and sends it back to the terminal.

[0716] Input: Decrypted JSON data

[0717] Output: Integrity check result (success or error)

[0718] Step 5:

[0719] If there are no problems with the data, the server passes the consistent data to a generative AI (OpenAI API) and requests the automatic generation of logistics-related documents. The generative AI generates the documents by appropriately arranging the user data based on a document template that has been trained in advance.

[0720] Input: Consistent JSON data

[0721] Output: Data from the generated shipping documents

[0722] Step 6:

[0723] The generative AI creates automatically generated shipping documents in PDF format and sends them back to the server. The server uses PDFKit to save the generated PDF files. The saved PDF files are uploaded to AWS S3, and an access URL is generated.

[0724] Input: Data from the generated shipping document

[0725] Output: AWS S3 access URL

[0726] Step 7:

[0727] The server sends the terminal an access URL for the generated shipping documents. The terminal displays the received URL to the user.

[0728] Input: AWS S3 access URL

[0729] Output: Access URL displayed on the user's terminal

[0730] Step 8:

[0731] The user clicks the access URL displayed on their device and downloads the shipping documents using a browser or dedicated app. If necessary, they print the downloaded shipping documents.

[0732] Input: User click operation

[0733] Output: Downloadable and printed shipping documents

[0734] The above outlines the processing flow of the system program that implements the application example. The system performs appropriate data processing and calculations based on the data entered at each step, ultimately generating logistics-related documents.

[0735] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0736] This invention relates to a system capable of automatically generating official documents and recognizing user emotions to adjust the interface accordingly. In particular, it relates to a method and system for improving the user experience by protecting user-input data and adjusting the interface according to user emotions in a series of processes for generating official documents.

[0737] Overall system configuration

[0738] This system consists of user terminals, servers, generative artificial intelligence, and emotion engines as its main components.

[0739] 1. Data entry from users

[0740] The device provides an interface for selecting official documents and entering personal information. It incorporates an emotion engine that recognizes emotions in real time from the user's facial expressions and voice.

[0741] Users select necessary official documents, such as their resident registration certificate, and enter their personal information into a form provided by the system. During this process, the emotion engine monitors the user's emotions as they input the information.

[0742] 2. User emotion recognition and interface adjustment

[0743] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it detects that the user is stressed, it adjusts how the interface is displayed.

[0744] The device receives feedback from the emotion engine and automatically adjusts the interface based on the user's emotions. For example, if the user is feeling stressed, it may simplify navigation or display encouraging messages.

[0745] 3. Data transmission and decryption

[0746] The device encrypts the personal information entered by the user and sends it to the server.

[0747] The server receives the encrypted data and performs the decryption process.

[0748] 4. Data integrity check and automatic generation

[0749] The server verifies the data integrity of the received personal information, and if there are no errors, it passes the data to the generative artificial intelligence.

[0750] Generative artificial intelligence appropriately inserts data into templates for official documents and executes an automated generation process.

[0751] 5. Document generation and storage

[0752] The generative artificial intelligence outputs the generated document in PDF format and sends it back to the server.

[0753] The server saves the PDF file and generates a URL that the user can access.

[0754] 6. Sending and downloading documents

[0755] The server sends the device an access URL for the generated PDF file.

[0756] The device displays the URL to the user and shows a confirmation message.

[0757] Users click the URL to download the generated official document and print it if necessary.

[0758] Specific example: Generating a resident registration certificate

[0759] As a specific example, we will explain the procedure for a user to obtain a resident registration certificate.

[0760] 1. The user enters their user ID and password to log in to the system and selects "Resident Registration Certificate".

[0761] 2. The device displays a screen for selecting official documents and a data entry form. Simultaneously, an emotion engine monitors the user's facial expressions and voice to recognize their emotions.

[0762] 3. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen.

[0763] 4. The emotion engine analyzes the emotional data the user is inputting, and if the user is feeling stressed, the device changes the interface to a simplified display method.

[0764] 5. The user reviews the entered information on the confirmation screen and clicks the submit button.

[0765] 6. The terminal structures the verified data in JSON format, encrypts it, and sends it to the server.

[0766] 7. The server receives the encrypted data, performs the decryption process, and checks the integrity of the data.

[0767] 8. If there are no problems with data integrity, the server will pass the data to the generative artificial intelligence to automatically generate the resident registration records.

[0768] 9. The generative artificial intelligence generates a resident registration form in PDF format and sends it back to the server.

[0769] 10. The server saves the file, generates an access URL, and sends it to the terminal.

[0770] 11. The device displays a URL to the user, and the user clicks the URL to download the PDF file.

[0771] 12. The user reviews the generated resident registration certificate and prints it if necessary.

[0772] The following describes the processing flow.

[0773] Step 1:

[0774] Users log in to the system by entering their user ID and password.

[0775] Step 2:

[0776] The terminal sends the entered authentication information to the server and makes an authentication request.

[0777] Step 3:

[0778] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[0779] Step 4:

[0780] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[0781] Step 5:

[0782] The user selects the necessary official documents, such as their resident registration certificate, and clicks the "Next" button.

[0783] Step 6:

[0784] The device displays a form for entering necessary information for the document (such as name, address, and date of birth). At this time, the emotion engine begins to analyze the user's facial expressions and voice in real time.

[0785] Step 7:

[0786] The user enters personal information into the input form on the device. While the user is entering information, the emotion engine monitors their emotions, and if stress or confusion is detected, the device displays a message of support.

[0787] Step 8:

[0788] The terminal displays the entered data on a confirmation screen, allowing the user to review the content. Simultaneously, the emotion engine re-analyzes the user's emotions and adjusts the interface as needed.

[0789] Step 9:

[0790] The user reviews the data on the confirmation screen and clicks the submit button.

[0791] Step 10:

[0792] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[0793] Step 11:

[0794] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[0795] Step 12:

[0796] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[0797] Step 13:

[0798] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[0799] Step 14:

[0800] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[0801] Step 15:

[0802] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[0803] Step 16:

[0804] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[0805] Step 17:

[0806] The server sends back the access URL for the generated PDF file to the terminal.

[0807] Step 18:

[0808] The device displays the received URL to the user and shows a confirmation message.

[0809] Step 19:

[0810] The user clicks the displayed URL to download the PDF file and save it locally.

[0811] Step 20:

[0812] Users can print downloaded PDF files as needed and use them as official documents.

[0813] (Example 2)

[0814] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0815] The process of obtaining official documents typically requires manual data entry and verification, which is time-consuming and labor-intensive. Furthermore, it often lacks consideration for reducing user emotional stress, resulting in a poor user experience. Additionally, ensuring the security and integrity of input data is crucial.

[0816] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0817] In this invention, the server includes means for selecting official documents from the user, a screen for inputting personal information, means for encrypting and transmitting the entered personal information, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and automatically generating a document by inserting the data into an official document template using a generation AI, means for generating and saving the generated official document in PDF format, means for transmitting access information of the generated document to the user terminal, means for recognizing the user's emotions and adjusting the interface, and means for adjusting the user terminal's operation screen based on feedback from the emotion recognition means. This makes it possible for the user to efficiently obtain official documents without experiencing stress.

[0818] A "user" refers to an individual or organization that uses the system to obtain official documents.

[0819] "Official documents" are documents issued by the government or public institutions, and examples include resident registration certificates and other official documents.

[0820] "Screen-based means" refers to computer screens or interfaces used by users to select official documents and enter necessary personal information.

[0821] "Encryption" refers to the technology of transforming data using specific algorithms to protect it from unauthorized access or tampering by third parties.

[0822] "Transmission means" refers to protocols and technologies (for example, internet communication) used to send data from a user terminal to a server.

[0823] "Decryption" refers to the process of restoring encrypted data to its original state.

[0824] "Data integrity" refers to the process of ensuring that data is accurate, complete, and free from unexpected changes or inconsistencies.

[0825] "Generative AI means" refers to a function that uses artificial intelligence technology to appropriately insert a user's personal information into a template for an official document and automatically generate the document.

[0826] "PDF format" is a file format developed by Adobe, and refers to a standard format for electronically saving and displaying documents.

[0827] "Access information" refers to URLs or links that allow users to download or view generated public documents.

[0828] "Emotion recognition means" refers to technologies and devices that analyze a user's emotions in real time from their facial expressions and voice to determine the user's emotional state.

[0829] An "operation screen" is a screen that allows a user to interact with the system, and it is displayed through an application or web browser.

[0830] This invention relates to a system for the automatic generation of official documents and for recognizing user emotions and adjusting the interface accordingly. The system facilitates the processes of user selection of official documents, input of personal information, data encryption and transmission, decryption, data integrity verification, automatic generation, and document storage and transmission.

[0831] This system is mainly composed of the following components:

[0832] 1. User terminal

[0833] 2. Server

[0834] 3. Generation AI

[0835] 4. Emotion Recognition Engine

[0836] User terminal

[0837] The user terminal provides an interface for selecting official documents and entering personal information. This interface incorporates an emotion recognition engine that analyzes the user's facial expressions and voice in real time to determine their emotions. This allows the system to appropriately adjust the user interface when the user is experiencing stress.

[0838] server

[0839] The server is responsible for primary data processing and storage. Specifically, it receives encrypted data sent from user terminals and performs decryption. It also verifies data integrity and, if there are no problems, passes the data to the generation AI. Furthermore, it saves the generated public documents in PDF format, generates a URL accessible to the user, and sends it to the user terminal.

[0840] Generation AI

[0841] The generation AI is a program that automatically generates documents by appropriately inserting received user data into official document templates. This program has a pre-existing set of official document templates and has the function of selecting the appropriate template and inserting data based on user instructions.

[0842] Emotion recognition engine

[0843] The emotion recognition engine analyzes the user's facial expressions and voice to recognize their emotions in real time. Based on this information, the interface display and operation flow can be adjusted. For example, if the user is feeling stressed, the interface can be simplified and adjusted to make it easier for the user to operate.

[0844] Specific example

[0845] As a specific example, the procedure for a user obtaining a resident registration certificate is described. The user logs into the system by entering their user ID and password and selects the resident registration certificate. Next, the user terminal displays a public document selection screen and a data entry form. Simultaneously, the emotion recognition engine monitors the user's facial expressions and voice and recognizes their emotions. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen. The emotion recognition engine analyzes the emotional data while the user is entering information, and if the user is experiencing stress, the terminal changes to a simplified interface display. After the user confirms the entered information on the confirmation screen and clicks the submit button, the terminal structures the confirmed data in JSON format, encrypts it, and sends it to the server.

[0846] The server receives encrypted data, decrypts it, and checks its integrity. If there are no problems with data integrity, it passes the data to the generation AI, which automatically generates a resident registration certificate. The generation AI generates the resident registration certificate in PDF format and sends it back to the server. The server saves the file, generates an access URL, and sends it to the terminal. The terminal displays the URL to the user, who clicks the URL to download the PDF file. The user reviews the generated resident registration certificate and prints it if necessary.

[0847] Example of a prompt

[0848] Please automatically generate official documents (e.g., resident registration certificates) based on customer data.

[0849] Input data:

[0850] Name: Taro Yamada

[0851] Address: 123-4 Shibuya-ku, Tokyo

[0852] Date of birth: January 1, 1990

[0853] Output format: PDF

[0854] By inputting this prompt into the generation AI, it is possible to automatically and accurately generate the specified public document.

[0855] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0856] Step 1: The user selects an official document and enters personal information.

[0857] Specific actions:

[0858] Input: The user logs into the system using their user ID and password, and selects the type of official document (e.g., resident registration certificate).

[0859] The terminal displays the input form for the selected official document.

[0860] The user enters personal information such as their name, address, and date of birth into the displayed form.

[0861] Data processing and calculations:

[0862] The device transmits the entered personal information to the emotion recognition system in real time.

[0863] The emotion recognition system analyzes the user's facial expressions and voice to evaluate their emotional state.

[0864] Output: User-entered personal information and real-time updated sentiment data.

[0865] Specific actions:

[0866] If the emotion recognition engine analyzes the user's facial expressions and determines that they may be experiencing stress, the device will display a message saying "Simplifying input" and simplify the form.

[0867] Step 2: Confirm and submit input data

[0868] Specific actions:

[0869] Input: The user reviews the entered data and clicks the submit button.

[0870] The terminal structures the verified data into JSON format.

[0871] Data processing and calculations:

[0872] The device encrypts the structured data using the AES encryption algorithm.

[0873] Encrypted data is sent to the server.

[0874] Output: Encrypted personal data.

[0875] Specific actions:

[0876] The terminal converts the input data into JSON format, encrypts it with AES, and then sends it to the server.

[0877] Step 3: Receiving and decrypting encrypted data

[0878] Specific actions:

[0879] Input: The server receives encrypted data.

[0880] The server decrypts the received data using the AES decryption key.

[0881] Data processing and calculations:

[0882] The server verifies the integrity of the received data. Specifically, it checks whether each field is entered in the correct format.

[0883] Output: Personal information data with verified integrity.

[0884] Specific actions:

[0885] The server decrypts the encrypted data and performs an integrity check.

[0886] Step 4: Automated generation of official documents

[0887] Specific actions:

[0888] Input: Personal information data whose integrity has been verified.

[0889] The server passes the data to a data generation AI, which then inserts the data into a public document template to generate the document.

[0890] Data processing and calculations:

[0891] The generation AI selects the appropriate template and inserts the data.

[0892] The generation process is executed to generate the document in PDF format.

[0893] Output: The generated official document in PDF format.

[0894] Specific actions:

[0895] The generation AI inserts data into a template and generates a resident registration certificate in PDF format.

[0896] Step 5: Save the generated document and generate a URL

[0897] Specific actions:

[0898] Input: Generated official document in PDF format.

[0899] The server saves the PDF file and generates a URL that the user can access.

[0900] Data processing and calculations:

[0901] The server saves the PDF file to storage.

[0902] Generate an access URL and send it to the user's terminal.

[0903] Output: The access URL for the generated document.

[0904] Specific actions:

[0905] The server saves the PDF file, generates an access URL, and sends it to the terminal.

[0906] Step 6: Download and review the document

[0907] Specific actions:

[0908] Input: The access URL received by the user's terminal.

[0909] The device displays the URL to the user and shows a confirmation message.

[0910] Data processing and calculations:

[0911] The user clicks the URL to download the generated public document.

[0912] Print the document as needed.

[0913] Output: Public documents available for download by users.

[0914] Specific actions:

[0915] The device displays a message and URL stating, "Your resident registration certificate has been generated. Please click the link below to download it." The user clicks the URL, downloads the PDF file, reviews its contents, and prints it.

[0916] (Application Example 2)

[0917] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0918] Traditional public document generation systems often caused user stress, particularly during registration procedures for electronic payment services, resulting in a poor user experience. Furthermore, the protection of user input data was sometimes insufficient, raising security concerns. These issues need to be resolved to improve both user convenience and security.

[0919] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0920] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for recognizing the user's facial expressions and voice in real time and adjusting the interface according to their emotions, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating the document by inserting the data into an official document template, means for generating and saving the generated official document in PDF format, and means for sending an access URL for the generated document to the user's terminal. This makes it possible for the user to easily and securely generate official documents with an interface optimized according to their emotions.

[0921] "Selection of official documents by the user" refers to the act of a user selecting the necessary official documents using a designated interface.

[0922] "An interface for entering personal information" refers to an interface provided to a user for entering personal information such as their name, address, and date of birth.

[0923] "Means for recognizing user facial expressions and voice in real time" refers to methods for analyzing a user's facial expressions and voice to recognize their emotions in real time.

[0924] "Means for adjusting the interface" refers to means for automatically adjusting the interface to improve the user experience based on the results of user emotion recognition.

[0925] "Means for encrypting and transmitting entered personal information" refers to a method for encrypting personal information entered by a user and securely transmitting it to the server.

[0926] "Means for receiving and decrypting encrypted data" refers to means for receiving encrypted data and decrypting it.

[0927] "Means for verifying the integrity of received data" refers to means for verifying the accuracy and completeness of received data.

[0928] A "template for official documents" is a format used to generate official documents.

[0929] "Generative artificial intelligence means" refers to artificial intelligence means for automatically generating official documents based on templates.

[0930] "Means for generating and saving public documents in PDF format" refers to means for generating and saving public documents in PDF file format.

[0931] "Means for sending the access URL of the generated document to the user's terminal" refers to means for sending the access URL of the generated PDF file to the user's terminal.

[0932] This invention relates to a system for easily and securely generating official documents required by users in electronic payment services. The system includes means for user data input, emotion recognition, data encryption, automatic document generation, saving in PDF format, and transmission via an access point.

[0933] System Overview

[0934] This system consists of the following main components:

[0935] User terminal

[0936] server

[0937] Generative artificial intelligence

[0938] Emotional Engine

[0939] User terminal

[0940] The user terminal serves as an interface, providing screens for selecting official documents and entering personal information. It also uses a camera and microphone to capture the user's facial expressions and voice, providing this data to the emotion engine. The emotion engine then analyzes this data to recognize emotions.

[0941] Emotional Engine

[0942] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it determines that the user is stressed, the device will make adjustments such as simplifying the interface.

[0943] Data encryption and transmission

[0944] Personal information entered by users is encrypted on the device and securely transmitted to the server. The latest encryption technology (e.g., AES) is used to maintain a high level of security.

[0945] Server Processing

[0946] The server reliably decrypts the received encrypted data and then verifies its integrity. Afterward, it passes the data to a generative artificial intelligence system, which inserts the data into a public document template to automatically generate the document.

[0947] Generation and storage of official documents

[0948] Generative artificial intelligence generates official documents in PDF format based on given data. The generated PDFs are stored on a server, and an access URL is generated. This URL is sent to the user's device, allowing them to easily access and download the documents.

[0949] Specific example: Generating a resident registration certificate

[0950] Follow these steps to generate your resident registration certificate.

[0951] 1. The user selects the required official documents when registering for the electronic payment service.

[0952] 2. The device displays a screen for entering personal information, and an emotion engine monitors the user's facial expressions and voice.

[0953] 3. The user enters personal information such as their name, address, and date of birth.

[0954] 4. The emotion engine analyzes the user's emotions and adjusts the interface as needed.

[0955] 5. The entered data is encrypted and sent to the server.

[0956] 6. The server decrypts the data and verifies its integrity.

[0957] 7. The data whose consistency has been verified is passed to the generative artificial intelligence and inserted into the resident registration template.

[0958] 8. The generative artificial intelligence generates a resident registration form in PDF format and saves it to the server.

[0959] 9. The server sends the access URL for the generated PDF file to the terminal.

[0960] 10. The user clicks the URL displayed on their device to download the resident registration certificate.

[0961] Hardware and software to use

[0962] The user terminal is equipped with a high-performance camera and microphone, and software for emotion recognition (e.g., OpenCV, EmotionRecognizer). The server has software for data encryption and decryption (e.g., AES library), and the generative artificial intelligence incorporates an AI model for generating official documents (e.g., DocumentGenerator).

[0963] Example of a prompt

[0964] "Please generate prompts for the generative AI model in the following format:

[0965] 1. Name: [User input]

[0966] 2. Address: [User input]

[0967] 3. Date of birth: [User input]

[0968] Please generate a resident registration certificate as an official document.

[0969] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0970] Step 1:

[0971] The user selects the required official documents when registering for the electronic payment service. The terminal displays a screen for selecting the official documents. It receives the user's selection information as input and saves the type of selected official document to the terminal's memory as output.

[0972] Step 2:

[0973] The device displays a screen for entering personal information. Simultaneously, it uses its camera and microphone to capture the user's facial expressions and voice, and sends them to the emotion engine. It receives video and audio data from the camera and microphone as input, and obtains real-time emotion recognition results as output.

[0974] Step 3:

[0975] The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. It receives video and audio data as input, performs image and audio analysis as data processing, and provides feedback to the device regarding the user's emotional state (e.g., stress, relaxation) as output.

[0976] Step 4:

[0977] The device adjusts the interface according to the user's emotions based on feedback from the emotion engine. Specifically, if the user's emotion is recognized as stress, the interface is simplified and an encouraging message is displayed. It receives the emotion recognition result as input and displays the adjusted interface or message as output.

[0978] Step 5:

[0979] The user enters personal information such as their name, address, and date of birth. The terminal receives the user's input data, structures it, and stores it in the terminal's memory. It receives personal information such as name, address, and date of birth as input and generates structured data (e.g., in JSON format) as output.

[0980] Step 6:

[0981] The device encrypts structured personal information and sends it to the server. It uses the latest encryption technology (e.g., AES). It receives structured data as input, performs encryption as data processing, and sends the encrypted data to the server as output.

[0982] Step 7:

[0983] The server receives encrypted data and decrypts it. It receives encrypted data as input, performs decryption as data processing, and obtains decrypted data as output.

[0984] Step 8:

[0985] The server verifies the integrity of the decrypted data. It receives the decrypted data as input, performs an integrity check (e.g., comparing hash values) as a data operation, and obtains the integrity verification result as output. If the integrity is confirmed, it proceeds to the next step.

[0986] Step 9:

[0987] The server passes the data, whose integrity has been verified, to a generative artificial intelligence (AI) system, which then inserts the data into a public document template to automatically generate the document. It receives decrypted data as input, performs data processing including data insertion into the template and document generation, and outputs a generated PDF document.

[0988] Step 10:

[0989] The server saves the generated public documents in PDF format. It receives the generated PDF documents as input and saves them to server storage as output.

[0990] Step 11:

[0991] The server generates an access URL for the generated PDF file and sends it to the user's terminal. It receives the PDF file's save path as input, processes the data to generate the access URL, and sends the generated access URL to the user's terminal as output.

[0992] Step 12:

[0993] The user clicks the URL displayed on their device to download the generated official document. The system receives the access URL as input, performs a data calculation to download the PDF file, and obtains the downloaded PDF file as output.

[0994] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0995] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0996] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0997] [Third Embodiment]

[0998] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0999] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1000] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1001] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1002] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1003] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1004] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1005] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1006] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1007] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1008] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1009] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1010] This invention relates to an automated system for generating official documents, and more particularly to a method and system for automatically generating official documents using artificial intelligence based on data entered by a user. A detailed configuration for implementing this system is described below.

[1011] System Overview

[1012] This system is broadly composed of user terminals corresponding to use cases, servers that process data, and generative artificial intelligence that generates data.

[1013] 1. Data entry from users

[1014] The terminal provides an interface screen for users to select official documents and enter personal information (such as name, address, and date of birth). This screen is designed to be user-friendly and allow for easy input of necessary information.

[1015] The user selects the required official documents and enters personal information into the form. This information is entered according to the input form provided by the terminal.

[1016] 2. Data transmission and decryption

[1017] The terminal displays the entered personal information on a confirmation screen, and after the user confirms it, it structures the data in JSON format, encrypts it, and sends it to the server.

[1018] The server receives the encrypted data and decrypts it using a predetermined encryption method. Once the data decryption is complete, it proceeds to the next data integrity check.

[1019] 3. Data integrity check and automatic generation

[1020] The server verifies the integrity of the decrypted data and checks for any missing information or formatting errors. If errors are found, it generates an error message and sends it back to the terminal.

[1021] If there are no problems, the data is passed to a generative AI. This AI automatically generates documents by appropriately arranging the received data based on pre-trained templates of official documents.

[1022] 4. Document generation and storage

[1023] The generative AI generates automatically created official documents in PDF format and sends them back to the server. PDF is a widely used format with high readability and compatibility.

[1024] The server saves the generated PDF file to a designated directory and generates an access URL. This URL is for the user to access the document later.

[1025] 5. Sending and downloading documents

[1026] The server sends the access URL for the generated PDF file to the user's terminal.

[1027] The device displays the received URL to the user, and the user can download the document by clicking this URL.

[1028] Specific example: Generating a resident registration certificate

[1029] As a concrete example, the case of a user obtaining a resident registration certificate is explained below.

[1030] 1. The user operates the device and selects "Certificate of Residence" on the official document selection screen.

[1031] 2. The terminal displays a form prompting the user to enter necessary information such as their name, address, and date of birth.

[1032] 3. The user enters information such as "Taro Yamada" and "1-2-3 Minato-ku, Tokyo" into the form, checks the details on the confirmation screen, and clicks the submit button.

[1033] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[1034] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[1035] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[1036] 7. The generative AI inserts data into a resident registration form template and generates a resident registration form in PDF format.

[1037] 8. The server saves the generated PDF and generates an access URL.

[1038] 9. The server sends the access URL to the terminal.

[1039] 10. The terminal displays a URL to the user, who clicks the URL to download the resident registration certificate and prints it if necessary.

[1040] The above describes a specific embodiment of the method for automatically generating official documents using the system of the present invention. This system streamlines the creation of official documents and reduces the risk of user errors.

[1041] The following describes the processing flow.

[1042] Step 1:

[1043] Users log in to the system by entering their user ID and password.

[1044] Step 2:

[1045] The terminal sends the entered authentication information to the server and makes an authentication request.

[1046] Step 3:

[1047] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[1048] Step 4:

[1049] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[1050] Step 5:

[1051] The user selects the necessary documents, such as their resident registration certificate, and clicks the "Next" button.

[1052] Step 6:

[1053] The terminal displays a form for entering the necessary information for the document (such as name, address, and date of birth).

[1054] Step 7:

[1055] The user enters their personal information into the input form on the device and clicks the button to proceed to the confirmation screen.

[1056] Step 8:

[1057] The terminal displays the entered data on a confirmation screen, allowing the user to review the content.

[1058] Step 9:

[1059] The user reviews the data on the confirmation screen and clicks the submit button.

[1060] Step 10:

[1061] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[1062] Step 11:

[1063] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[1064] Step 12:

[1065] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[1066] Step 13:

[1067] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[1068] Step 14:

[1069] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[1070] Step 15:

[1071] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[1072] Step 16:

[1073] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[1074] Step 17:

[1075] The server sends back the access URL for the generated PDF file to the terminal.

[1076] Step 18:

[1077] The device displays the received URL to the user and shows a confirmation message.

[1078] Step 19:

[1079] The user clicks the displayed URL to download the PDF file and save it locally.

[1080] Step 20:

[1081] Users can print downloaded PDF files as needed and use them as official documents.

[1082] (Example 1)

[1083] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1084] Traditional methods for generating official documents required users to manually input information and create the documents themselves. This process was time-consuming and carried a high risk of input errors. Furthermore, if the format or content of the document was inaccurate, it had to be recreated, making it highly inefficient. Therefore, there was a need for a system that could easily input information through a user-friendly interface and generate official documents accurately and automatically using artificial intelligence.

[1085] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1086] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for structuring the input personal information in JSON format, encrypting it, and transmitting it, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and detecting missing information or format errors, a generative artificial intelligence means for automatically generating documents by inserting the received data into an official document template, means for generating and saving the generated official document in PDF format, and means for generating an access URL for the generated document and sending it to the user's terminal. As a result, the user can easily input the necessary information, and based on that information, it becomes possible to generate official documents quickly and accurately.

[1087] An "interface means" is a functional device provided for users to select official documents and input personal information.

[1088] "JSON format" is an abbreviation for JavaScript Object Notation, and it is a lightweight data exchange format for structuring, storing, or transferring data.

[1089] "Encryption" is a technology that converts data into a format that is difficult to analyze, thereby preventing unauthorized access and information leaks.

[1090] A "server" is a computer system that receives, decrypts, processes, and stores data over a network.

[1091] "Decryption" is the process of restoring encrypted data to its original format.

[1092] "Consistency check" is a process to verify that received data is complete and conforms to the specified format.

[1093] "Generative artificial intelligence means" refers to artificial intelligence technology that automatically processes data based on pre-learned templates to generate official documents.

[1094] "PDF format" is an abbreviation for Portable Document Format, a file format for consistently displaying and printing documents on various devices.

[1095] An "access URL" is the web address used to access the generated official document.

[1096] Hardware and software necessary for carrying out the invention

[1097] This invention is a system for automatically generating official documents, constructed using a user terminal, a server, and generative artificial intelligence (AI). The user terminal is a device that the user can operate, such as a personal computer, smartphone, or tablet. The server is a computing system that receives, decrypts, checks the integrity of data, generates documents, and stores them. The generative AI is a machine learning model that has the function of automatically processing data and generating official documents.

[1098] System Overview

[1099] This system automatically generates official documents using the following procedure.

[1100] Data entry from users

[1101] The terminal provides an interface for selecting official documents and entering personal information (e.g., name, address, date of birth). This interface is designed to be easy for the user to operate.

[1102] Specific example: The user operates the terminal and selects "Resident Registration," then enters "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990" into the input form on the screen.

[1103] Data transmission and decryption

[1104] The terminal structures the entered information in JSON format and encrypts the data using an encryption algorithm such as AES (Advanced Encryption Standard). The encrypted data is sent to the server. The server receives this data and decrypts it back into the original data using a decryption algorithm.

[1105] Specific example: After the user confirms the input content and presses the submit button, the device structures the data in JSON format, encrypts it with AES, and sends it to the server.

[1106] Data integrity check and automatic generation

[1107] The server checks the integrity of the decrypted data. It verifies that the data is complete and free from missing information or formatting errors. If errors are found, the server generates an error message and sends it back to the terminal.

[1108] Once the server confirms that the data is free of problems, it passes the data to the generative AI. The generative AI then automatically generates the document by inserting the data based on a template of a public document that it has learned in advance.

[1109] Specific example: The server performs a consistency check on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," then passes it to a generative AI, which generates a resident registration certificate in PDF format based on a template.

[1110] Document generation and storage

[1111] The generative AI generates automatically created official documents in PDF format and sends them back to the server. The server saves these PDF files to a designated directory and generates an access URL.

[1112] Specific example: A generative AI generates a resident registration form in PDF format and sends it back to the server, which then saves it and generates an access URL.

[1113] Sending and downloading documents

[1114] The server sends an access URL to the user's terminal. The terminal displays the URL to the user, who can then click on it to download the document.

[1115] Specific example: A user clicks a URL sent from the server to download a resident registration certificate and prints it if necessary.

[1116] Examples of prompts to input into a generative AI model

[1117] "Based on the following information, please appropriately insert the data into the resident registration form template to generate a PDF file. Name: Taro Yamada, Address: 1-2-3 Minato-ku, Tokyo, Date of Birth: January 1, 1990."

[1118] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1119] Step 1:

[1120] The terminal displays an interface for selecting official documents and entering personal information. The data entered by the user (e.g., name, address, date of birth) is entered into the interface. The entered data is temporarily stored on the terminal, and the process proceeds to the next step.

[1121] Step 2:

[1122] The user selects an official document and enters the required information (e.g., name, address, date of birth) into the input form. The entered data is saved in the device's memory, and confirmation is requested. The user confirms the entered information by clicking the submit button and proceeds to the next step.

[1123] Step 3:

[1124] The terminal structures the data entered by the user in JSON format. The structured JSON data is encrypted using the AES encryption algorithm. The encrypted data is then sent to the server. The input is JSON data, and the output is encrypted data.

[1125] Step 4:

[1126] The server receives encrypted data sent from the terminal. It decrypts the received encrypted data using the AES decryption algorithm. The input is encrypted data, and the output is decrypted data (in JSON format).

[1127] Step 5:

[1128] The server checks the integrity of the decrypted data. Specifically, it verifies that no data is missing and that the format is correct. Depending on the errors detected, an error message is generated and sent back to the terminal. Data that has been verified as integrity proceeds to the next step. The input is the decrypted data, and the output is the integrity check result (data to proceed to the next step if no errors are found).

[1129] Step 6:

[1130] The server passes data that has passed an integrity check to the generative AI. The generative AI uses a pre-trained public document template to appropriately arrange the passed data. Specific example: The generative AI inserts a resident registration form into the template based on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," and issues instructions to generate a PDF. The input is data that has passed an integrity check, and the output is the PDF generation instruction.

[1131] Step 7:

[1132] The generative AI generates official documents in PDF format and returns the generated PDF file to the server. The input is a PDF generation instruction, and the output is a PDF file.

[1133] Step 8:

[1134] The server saves the generated PDF file to a designated directory. It then generates an access URL for the saved PDF file, saves this URL, and proceeds to the next step. The input is a PDF file, and the output is an access URL.

[1135] Step 9:

[1136] The server sends the access URL for the generated document to the user's terminal. The input is the access URL, and the output is the transmission of the URL to the user's terminal.

[1137] Step 10:

[1138] The terminal displays the received access URL, and the user downloads the document by clicking it. The user prints the downloaded document as needed. The input is the access URL, and the output is the download and printing of the official document.

[1139] (Application Example 1)

[1140] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1141] Logistics centers and delivery operations require the creation of a wide variety of shipping documents, receipts, and delivery labels, and this process is time-consuming. Furthermore, manual data entry and creation processes are prone to human error, necessitating frequent corrections. Additionally, while digital storage and rapid access to documents are required, existing systems struggle to fully meet these needs. Given this background, there is a need for an automated system for generating official documents efficiently within logistics centers.

[1142] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1143] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating documents by inserting the data into logistics-related document templates, means for generating and saving the generated logistics-related documents in PDF format, means for sending an access URL for the generated documents to the user terminal, and access means for downloading and printing the generated documents. This enables increased efficiency in document creation and a reduction in human error.

[1144] A "user" refers to an individual or company that uses the system to select official documents or logistics-related documents and enter personal information.

[1145] "Official documents" refer to official documents issued by government agencies or public institutions.

[1146] "Interface means" refers to the parts of a system that provide user-friendly screens and functions for users to input personal information, select documents, and so on.

[1147] "Personal information" refers to information that identifies a specific individual, such as a user's name, address, and date of birth.

[1148] "Encryption" is a technology that transforms data using a specific algorithm to protect it and prevent it from being deciphered by third parties.

[1149] "Sending" refers to the process of transferring data entered by the user to the server.

[1150] "Decryption" is the process of restoring encrypted data to its original format.

[1151] "Consistency" refers to a state in which data is complete, accurate, and maintains consistency.

[1152] A "template" is a pre-defined document with a specific format and layout.

[1153] "Generative artificial intelligence means" refers to the system component that uses machine learning and AI technology to automatically generate official documents and logistics-related documents.

[1154] "PDF format" is an abbreviation for Portable Document Format, a file format that allows a document to be displayed and printed on different devices and applications while maintaining its original appearance.

[1155] "Saving" refers to the process of retaining generated data and documents and making them accessible later.

[1156] An "access URL" is a web address that allows a user to access a generated document via the internet.

[1157] "Download and print methods" refers to applications and functions that allow users to save generated documents to their local device or to print them physically.

[1158] "Logistics-related documents" refers to all official documents related to logistics and delivery operations, such as shipping documents, receipts, and delivery labels.

[1159] This invention is a system aimed at improving the efficiency of document generation in logistics centers, and automatically generates shipping documents and receipts based on user input data. A specific embodiment of the system is shown below.

[1160] System Overview

[1161] This system is broadly composed of user terminals, servers, and generative artificial intelligence (generative AI). It automatically generates logistics-related documents primarily through the following steps.

[1162] 1. Data entry from users

[1163] The system provides an interface on the user's terminal for selecting logistics-related documents such as shipping documents and receipts, and for entering necessary personal information (e.g., shipping address, product information). This screen is implemented using React Native and features a user-friendly UI.

[1164] 2. Data transmission and decryption

[1165] The terminal displays the entered personal information on a confirmation screen, then constructs the data in JSON format, encrypts it, and sends it to the server. The latest encryption technology is used. The server receives this data using Node.js and Express and decrypts it using a predetermined encryption method.

[1166] 3. Data integrity check and automatic generation

[1167] The server uses Python and Pandas to verify the integrity of the decrypted data, checking for missing information or formatting errors. If errors are found, an error message is generated and sent back to the terminal. If there are no problems, the data is passed to a generative AI (OpenAI API). This AI automatically generates documents by appropriately arranging the data received from the user, based on pre-trained logistics-related document templates.

[1168] 4. Document generation and storage

[1169] The generation AI automatically generates logistics-related documents in PDF format and sends them back to the server. PDFKit is used for PDF generation. The server saves the generated PDF files to AWS S3 and generates an access URL.

[1170] 5. Sending and downloading documents

[1171] The server sends an access URL for the generated PDF file to the user's terminal. The terminal displays the received URL to the user, who can click this URL to download the document and print it if necessary.

[1172] Specific example

[1173] As a concrete example, the following shows a case where a user generates shipping documents.

[1174] 1. The user operates the terminal and selects "Shipping Documents" on the logistics-related document selection screen.

[1175] 2. The terminal displays a form that prompts the user to enter necessary information such as the shipping address and product information.

[1176] 3. The user enters information such as "1-2-3 C-cho, B-city, A-prefecture", "electronic components", and "1000 pieces" into the form, checks the contents on the confirmation screen, and clicks the submit button.

[1177] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[1178] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[1179] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[1180] 7. The generative AI inserts data into a shipping document template and generates a shipping document in PDF format.

[1181] 8. The server saves the generated PDF and generates an access URL.

[1182] 9. The server sends the access URL to the terminal.

[1183] 10. The terminal displays a URL to the user, who clicks the URL to download the shipping documents and print them as needed.

[1184] Example of a prompt

[1185] Please generate the shipping document based on the following user input: Shipping destination: "1-2-3 C-cho, B-city, A-prefecture"; Shipping origin: "5-1-60 F-cho, E-city, D-prefecture"; Product: "Electronic components"; Quantity: "1000 pieces"; Shipping date: "2023-10-15"

[1186] The above describes a specific embodiment for carrying out the present invention. This system significantly improves the efficiency of the document creation process at logistics centers and reduces human error.

[1187] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1188] Step 1:

[1189] The user opens the smartphone app and selects "Shipping Documents" on the logistics document selection screen. The user enters the necessary information, such as the shipping address, product information, quantity, and shipping date. This entered data will be used in the next step.

[1190] Input: Shipping address, product information, quantity, shipping date

[1191] Output: Input data confirmation screen

[1192] Step 2:

[1193] The terminal displays the entered information to the user on a confirmation screen, prompting the user to review the content and click the submit button. When the user clicks the submit button, the entered data is structured in JSON format and encrypted using AES.

[1194] Input: User-confirmed input data

[1195] Output: Encrypted JSON data

[1196] Step 3:

[1197] The terminal sends encrypted JSON data to the server via the HTTPS protocol. The server receives the encrypted data and decrypts it using a predetermined AES key.

[1198] Input: Encrypted JSON data

[1199] Output: Decrypted JSON data

[1200] Step 4:

[1201] The server retrieves the decrypted JSON data and uses Python and Pandas to check the data's integrity. If there is missing information or an incorrect format, it generates an error message and sends it back to the terminal.

[1202] Input: Decrypted JSON data

[1203] Output: Integrity check result (success or error)

[1204] Step 5:

[1205] If there are no problems with the data, the server passes the consistent data to a generative AI (OpenAI API) and requests the automatic generation of logistics-related documents. The generative AI generates the documents by appropriately arranging the user data based on a document template that has been trained in advance.

[1206] Input: Consistent JSON data

[1207] Output: Data from the generated shipping documents

[1208] Step 6:

[1209] The generative AI creates automatically generated shipping documents in PDF format and sends them back to the server. The server uses PDFKit to save the generated PDF files. The saved PDF files are uploaded to AWS S3, and an access URL is generated.

[1210] Input: Data from the generated shipping document

[1211] Output: AWS S3 access URL

[1212] Step 7:

[1213] The server sends the terminal an access URL for the generated shipping documents. The terminal displays the received URL to the user.

[1214] Input: AWS S3 access URL

[1215] Output: Access URL displayed on the user's terminal

[1216] Step 8:

[1217] The user clicks the access URL displayed on their device and downloads the shipping documents using a browser or dedicated app. If necessary, they print the downloaded shipping documents.

[1218] Input: User click operation

[1219] Output: Downloadable and printed shipping documents

[1220] The above outlines the processing flow of the system program that implements the application example. The system performs appropriate data processing and calculations based on the data entered at each step, ultimately generating logistics-related documents.

[1221] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1222] This invention relates to a system capable of automatically generating official documents and recognizing user emotions to adjust the interface accordingly. In particular, it relates to a method and system for improving the user experience by protecting user-input data and adjusting the interface according to user emotions in a series of processes for generating official documents.

[1223] Overall system configuration

[1224] This system consists of user terminals, servers, generative artificial intelligence, and emotion engines as its main components.

[1225] 1. Data entry from users

[1226] The device provides an interface for selecting official documents and entering personal information. It incorporates an emotion engine that recognizes emotions in real time from the user's facial expressions and voice.

[1227] Users select necessary official documents, such as their resident registration certificate, and enter their personal information into a form provided by the system. During this process, the emotion engine monitors the user's emotions as they input the information.

[1228] 2. User emotion recognition and interface adjustment

[1229] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it detects that the user is stressed, it adjusts how the interface is displayed.

[1230] The device receives feedback from the emotion engine and automatically adjusts the interface based on the user's emotions. For example, if the user is feeling stressed, it may simplify navigation or display encouraging messages.

[1231] 3. Data transmission and decryption

[1232] The device encrypts the personal information entered by the user and sends it to the server.

[1233] The server receives the encrypted data and performs the decryption process.

[1234] 4. Data integrity check and automatic generation

[1235] The server verifies the data integrity of the received personal information, and if there are no errors, it passes the data to the generative artificial intelligence.

[1236] Generative artificial intelligence appropriately inserts data into templates for official documents and executes an automated generation process.

[1237] 5. Document generation and storage

[1238] The generative artificial intelligence outputs the generated document in PDF format and sends it back to the server.

[1239] The server saves the PDF file and generates a URL that the user can access.

[1240] 6. Sending and downloading documents

[1241] The server sends the device an access URL for the generated PDF file.

[1242] The device displays the URL to the user and shows a confirmation message.

[1243] Users click the URL to download the generated official document and print it if necessary.

[1244] Specific example: Generating a resident registration certificate

[1245] As a specific example, we will explain the procedure for a user to obtain a resident registration certificate.

[1246] 1. The user enters their user ID and password to log in to the system and selects "Resident Registration Certificate".

[1247] 2. The device displays a screen for selecting official documents and a data entry form. Simultaneously, an emotion engine monitors the user's facial expressions and voice to recognize their emotions.

[1248] 3. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen.

[1249] 4. The emotion engine analyzes the emotional data the user is inputting, and if the user is feeling stressed, the device changes the interface to a simplified display method.

[1250] 5. The user reviews the entered information on the confirmation screen and clicks the submit button.

[1251] 6. The terminal structures the verified data in JSON format, encrypts it, and sends it to the server.

[1252] 7. The server receives the encrypted data, performs the decryption process, and checks the integrity of the data.

[1253] 8. If there are no problems with data integrity, the server will pass the data to the generative artificial intelligence to automatically generate the resident registration records.

[1254] 9. The generative artificial intelligence generates a resident registration form in PDF format and sends it back to the server.

[1255] 10. The server saves the file, generates an access URL, and sends it to the terminal.

[1256] 11. The device displays a URL to the user, and the user clicks the URL to download the PDF file.

[1257] 12. The user reviews the generated resident registration certificate and prints it if necessary.

[1258] The following describes the processing flow.

[1259] Step 1:

[1260] Users log in to the system by entering their user ID and password.

[1261] Step 2:

[1262] The terminal sends the entered authentication information to the server and makes an authentication request.

[1263] Step 3:

[1264] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[1265] Step 4:

[1266] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[1267] Step 5:

[1268] The user selects the necessary official documents, such as their resident registration certificate, and clicks the "Next" button.

[1269] Step 6:

[1270] The device displays a form for entering necessary information for the document (such as name, address, and date of birth). At this time, the emotion engine begins to analyze the user's facial expressions and voice in real time.

[1271] Step 7:

[1272] The user enters personal information into the input form on the device. While the user is entering information, the emotion engine monitors their emotions, and if stress or confusion is detected, the device displays a message of support.

[1273] Step 8:

[1274] The terminal displays the entered data on a confirmation screen, allowing the user to review the content. Simultaneously, the emotion engine re-analyzes the user's emotions and adjusts the interface as needed.

[1275] Step 9:

[1276] The user reviews the data on the confirmation screen and clicks the submit button.

[1277] Step 10:

[1278] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[1279] Step 11:

[1280] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[1281] Step 12:

[1282] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[1283] Step 13:

[1284] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[1285] Step 14:

[1286] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[1287] Step 15:

[1288] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[1289] Step 16:

[1290] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[1291] Step 17:

[1292] The server sends back the access URL for the generated PDF file to the terminal.

[1293] Step 18:

[1294] The device displays the received URL to the user and shows a confirmation message.

[1295] Step 19:

[1296] The user clicks the displayed URL to download the PDF file and save it locally.

[1297] Step 20:

[1298] Users can print downloaded PDF files as needed and use them as official documents.

[1299] (Example 2)

[1300] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1301] The process of obtaining official documents typically requires manual data entry and verification, which is time-consuming and labor-intensive. Furthermore, it often lacks consideration for reducing user emotional stress, resulting in a poor user experience. Additionally, ensuring the security and integrity of input data is crucial.

[1302] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1303] In this invention, the server includes means for selecting official documents from the user, a screen for inputting personal information, means for encrypting and transmitting the entered personal information, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and automatically generating a document by inserting the data into an official document template using a generation AI, means for generating and saving the generated official document in PDF format, means for transmitting access information of the generated document to the user terminal, means for recognizing the user's emotions and adjusting the interface, and means for adjusting the user terminal's operation screen based on feedback from the emotion recognition means. This makes it possible for the user to efficiently obtain official documents without experiencing stress.

[1304] A "user" refers to an individual or organization that uses the system to obtain official documents.

[1305] "Official documents" are documents issued by the government or public institutions, and examples include resident registration certificates and other official documents.

[1306] "Screen-based means" refers to computer screens or interfaces used by users to select official documents and enter necessary personal information.

[1307] "Encryption" refers to the technology of transforming data using specific algorithms to protect it from unauthorized access or tampering by third parties.

[1308] "Transmission means" refers to protocols and technologies (for example, internet communication) used to send data from a user terminal to a server.

[1309] "Decryption" refers to the process of restoring encrypted data to its original state.

[1310] "Data integrity" refers to the process of ensuring that data is accurate, complete, and free from unexpected changes or inconsistencies.

[1311] "Generative AI means" refers to a function that uses artificial intelligence technology to appropriately insert a user's personal information into a template for an official document and automatically generate the document.

[1312] "PDF format" is a file format developed by Adobe, and refers to a standard format for electronically saving and displaying documents.

[1313] "Access information" refers to URLs or links that allow users to download or view generated public documents.

[1314] "Emotion recognition means" refers to technologies and devices that analyze a user's emotions in real time from their facial expressions and voice to determine the user's emotional state.

[1315] An "operation screen" is a screen that allows a user to interact with the system, and it is displayed through an application or web browser.

[1316] This invention relates to a system for the automatic generation of official documents and for recognizing user emotions and adjusting the interface accordingly. The system facilitates the processes of user selection of official documents, input of personal information, data encryption and transmission, decryption, data integrity verification, automatic generation, and document storage and transmission.

[1317] This system is mainly composed of the following components:

[1318] 1. User terminal

[1319] 2. Server

[1320] 3. Generation AI

[1321] 4. Emotion Recognition Engine

[1322] User terminal

[1323] The user terminal provides an interface for selecting official documents and entering personal information. This interface incorporates an emotion recognition engine that analyzes the user's facial expressions and voice in real time to determine their emotions. This allows the system to appropriately adjust the user interface when the user is experiencing stress.

[1324] server

[1325] The server is responsible for primary data processing and storage. Specifically, it receives encrypted data sent from user terminals and performs decryption. It also verifies data integrity and, if there are no problems, passes the data to the generation AI. Furthermore, it saves the generated public documents in PDF format, generates a URL accessible to the user, and sends it to the user terminal.

[1326] Generation AI

[1327] The generation AI is a program that automatically generates documents by appropriately inserting received user data into official document templates. This program has a pre-existing set of official document templates and has the function of selecting the appropriate template and inserting data based on user instructions.

[1328] Emotion recognition engine

[1329] The emotion recognition engine analyzes the user's facial expressions and voice to recognize their emotions in real time. Based on this information, the interface display and operation flow can be adjusted. For example, if the user is feeling stressed, the interface can be simplified and adjusted to make it easier for the user to operate.

[1330] Specific example

[1331] As a specific example, the procedure for a user obtaining a resident registration certificate is described. The user logs into the system by entering their user ID and password and selects the resident registration certificate. Next, the user terminal displays a public document selection screen and a data entry form. Simultaneously, the emotion recognition engine monitors the user's facial expressions and voice and recognizes their emotions. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen. The emotion recognition engine analyzes the emotional data while the user is entering information, and if the user is experiencing stress, the terminal changes to a simplified interface display. After the user confirms the entered information on the confirmation screen and clicks the submit button, the terminal structures the confirmed data in JSON format, encrypts it, and sends it to the server.

[1332] The server receives encrypted data, decrypts it, and checks its integrity. If there are no problems with data integrity, it passes the data to the generation AI, which automatically generates a resident registration certificate. The generation AI generates the resident registration certificate in PDF format and sends it back to the server. The server saves the file, generates an access URL, and sends it to the terminal. The terminal displays the URL to the user, who clicks the URL to download the PDF file. The user reviews the generated resident registration certificate and prints it if necessary.

[1333] Example of a prompt

[1334] Please automatically generate official documents (e.g., resident registration certificates) based on customer data.

[1335] Input data:

[1336] Name: Taro Yamada

[1337] Address: 123-4 Shibuya-ku, Tokyo

[1338] Date of birth: January 1, 1990

[1339] Output format: PDF

[1340] By inputting this prompt into the generation AI, it is possible to automatically and accurately generate the specified public document.

[1341] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1342] Step 1: The user selects an official document and enters personal information.

[1343] Specific actions:

[1344] Input: The user logs into the system using their user ID and password, and selects the type of official document (e.g., resident registration certificate).

[1345] The terminal displays the input form for the selected official document.

[1346] The user enters personal information such as their name, address, and date of birth into the displayed form.

[1347] Data processing and calculations:

[1348] The device transmits the entered personal information to the emotion recognition system in real time.

[1349] The emotion recognition system analyzes the user's facial expressions and voice to evaluate their emotional state.

[1350] Output: User-entered personal information and real-time updated sentiment data.

[1351] Specific actions:

[1352] If the emotion recognition engine analyzes the user's facial expressions and determines that they may be experiencing stress, the device will display a message saying "Simplifying input" and simplify the form.

[1353] Step 2: Confirm and submit input data

[1354] Specific actions:

[1355] Input: The user reviews the entered data and clicks the submit button.

[1356] The terminal structures the verified data into JSON format.

[1357] Data processing and calculations:

[1358] The device encrypts the structured data using the AES encryption algorithm.

[1359] Encrypted data is sent to the server.

[1360] Output: Encrypted personal data.

[1361] Specific actions:

[1362] The terminal converts the input data into JSON format, encrypts it with AES, and then sends it to the server.

[1363] Step 3: Receiving and decrypting encrypted data

[1364] Specific actions:

[1365] Input: The server receives encrypted data.

[1366] The server decrypts the received data using the AES decryption key.

[1367] Data processing and calculations:

[1368] The server verifies the integrity of the received data. Specifically, it checks whether each field is entered in the correct format.

[1369] Output: Personal information data with verified integrity.

[1370] Specific actions:

[1371] The server decrypts the encrypted data and performs an integrity check.

[1372] Step 4: Automated generation of official documents

[1373] Specific actions:

[1374] Input: Personal information data whose integrity has been verified.

[1375] The server passes the data to a data generation AI, which then inserts the data into a public document template to generate the document.

[1376] Data processing and calculations:

[1377] The generation AI selects the appropriate template and inserts the data.

[1378] The generation process is executed to generate the document in PDF format.

[1379] Output: The generated official document in PDF format.

[1380] Specific actions:

[1381] The generation AI inserts data into a template and generates a resident registration certificate in PDF format.

[1382] Step 5: Save the generated document and generate a URL

[1383] Specific actions:

[1384] Input: Generated official document in PDF format.

[1385] The server saves the PDF file and generates a URL that the user can access.

[1386] Data processing and calculations:

[1387] The server saves the PDF file to storage.

[1388] Generate an access URL and send it to the user's terminal.

[1389] Output: The access URL for the generated document.

[1390] Specific actions:

[1391] The server saves the PDF file, generates an access URL, and sends it to the terminal.

[1392] Step 6: Download and review the document

[1393] Specific actions:

[1394] Input: The access URL received by the user's terminal.

[1395] The device displays the URL to the user and shows a confirmation message.

[1396] Data processing and calculations:

[1397] The user clicks the URL to download the generated public document.

[1398] Print the document as needed.

[1399] Output: Public documents available for download by users.

[1400] Specific actions:

[1401] The device displays a message and URL stating, "Your resident registration certificate has been generated. Please click the link below to download it." The user clicks the URL, downloads the PDF file, reviews its contents, and prints it.

[1402] (Application Example 2)

[1403] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1404] Traditional public document generation systems often caused user stress, particularly during registration procedures for electronic payment services, resulting in a poor user experience. Furthermore, the protection of user input data was sometimes insufficient, raising security concerns. These issues need to be resolved to improve both user convenience and security.

[1405] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1406] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for recognizing the user's facial expressions and voice in real time and adjusting the interface according to their emotions, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating the document by inserting the data into an official document template, means for generating and saving the generated official document in PDF format, and means for sending an access URL for the generated document to the user's terminal. This makes it possible for the user to easily and securely generate official documents with an interface optimized according to their emotions.

[1407] "Selection of official documents by the user" refers to the act of a user selecting the necessary official documents using a designated interface.

[1408] "An interface for entering personal information" refers to an interface provided to a user for entering personal information such as their name, address, and date of birth.

[1409] "Means for recognizing user facial expressions and voice in real time" refers to methods for analyzing a user's facial expressions and voice to recognize their emotions in real time.

[1410] "Means for adjusting the interface" refers to means for automatically adjusting the interface to improve the user experience based on the results of user emotion recognition.

[1411] "Means for encrypting and transmitting entered personal information" refers to a method for encrypting personal information entered by a user and securely transmitting it to the server.

[1412] "Means for receiving and decrypting encrypted data" refers to means for receiving encrypted data and decrypting it.

[1413] "Means for verifying the integrity of received data" refers to means for verifying the accuracy and completeness of received data.

[1414] A "template for official documents" is a format used to generate official documents.

[1415] "Generative artificial intelligence means" refers to artificial intelligence means for automatically generating official documents based on templates.

[1416] "Means for generating and saving public documents in PDF format" refers to means for generating and saving public documents in PDF file format.

[1417] "Means for sending the access URL of the generated document to the user's terminal" refers to means for sending the access URL of the generated PDF file to the user's terminal.

[1418] This invention relates to a system for easily and securely generating official documents required by users in electronic payment services. The system includes means for user data input, emotion recognition, data encryption, automatic document generation, saving in PDF format, and transmission via an access point.

[1419] System Overview

[1420] This system consists of the following main components:

[1421] User terminal

[1422] server

[1423] Generative artificial intelligence

[1424] Emotional Engine

[1425] User terminal

[1426] The user terminal serves as an interface, providing screens for selecting official documents and entering personal information. It also uses a camera and microphone to capture the user's facial expressions and voice, providing this data to the emotion engine. The emotion engine then analyzes this data to recognize emotions.

[1427] Emotional Engine

[1428] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it determines that the user is stressed, the device will make adjustments such as simplifying the interface.

[1429] Data encryption and transmission

[1430] Personal information entered by users is encrypted on the device and securely transmitted to the server. The latest encryption technology (e.g., AES) is used to maintain a high level of security.

[1431] Server Processing

[1432] The server reliably decrypts the received encrypted data and then verifies its integrity. Afterward, it passes the data to a generative artificial intelligence system, which inserts the data into a public document template to automatically generate the document.

[1433] Generation and storage of official documents

[1434] Generative artificial intelligence generates official documents in PDF format based on given data. The generated PDFs are stored on a server, and an access URL is generated. This URL is sent to the user's device, allowing them to easily access and download the documents.

[1435] Specific example: Generating a resident registration certificate

[1436] Follow these steps to generate your resident registration certificate.

[1437] 1. The user selects the required official documents when registering for the electronic payment service.

[1438] 2. The device displays a screen for entering personal information, and an emotion engine monitors the user's facial expressions and voice.

[1439] 3. The user enters personal information such as their name, address, and date of birth.

[1440] 4. The emotion engine analyzes the user's emotions and adjusts the interface as needed.

[1441] 5. The entered data is encrypted and sent to the server.

[1442] 6. The server decrypts the data and verifies its integrity.

[1443] 7. The data whose consistency has been verified is passed to the generative artificial intelligence and inserted into the resident registration template.

[1444] 8. The generative artificial intelligence generates a resident registration form in PDF format and saves it to the server.

[1445] 9. The server sends the access URL for the generated PDF file to the terminal.

[1446] 10. The user clicks the URL displayed on their device to download the resident registration certificate.

[1447] Hardware and software to use

[1448] The user terminal is equipped with a high-performance camera and microphone, and software for emotion recognition (e.g., OpenCV, EmotionRecognizer). The server has software for data encryption and decryption (e.g., AES library), and the generative artificial intelligence incorporates an AI model for generating official documents (e.g., DocumentGenerator).

[1449] Example of a prompt

[1450] "Please generate prompts for the generative AI model in the following format:

[1451] 1. Name: [User input]

[1452] 2. Address: [User input]

[1453] 3. Date of birth: [User input]

[1454] Please generate a resident registration certificate as an official document.

[1455] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1456] Step 1:

[1457] The user selects the required official documents when registering for the electronic payment service. The terminal displays a screen for selecting the official documents. It receives the user's selection information as input and saves the type of selected official document to the terminal's memory as output.

[1458] Step 2:

[1459] The device displays a screen for entering personal information. Simultaneously, it uses its camera and microphone to capture the user's facial expressions and voice, and sends them to the emotion engine. It receives video and audio data from the camera and microphone as input, and obtains real-time emotion recognition results as output.

[1460] Step 3:

[1461] The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. It receives video and audio data as input, performs image and audio analysis as data processing, and provides feedback to the device regarding the user's emotional state (e.g., stress, relaxation) as output.

[1462] Step 4:

[1463] The device adjusts the interface according to the user's emotions based on feedback from the emotion engine. Specifically, if the user's emotion is recognized as stress, the interface is simplified and an encouraging message is displayed. It receives the emotion recognition result as input and displays the adjusted interface or message as output.

[1464] Step 5:

[1465] The user enters personal information such as their name, address, and date of birth. The terminal receives the user's input data, structures it, and stores it in the terminal's memory. It receives personal information such as name, address, and date of birth as input and generates structured data (e.g., in JSON format) as output.

[1466] Step 6:

[1467] The device encrypts structured personal information and sends it to the server. It uses the latest encryption technology (e.g., AES). It receives structured data as input, performs encryption as data processing, and sends the encrypted data to the server as output.

[1468] Step 7:

[1469] The server receives encrypted data and decrypts it. It receives encrypted data as input, performs decryption as data processing, and obtains decrypted data as output.

[1470] Step 8:

[1471] The server verifies the integrity of the decrypted data. It receives the decrypted data as input, performs an integrity check (e.g., comparing hash values) as a data operation, and obtains the integrity verification result as output. If the integrity is confirmed, it proceeds to the next step.

[1472] Step 9:

[1473] The server passes the data, whose integrity has been verified, to a generative artificial intelligence (AI) system, which then inserts the data into a public document template to automatically generate the document. It receives decrypted data as input, performs data processing including data insertion into the template and document generation, and outputs a generated PDF document.

[1474] Step 10:

[1475] The server saves the generated public documents in PDF format. It receives the generated PDF documents as input and saves them to server storage as output.

[1476] Step 11:

[1477] The server generates an access URL for the generated PDF file and sends it to the user's terminal. It receives the PDF file's save path as input, processes the data to generate the access URL, and sends the generated access URL to the user's terminal as output.

[1478] Step 12:

[1479] The user clicks the URL displayed on their device to download the generated official document. The system receives the access URL as input, performs a data calculation to download the PDF file, and obtains the downloaded PDF file as output.

[1480] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1481] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1482] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1483] [Fourth Embodiment]

[1484] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1485] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1486] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1487] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1488] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1489] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1490] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1491] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1492] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1493] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1494] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1495] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1496] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1497] This invention relates to an automated system for generating official documents, and more particularly to a method and system for automatically generating official documents using artificial intelligence based on data entered by a user. A detailed configuration for implementing this system is described below.

[1498] System Overview

[1499] This system is broadly composed of user terminals corresponding to use cases, servers that process data, and generative artificial intelligence that generates data.

[1500] 1. Data entry from users

[1501] The terminal provides an interface screen for users to select official documents and enter personal information (such as name, address, and date of birth). This screen is designed to be user-friendly and allow for easy input of necessary information.

[1502] The user selects the required official documents and enters personal information into the form. This information is entered according to the input form provided by the terminal.

[1503] 2. Data transmission and decryption

[1504] The terminal displays the entered personal information on a confirmation screen, and after the user confirms it, it structures the data in JSON format, encrypts it, and sends it to the server.

[1505] The server receives the encrypted data and decrypts it using a predetermined encryption method. Once the data decryption is complete, it proceeds to the next data integrity check.

[1506] 3. Data integrity check and automatic generation

[1507] The server verifies the integrity of the decrypted data and checks for any missing information or formatting errors. If errors are found, it generates an error message and sends it back to the terminal.

[1508] If there are no problems, the data is passed to a generative AI. This AI automatically generates documents by appropriately arranging the received data based on pre-trained templates of official documents.

[1509] 4. Document generation and storage

[1510] The generative AI generates automatically created official documents in PDF format and sends them back to the server. PDF is a widely used format with high readability and compatibility.

[1511] The server saves the generated PDF file to a designated directory and generates an access URL. This URL is for the user to access the document later.

[1512] 5. Sending and downloading documents

[1513] The server sends the access URL for the generated PDF file to the user's terminal.

[1514] The device displays the received URL to the user, and the user can download the document by clicking this URL.

[1515] Specific example: Generating a resident registration certificate

[1516] As a concrete example, the case of a user obtaining a resident registration certificate is explained below.

[1517] 1. The user operates the device and selects "Certificate of Residence" on the official document selection screen.

[1518] 2. The terminal displays a form prompting the user to enter necessary information such as their name, address, and date of birth.

[1519] 3. The user enters information such as "Taro Yamada" and "1-2-3 Minato-ku, Tokyo" into the form, checks the details on the confirmation screen, and clicks the submit button.

[1520] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[1521] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[1522] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[1523] 7. The generative AI inserts data into a resident registration form template and generates a resident registration form in PDF format.

[1524] 8. The server saves the generated PDF and generates an access URL.

[1525] 9. The server sends the access URL to the terminal.

[1526] 10. The terminal displays a URL to the user, who clicks the URL to download the resident registration certificate and prints it if necessary.

[1527] The above describes a specific embodiment of the method for automatically generating official documents using the system of the present invention. This system streamlines the creation of official documents and reduces the risk of user errors.

[1528] The following describes the processing flow.

[1529] Step 1:

[1530] Users log in to the system by entering their user ID and password.

[1531] Step 2:

[1532] The terminal sends the entered authentication information to the server and makes an authentication request.

[1533] Step 3:

[1534] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[1535] Step 4:

[1536] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[1537] Step 5:

[1538] The user selects the necessary documents, such as their resident registration certificate, and clicks the "Next" button.

[1539] Step 6:

[1540] The terminal displays a form for entering the necessary information for the document (such as name, address, and date of birth).

[1541] Step 7:

[1542] The user enters their personal information into the input form on the device and clicks the button to proceed to the confirmation screen.

[1543] Step 8:

[1544] The terminal displays the entered data on a confirmation screen, allowing the user to review the content.

[1545] Step 9:

[1546] The user reviews the data on the confirmation screen and clicks the submit button.

[1547] Step 10:

[1548] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[1549] Step 11:

[1550] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[1551] Step 12:

[1552] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[1553] Step 13:

[1554] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[1555] Step 14:

[1556] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[1557] Step 15:

[1558] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[1559] Step 16:

[1560] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[1561] Step 17:

[1562] The server sends back the access URL for the generated PDF file to the terminal.

[1563] Step 18:

[1564] The device displays the received URL to the user and shows a confirmation message.

[1565] Step 19:

[1566] The user clicks the displayed URL to download the PDF file and save it locally.

[1567] Step 20:

[1568] Users can print downloaded PDF files as needed and use them as official documents.

[1569] (Example 1)

[1570] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1571] Traditional methods for generating official documents required users to manually input information and create the documents themselves. This process was time-consuming and carried a high risk of input errors. Furthermore, if the format or content of the document was inaccurate, it had to be recreated, making it highly inefficient. Therefore, there was a need for a system that could easily input information through a user-friendly interface and generate official documents accurately and automatically using artificial intelligence.

[1572] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1573] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for structuring the input personal information in JSON format, encrypting it, and transmitting it, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and detecting missing information or format errors, a generative artificial intelligence means for automatically generating documents by inserting the received data into an official document template, means for generating and saving the generated official document in PDF format, and means for generating an access URL for the generated document and sending it to the user's terminal. As a result, the user can easily input the necessary information, and based on that information, it becomes possible to generate official documents quickly and accurately.

[1574] An "interface means" is a functional device provided for users to select official documents and input personal information.

[1575] "JSON format" is an abbreviation for JavaScript Object Notation, and it is a lightweight data exchange format for structuring, storing, or transferring data.

[1576] "Encryption" is a technology that converts data into a format that is difficult to analyze, thereby preventing unauthorized access and information leaks.

[1577] A "server" is a computer system that receives, decrypts, processes, and stores data over a network.

[1578] "Decryption" is the process of restoring encrypted data to its original format.

[1579] "Consistency check" is a process to verify that received data is complete and conforms to the specified format.

[1580] "Generative artificial intelligence means" refers to artificial intelligence technology that automatically processes data based on pre-learned templates to generate official documents.

[1581] "PDF format" is an abbreviation for Portable Document Format, a file format for consistently displaying and printing documents on various devices.

[1582] An "access URL" is the web address used to access the generated official document.

[1583] Hardware and software necessary for carrying out the invention

[1584] This invention is a system for automatically generating official documents, constructed using a user terminal, a server, and generative artificial intelligence (AI). The user terminal is a device that the user can operate, such as a personal computer, smartphone, or tablet. The server is a computing system that receives, decrypts, checks the integrity of data, generates documents, and stores them. The generative AI is a machine learning model that has the function of automatically processing data and generating official documents.

[1585] System Overview

[1586] This system automatically generates official documents using the following procedure.

[1587] Data entry from users

[1588] The terminal provides an interface for selecting official documents and entering personal information (e.g., name, address, date of birth). This interface is designed to be easy for the user to operate.

[1589] Specific example: The user operates the terminal and selects "Resident Registration," then enters "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990" into the input form on the screen.

[1590] Data transmission and decryption

[1591] The terminal structures the entered information in JSON format and encrypts the data using an encryption algorithm such as AES (Advanced Encryption Standard). The encrypted data is sent to the server. The server receives this data and decrypts it back into the original data using a decryption algorithm.

[1592] Specific example: After the user confirms the input content and presses the submit button, the device structures the data in JSON format, encrypts it with AES, and sends it to the server.

[1593] Data integrity check and automatic generation

[1594] The server checks the integrity of the decrypted data. It verifies that the data is complete and free from missing information or formatting errors. If errors are found, the server generates an error message and sends it back to the terminal.

[1595] Once the server confirms that the data is free of problems, it passes the data to the generative AI. The generative AI then automatically generates the document by inserting the data based on a template of a public document that it has learned in advance.

[1596] Specific example: The server performs a consistency check on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," then passes it to a generative AI, which generates a resident registration certificate in PDF format based on a template.

[1597] Document generation and storage

[1598] The generative AI generates automatically created official documents in PDF format and sends them back to the server. The server saves these PDF files to a designated directory and generates an access URL.

[1599] Specific example: A generative AI generates a resident registration form in PDF format and sends it back to the server, which then saves it and generates an access URL.

[1600] Sending and downloading documents

[1601] The server sends an access URL to the user's terminal. The terminal displays the URL to the user, who can then click on it to download the document.

[1602] Specific example: A user clicks a URL sent from the server to download a resident registration certificate and prints it if necessary.

[1603] Examples of prompts to input into a generative AI model

[1604] "Based on the following information, please appropriately insert the data into the resident registration form template to generate a PDF file. Name: Taro Yamada, Address: 1-2-3 Minato-ku, Tokyo, Date of Birth: January 1, 1990."

[1605] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1606] Step 1:

[1607] The terminal displays an interface for selecting official documents and entering personal information. The data entered by the user (e.g., name, address, date of birth) is entered into the interface. The entered data is temporarily stored on the terminal, and the process proceeds to the next step.

[1608] Step 2:

[1609] The user selects an official document and enters the required information (e.g., name, address, date of birth) into the input form. The entered data is saved in the device's memory, and confirmation is requested. The user confirms the entered information by clicking the submit button and proceeds to the next step.

[1610] Step 3:

[1611] The terminal structures the data entered by the user in JSON format. The structured JSON data is encrypted using the AES encryption algorithm. The encrypted data is then sent to the server. The input is JSON data, and the output is encrypted data.

[1612] Step 4:

[1613] The server receives encrypted data sent from the terminal. It decrypts the received encrypted data using the AES decryption algorithm. The input is encrypted data, and the output is decrypted data (in JSON format).

[1614] Step 5:

[1615] The server checks the integrity of the decrypted data. Specifically, it verifies that no data is missing and that the format is correct. Depending on the errors detected, an error message is generated and sent back to the terminal. Data that has been verified as integrity proceeds to the next step. The input is the decrypted data, and the output is the integrity check result (data to proceed to the next step if no errors are found).

[1616] Step 6:

[1617] The server passes data that has passed an integrity check to the generative AI. The generative AI uses a pre-trained public document template to appropriately arrange the passed data. Specific example: The generative AI inserts a resident registration form into the template based on the data "Taro Yamada," "1-2-3 Minato-ku, Tokyo," and "January 1, 1990," and issues instructions to generate a PDF. The input is data that has passed an integrity check, and the output is the PDF generation instruction.

[1618] Step 7:

[1619] The generative AI generates official documents in PDF format and returns the generated PDF file to the server. The input is a PDF generation instruction, and the output is a PDF file.

[1620] Step 8:

[1621] The server saves the generated PDF file to a designated directory. It then generates an access URL for the saved PDF file, saves this URL, and proceeds to the next step. The input is a PDF file, and the output is an access URL.

[1622] Step 9:

[1623] The server sends the access URL for the generated document to the user's terminal. The input is the access URL, and the output is the transmission of the URL to the user's terminal.

[1624] Step 10:

[1625] The terminal displays the received access URL, and the user downloads the document by clicking it. The user prints the downloaded document as needed. The input is the access URL, and the output is the download and printing of the official document.

[1626] (Application Example 1)

[1627] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1628] Logistics centers and delivery operations require the creation of a wide variety of shipping documents, receipts, and delivery labels, and this process is time-consuming. Furthermore, manual data entry and creation processes are prone to human error, necessitating frequent corrections. Additionally, while digital storage and rapid access to documents are required, existing systems struggle to fully meet these needs. Given this background, there is a need for an automated system for generating official documents efficiently within logistics centers.

[1629] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1630] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating documents by inserting the data into logistics-related document templates, means for generating and saving the generated logistics-related documents in PDF format, means for sending an access URL for the generated documents to the user terminal, and access means for downloading and printing the generated documents. This enables increased efficiency in document creation and a reduction in human error.

[1631] A "user" refers to an individual or company that uses the system to select official documents or logistics-related documents and enter personal information.

[1632] "Official documents" refer to official documents issued by government agencies or public institutions.

[1633] "Interface means" refers to the parts of a system that provide user-friendly screens and functions for users to input personal information, select documents, and so on.

[1634] "Personal information" refers to information that identifies a specific individual, such as a user's name, address, and date of birth.

[1635] "Encryption" is a technology that transforms data using a specific algorithm to protect it and prevent it from being deciphered by third parties.

[1636] "Sending" refers to the process of transferring data entered by the user to the server.

[1637] "Decryption" is the process of restoring encrypted data to its original format.

[1638] "Consistency" refers to a state in which data is complete, accurate, and maintains consistency.

[1639] A "template" is a pre-defined document with a specific format and layout.

[1640] "Generative artificial intelligence means" refers to the system component that uses machine learning and AI technology to automatically generate official documents and logistics-related documents.

[1641] "PDF format" is an abbreviation for Portable Document Format, a file format that allows a document to be displayed and printed on different devices and applications while maintaining its original appearance.

[1642] "Saving" refers to the process of retaining generated data and documents and making them accessible later.

[1643] An "access URL" is a web address that allows a user to access a generated document via the internet.

[1644] "Download and print methods" refers to applications and functions that allow users to save generated documents to their local device or to print them physically.

[1645] "Logistics-related documents" refers to all official documents related to logistics and delivery operations, such as shipping documents, receipts, and delivery labels.

[1646] This invention is a system aimed at improving the efficiency of document generation in logistics centers, and automatically generates shipping documents and receipts based on user input data. A specific embodiment of the system is shown below.

[1647] System Overview

[1648] This system is broadly composed of user terminals, servers, and generative artificial intelligence (generative AI). It automatically generates logistics-related documents primarily through the following steps.

[1649] 1. Data entry from users

[1650] The system provides an interface on the user's terminal for selecting logistics-related documents such as shipping documents and receipts, and for entering necessary personal information (e.g., shipping address, product information). This screen is implemented using React Native and features a user-friendly UI.

[1651] 2. Data transmission and decryption

[1652] The terminal displays the entered personal information on a confirmation screen, then constructs the data in JSON format, encrypts it, and sends it to the server. The latest encryption technology is used. The server receives this data using Node.js and Express and decrypts it using a predetermined encryption method.

[1653] 3. Data integrity check and automatic generation

[1654] The server uses Python and Pandas to verify the integrity of the decrypted data, checking for missing information or formatting errors. If errors are found, an error message is generated and sent back to the terminal. If there are no problems, the data is passed to a generative AI (OpenAI API). This AI automatically generates documents by appropriately arranging the data received from the user, based on pre-trained logistics-related document templates.

[1655] 4. Document generation and storage

[1656] The generation AI automatically generates logistics-related documents in PDF format and sends them back to the server. PDFKit is used for PDF generation. The server saves the generated PDF files to AWS S3 and generates an access URL.

[1657] 5. Sending and downloading documents

[1658] The server sends an access URL for the generated PDF file to the user's terminal. The terminal displays the received URL to the user, who can click this URL to download the document and print it if necessary.

[1659] Specific example

[1660] As a concrete example, the following shows a case where a user generates shipping documents.

[1661] 1. The user operates the terminal and selects "Shipping Documents" on the logistics-related document selection screen.

[1662] 2. The terminal displays a form that prompts the user to enter necessary information such as the shipping address and product information.

[1663] 3. The user enters information such as "1-2-3 C-cho, B-city, A-prefecture", "electronic components", and "1000 pieces" into the form, checks the contents on the confirmation screen, and clicks the submit button.

[1664] 4. The terminal structures the input data in JSON format, encrypts it, and sends it to the server.

[1665] 5. The server receives and decrypts the encrypted data. Once decryption is complete, it performs a data integrity check.

[1666] 6. The server verifies that the data is free of problems and then passes it on to the generative AI.

[1667] 7. The generative AI inserts data into a shipping document template and generates a shipping document in PDF format.

[1668] 8. The server saves the generated PDF and generates an access URL.

[1669] 9. The server sends the access URL to the terminal.

[1670] 10. The terminal displays a URL to the user, who clicks the URL to download the shipping documents and print them as needed.

[1671] Example of a prompt

[1672] Please generate the shipping document based on the following user input: Shipping destination: "1-2-3 C-cho, B-city, A-prefecture"; Shipping origin: "5-1-60 F-cho, E-city, D-prefecture"; Product: "Electronic components"; Quantity: "1000 pieces"; Shipping date: "2023-10-15"

[1673] The above describes a specific embodiment for carrying out the present invention. This system significantly improves the efficiency of the document creation process at logistics centers and reduces human error.

[1674] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1675] Step 1:

[1676] The user opens the smartphone app and selects "Shipping Documents" on the logistics document selection screen. The user enters the necessary information, such as the shipping address, product information, quantity, and shipping date. This entered data will be used in the next step.

[1677] Input: Shipping address, product information, quantity, shipping date

[1678] Output: Input data confirmation screen

[1679] Step 2:

[1680] The terminal displays the entered information to the user on a confirmation screen, prompting the user to review the content and click the submit button. When the user clicks the submit button, the entered data is structured in JSON format and encrypted using AES.

[1681] Input: User-confirmed input data

[1682] Output: Encrypted JSON data

[1683] Step 3:

[1684] The terminal sends encrypted JSON data to the server via the HTTPS protocol. The server receives the encrypted data and decrypts it using a predetermined AES key.

[1685] Input: Encrypted JSON data

[1686] Output: Decrypted JSON data

[1687] Step 4:

[1688] The server retrieves the decrypted JSON data and uses Python and Pandas to check the data's integrity. If there is missing information or an incorrect format, it generates an error message and sends it back to the terminal.

[1689] Input: Decrypted JSON data

[1690] Output: Integrity check result (success or error)

[1691] Step 5:

[1692] If there are no problems with the data, the server passes the consistent data to a generative AI (OpenAI API) and requests the automatic generation of logistics-related documents. The generative AI generates the documents by appropriately arranging the user data based on a document template that has been trained in advance.

[1693] Input: Consistent JSON data

[1694] Output: Data from the generated shipping documents

[1695] Step 6:

[1696] The generative AI creates automatically generated shipping documents in PDF format and sends them back to the server. The server uses PDFKit to save the generated PDF files. The saved PDF files are uploaded to AWS S3, and an access URL is generated.

[1697] Input: Data from the generated shipping document

[1698] Output: AWS S3 access URL

[1699] Step 7:

[1700] The server sends the terminal an access URL for the generated shipping documents. The terminal displays the received URL to the user.

[1701] Input: AWS S3 access URL

[1702] Output: Access URL displayed on the user's terminal

[1703] Step 8:

[1704] The user clicks the access URL displayed on their device and downloads the shipping documents using a browser or dedicated app. If necessary, they print the downloaded shipping documents.

[1705] Input: User click operation

[1706] Output: Downloadable and printed shipping documents

[1707] The above outlines the processing flow of the system program that implements the application example. The system performs appropriate data processing and calculations based on the data entered at each step, ultimately generating logistics-related documents.

[1708] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1709] This invention relates to a system capable of automatically generating official documents and recognizing user emotions to adjust the interface accordingly. In particular, it relates to a method and system for improving the user experience by protecting user-input data and adjusting the interface according to user emotions in a series of processes for generating official documents.

[1710] Overall system configuration

[1711] This system consists of user terminals, servers, generative artificial intelligence, and emotion engines as its main components.

[1712] 1. Data entry from users

[1713] The device provides an interface for selecting official documents and entering personal information. It incorporates an emotion engine that recognizes emotions in real time from the user's facial expressions and voice.

[1714] Users select necessary official documents, such as their resident registration certificate, and enter their personal information into a form provided by the system. During this process, the emotion engine monitors the user's emotions as they input the information.

[1715] 2. User emotion recognition and interface adjustment

[1716] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it detects that the user is stressed, it adjusts how the interface is displayed.

[1717] The device receives feedback from the emotion engine and automatically adjusts the interface based on the user's emotions. For example, if the user is feeling stressed, it may simplify navigation or display encouraging messages.

[1718] 3. Data transmission and decryption

[1719] The device encrypts the personal information entered by the user and sends it to the server.

[1720] The server receives the encrypted data and performs the decryption process.

[1721] 4. Data integrity check and automatic generation

[1722] The server verifies the data integrity of the received personal information, and if there are no errors, it passes the data to the generative artificial intelligence.

[1723] Generative artificial intelligence appropriately inserts data into templates for official documents and executes an automated generation process.

[1724] 5. Document generation and storage

[1725] The generative artificial intelligence outputs the generated document in PDF format and sends it back to the server.

[1726] The server saves the PDF file and generates a URL that the user can access.

[1727] 6. Sending and downloading documents

[1728] The server sends the device an access URL for the generated PDF file.

[1729] The device displays the URL to the user and shows a confirmation message.

[1730] Users click the URL to download the generated official document and print it if necessary.

[1731] Specific example: Generating a resident registration certificate

[1732] As a specific example, we will explain the procedure for a user to obtain a resident registration certificate.

[1733] 1. The user enters their user ID and password to log in to the system and selects "Resident Registration Certificate".

[1734] 2. The device displays a screen for selecting official documents and a data entry form. Simultaneously, an emotion engine monitors the user's facial expressions and voice to recognize their emotions.

[1735] 3. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen.

[1736] 4. The emotion engine analyzes the emotional data the user is inputting, and if the user is feeling stressed, the device changes the interface to a simplified display method.

[1737] 5. The user reviews the entered information on the confirmation screen and clicks the submit button.

[1738] 6. The terminal structures the verified data in JSON format, encrypts it, and sends it to the server.

[1739] 7. The server receives the encrypted data, performs the decryption process, and checks the integrity of the data.

[1740] 8. If there are no problems with data integrity, the server will pass the data to the generative artificial intelligence to automatically generate the resident registration records.

[1741] 9. The generative artificial intelligence generates a resident registration form in PDF format and sends it back to the server.

[1742] 10. The server saves the file, generates an access URL, and sends it to the terminal.

[1743] 11. The device displays a URL to the user, and the user clicks the URL to download the PDF file.

[1744] 12. The user reviews the generated resident registration certificate and prints it if necessary.

[1745] The following describes the processing flow.

[1746] Step 1:

[1747] Users log in to the system by entering their user ID and password.

[1748] Step 2:

[1749] The terminal sends the entered authentication information to the server and makes an authentication request.

[1750] Step 3:

[1751] The server checks the received authentication information against its database, and if authentication is successful, it returns login permission to the terminal.

[1752] Step 4:

[1753] The terminal displays a screen for selecting official documents to the user, who then selects the necessary documents.

[1754] Step 5:

[1755] The user selects the necessary official documents, such as their resident registration certificate, and clicks the "Next" button.

[1756] Step 6:

[1757] The device displays a form for entering necessary information for the document (such as name, address, and date of birth). At this time, the emotion engine begins to analyze the user's facial expressions and voice in real time.

[1758] Step 7:

[1759] The user enters personal information into the input form on the device. While the user is entering information, the emotion engine monitors their emotions, and if stress or confusion is detected, the device displays a message of support.

[1760] Step 8:

[1761] The terminal displays the entered data on a confirmation screen, allowing the user to review the content. Simultaneously, the emotion engine re-analyzes the user's emotions and adjusts the interface as needed.

[1762] Step 9:

[1763] The user reviews the data on the confirmation screen and clicks the submit button.

[1764] Step 10:

[1765] The device structures the entered data in JSON format, encrypts it, and sends it to the server in response to the click of the confirmation button.

[1766] Step 11:

[1767] The server receives the encrypted data, performs a decryption process, and restores it to its original data format.

[1768] Step 12:

[1769] The server checks the integrity of the received data, verifying that there is no missing information or errors in format.

[1770] Step 13:

[1771] The server verifies that there are no problems with the data and passes the data, whose integrity has been confirmed, to the generative AI.

[1772] Step 14:

[1773] The generative AI inserts data into templates for official documents such as resident registration certificates and executes an automated generation process.

[1774] Step 15:

[1775] The generative AI outputs the generated document in PDF format and sends the file back to the server.

[1776] Step 16:

[1777] The server saves the PDF file to a designated directory and generates a URL that the user can access.

[1778] Step 17:

[1779] The server sends back the access URL for the generated PDF file to the terminal.

[1780] Step 18:

[1781] The device displays the received URL to the user and shows a confirmation message.

[1782] Step 19:

[1783] The user clicks the displayed URL to download the PDF file and save it locally.

[1784] Step 20:

[1785] Users can print downloaded PDF files as needed and use them as official documents.

[1786] (Example 2)

[1787] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1788] The process of obtaining official documents typically requires manual data entry and verification, which is time-consuming and labor-intensive. Furthermore, it often lacks consideration for reducing user emotional stress, resulting in a poor user experience. Additionally, ensuring the security and integrity of input data is crucial.

[1789] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1790] In this invention, the server includes means for selecting official documents from the user, a screen for inputting personal information, means for encrypting and transmitting the entered personal information, means for receiving and decrypting the encrypted data, means for verifying the integrity of the received data and automatically generating a document by inserting the data into an official document template using a generation AI, means for generating and saving the generated official document in PDF format, means for transmitting access information of the generated document to the user terminal, means for recognizing the user's emotions and adjusting the interface, and means for adjusting the user terminal's operation screen based on feedback from the emotion recognition means. This makes it possible for the user to efficiently obtain official documents without experiencing stress.

[1791] A "user" refers to an individual or organization that uses the system to obtain official documents.

[1792] "Official documents" are documents issued by the government or public institutions, and examples include resident registration certificates and other official documents.

[1793] "Screen-based means" refers to computer screens or interfaces used by users to select official documents and enter necessary personal information.

[1794] "Encryption" refers to the technology of transforming data using specific algorithms to protect it from unauthorized access or tampering by third parties.

[1795] "Transmission means" refers to protocols and technologies (for example, internet communication) used to send data from a user terminal to a server.

[1796] "Decryption" refers to the process of restoring encrypted data to its original state.

[1797] "Data integrity" refers to the process of ensuring that data is accurate, complete, and free from unexpected changes or inconsistencies.

[1798] "Generative AI means" refers to a function that uses artificial intelligence technology to appropriately insert a user's personal information into a template for an official document and automatically generate the document.

[1799] "PDF format" is a file format developed by Adobe, and refers to a standard format for electronically saving and displaying documents.

[1800] "Access information" refers to URLs or links that allow users to download or view generated public documents.

[1801] "Emotion recognition means" refers to technologies and devices that analyze a user's emotions in real time from their facial expressions and voice to determine the user's emotional state.

[1802] An "operation screen" is a screen that allows a user to interact with the system, and it is displayed through an application or web browser.

[1803] This invention relates to a system for the automatic generation of official documents and for recognizing user emotions and adjusting the interface accordingly. The system facilitates the processes of user selection of official documents, input of personal information, data encryption and transmission, decryption, data integrity verification, automatic generation, and document storage and transmission.

[1804] This system is mainly composed of the following components:

[1805] 1. User terminal

[1806] 2. Server

[1807] 3. Generation AI

[1808] 4. Emotion Recognition Engine

[1809] User terminal

[1810] The user terminal provides an interface for selecting official documents and entering personal information. This interface incorporates an emotion recognition engine that analyzes the user's facial expressions and voice in real time to determine their emotions. This allows the system to appropriately adjust the user interface when the user is experiencing stress.

[1811] server

[1812] The server is responsible for primary data processing and storage. Specifically, it receives encrypted data sent from user terminals and performs decryption. It also verifies data integrity and, if there are no problems, passes the data to the generation AI. Furthermore, it saves the generated public documents in PDF format, generates a URL accessible to the user, and sends it to the user terminal.

[1813] Generation AI

[1814] The generation AI is a program that automatically generates documents by appropriately inserting received user data into official document templates. This program has a pre-existing set of official document templates and has the function of selecting the appropriate template and inserting data based on user instructions.

[1815] Emotion recognition engine

[1816] The emotion recognition engine analyzes the user's facial expressions and voice to recognize their emotions in real time. Based on this information, the interface display and operation flow can be adjusted. For example, if the user is feeling stressed, the interface can be simplified and adjusted to make it easier for the user to operate.

[1817] Specific example

[1818] As a specific example, the procedure for a user obtaining a resident registration certificate is described. The user logs into the system by entering their user ID and password and selects the resident registration certificate. Next, the user terminal displays a public document selection screen and a data entry form. Simultaneously, the emotion recognition engine monitors the user's facial expressions and voice and recognizes their emotions. The user enters personal information such as their name, address, and date of birth into the form provided by the system and proceeds to the confirmation screen. The emotion recognition engine analyzes the emotional data while the user is entering information, and if the user is experiencing stress, the terminal changes to a simplified interface display. After the user confirms the entered information on the confirmation screen and clicks the submit button, the terminal structures the confirmed data in JSON format, encrypts it, and sends it to the server.

[1819] The server receives encrypted data, decrypts it, and checks its integrity. If there are no problems with data integrity, it passes the data to the generation AI, which automatically generates a resident registration certificate. The generation AI generates the resident registration certificate in PDF format and sends it back to the server. The server saves the file, generates an access URL, and sends it to the terminal. The terminal displays the URL to the user, who clicks the URL to download the PDF file. The user reviews the generated resident registration certificate and prints it if necessary.

[1820] Example of a prompt

[1821] Please automatically generate official documents (e.g., resident registration certificates) based on customer data.

[1822] Input data:

[1823] Name: Taro Yamada

[1824] Address: 123-4 Shibuya-ku, Tokyo

[1825] Date of birth: January 1, 1990

[1826] Output format: PDF

[1827] By inputting this prompt into the generation AI, it is possible to automatically and accurately generate the specified public document.

[1828] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1829] Step 1: The user selects an official document and enters personal information.

[1830] Specific actions:

[1831] Input: The user logs into the system using their user ID and password, and selects the type of official document (e.g., resident registration certificate).

[1832] The terminal displays the input form for the selected official document.

[1833] The user enters personal information such as their name, address, and date of birth into the displayed form.

[1834] Data processing and calculations:

[1835] The device transmits the entered personal information to the emotion recognition system in real time.

[1836] The emotion recognition system analyzes the user's facial expressions and voice to evaluate their emotional state.

[1837] Output: User-entered personal information and real-time updated sentiment data.

[1838] Specific actions:

[1839] If the emotion recognition engine analyzes the user's facial expressions and determines that they may be experiencing stress, the device will display a message saying "Simplifying input" and simplify the form.

[1840] Step 2: Confirm and submit input data

[1841] Specific actions:

[1842] Input: The user reviews the entered data and clicks the submit button.

[1843] The terminal structures the verified data into JSON format.

[1844] Data processing and calculations:

[1845] The device encrypts the structured data using the AES encryption algorithm.

[1846] Encrypted data is sent to the server.

[1847] Output: Encrypted personal data.

[1848] Specific actions:

[1849] The terminal converts the input data into JSON format, encrypts it with AES, and then sends it to the server.

[1850] Step 3: Receiving and decrypting encrypted data

[1851] Specific actions:

[1852] Input: The server receives encrypted data.

[1853] The server decrypts the received data using the AES decryption key.

[1854] Data processing and calculations:

[1855] The server verifies the integrity of the received data. Specifically, it checks whether each field is entered in the correct format.

[1856] Output: Personal information data with verified integrity.

[1857] Specific actions:

[1858] The server decrypts the encrypted data and performs an integrity check.

[1859] Step 4: Automated generation of official documents

[1860] Specific actions:

[1861] Input: Personal information data whose integrity has been verified.

[1862] The server passes the data to a data generation AI, which then inserts the data into a public document template to generate the document.

[1863] Data processing and calculations:

[1864] The generation AI selects the appropriate template and inserts the data.

[1865] The generation process is executed to generate the document in PDF format.

[1866] Output: The generated official document in PDF format.

[1867] Specific actions:

[1868] The generation AI inserts data into a template and generates a resident registration certificate in PDF format.

[1869] Step 5: Save the generated document and generate a URL

[1870] Specific actions:

[1871] Input: Generated official document in PDF format.

[1872] The server saves the PDF file and generates a URL that the user can access.

[1873] Data processing and calculations:

[1874] The server saves the PDF file to storage.

[1875] Generate an access URL and send it to the user's terminal.

[1876] Output: The access URL for the generated document.

[1877] Specific actions:

[1878] The server saves the PDF file, generates an access URL, and sends it to the terminal.

[1879] Step 6: Download and review the document

[1880] Specific actions:

[1881] Input: The access URL received by the user's terminal.

[1882] The device displays the URL to the user and shows a confirmation message.

[1883] Data processing and calculations:

[1884] The user clicks the URL to download the generated public document.

[1885] Print the document as needed.

[1886] Output: Public documents available for download by users.

[1887] Specific actions:

[1888] The device displays a message and URL stating, "Your resident registration certificate has been generated. Please click the link below to download it." The user clicks the URL, downloads the PDF file, reviews its contents, and prints it.

[1889] (Application Example 2)

[1890] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1891] Traditional public document generation systems often caused user stress, particularly during registration procedures for electronic payment services, resulting in a poor user experience. Furthermore, the protection of user input data was sometimes insufficient, raising security concerns. These issues need to be resolved to improve both user convenience and security.

[1892] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1893] In this invention, the server includes an interface means for the user to select official documents and input personal information, means for recognizing the user's facial expressions and voice in real time and adjusting the interface according to their emotions, means for encrypting and transmitting the input personal information, means for receiving and decrypting the encrypted data, a generative artificial intelligence means for verifying the integrity of the received data and automatically generating the document by inserting the data into an official document template, means for generating and saving the generated official document in PDF format, and means for sending an access URL for the generated document to the user's terminal. This makes it possible for the user to easily and securely generate official documents with an interface optimized according to their emotions.

[1894] "Selection of official documents by the user" refers to the act of a user selecting the necessary official documents using a designated interface.

[1895] "An interface for entering personal information" refers to an interface provided to a user for entering personal information such as their name, address, and date of birth.

[1896] "Means for recognizing user facial expressions and voice in real time" refers to methods for analyzing a user's facial expressions and voice to recognize their emotions in real time.

[1897] "Means for adjusting the interface" refers to means for automatically adjusting the interface to improve the user experience based on the results of user emotion recognition.

[1898] "Means for encrypting and transmitting entered personal information" refers to a method for encrypting personal information entered by a user and securely transmitting it to the server.

[1899] "Means for receiving and decrypting encrypted data" refers to means for receiving encrypted data and decrypting it.

[1900] "Means for verifying the integrity of received data" refers to means for verifying the accuracy and completeness of received data.

[1901] A "template for official documents" is a format used to generate official documents.

[1902] "Generative artificial intelligence means" refers to artificial intelligence means for automatically generating official documents based on templates.

[1903] "Means for generating and saving public documents in PDF format" refers to means for generating and saving public documents in PDF file format.

[1904] "Means for sending the access URL of the generated document to the user's terminal" refers to means for sending the access URL of the generated PDF file to the user's terminal.

[1905] This invention relates to a system for easily and securely generating official documents required by users in electronic payment services. The system includes means for user data input, emotion recognition, data encryption, automatic document generation, saving in PDF format, and transmission via an access point.

[1906] System Overview

[1907] This system consists of the following main components:

[1908] User terminal

[1909] server

[1910] Generative artificial intelligence

[1911] Emotional Engine

[1912] User terminal

[1913] The user terminal serves as an interface, providing screens for selecting official documents and entering personal information. It also uses a camera and microphone to capture the user's facial expressions and voice, providing this data to the emotion engine. The emotion engine then analyzes this data to recognize emotions.

[1914] Emotional Engine

[1915] The emotion engine analyzes the user's facial expressions and voice to recognize emotions in real time. For example, if it determines that the user is stressed, the device will make adjustments such as simplifying the interface.

[1916] Data encryption and transmission

[1917] Personal information entered by users is encrypted on the device and securely transmitted to the server. The latest encryption technology (e.g., AES) is used to maintain a high level of security.

[1918] Server Processing

[1919] The server reliably decrypts the received encrypted data and then verifies its integrity. Afterward, it passes the data to a generative artificial intelligence system, which inserts the data into a public document template to automatically generate the document.

[1920] Generation and storage of official documents

[1921] Generative artificial intelligence generates official documents in PDF format based on given data. The generated PDFs are stored on a server, and an access URL is generated. This URL is sent to the user's device, allowing them to easily access and download the documents.

[1922] Specific example: Generating a resident registration certificate

[1923] Follow these steps to generate your resident registration certificate.

[1924] 1. The user selects the required official documents when registering for the electronic payment service.

[1925] 2. The device displays a screen for entering personal information, and an emotion engine monitors the user's facial expressions and voice.

[1926] 3. The user enters personal information such as their name, address, and date of birth.

[1927] 4. The emotion engine analyzes the user's emotions and adjusts the interface as needed.

[1928] 5. The entered data is encrypted and sent to the server.

[1929] 6. The server decrypts the data and verifies its integrity.

[1930] 7. The data whose consistency has been verified is passed to the generative artificial intelligence and inserted into the resident registration template.

[1931] 8. The generative artificial intelligence generates a resident registration form in PDF format and saves it to the server.

[1932] 9. The server sends the access URL for the generated PDF file to the terminal.

[1933] 10. The user clicks the URL displayed on their device to download the resident registration certificate.

[1934] Hardware and software to use

[1935] The user terminal is equipped with a high-performance camera and microphone, and software for emotion recognition (e.g., OpenCV, EmotionRecognizer). The server has software for data encryption and decryption (e.g., AES library), and the generative artificial intelligence incorporates an AI model for generating official documents (e.g., DocumentGenerator).

[1936] Example of a prompt

[1937] "Please generate prompts for the generative AI model in the following format:

[1938] 1. Name: [User input]

[1939] 2. Address: [User input]

[1940] 3. Date of birth: [User input]

[1941] Please generate a resident registration certificate as an official document.

[1942] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1943] Step 1:

[1944] The user selects the required official documents when registering for the electronic payment service. The terminal displays a screen for selecting the official documents. It receives the user's selection information as input and saves the type of selected official document to the terminal's memory as output.

[1945] Step 2:

[1946] The device displays a screen for entering personal information. Simultaneously, it uses its camera and microphone to capture the user's facial expressions and voice, and sends them to the emotion engine. It receives video and audio data from the camera and microphone as input, and obtains real-time emotion recognition results as output.

[1947] Step 3:

[1948] The emotion engine analyzes the user's facial expressions and voice to recognize their emotions. It receives video and audio data as input, performs image and audio analysis as data processing, and provides feedback to the device regarding the user's emotional state (e.g., stress, relaxation) as output.

[1949] Step 4:

[1950] The device adjusts the interface according to the user's emotions based on feedback from the emotion engine. Specifically, if the user's emotion is recognized as stress, the interface is simplified and an encouraging message is displayed. It receives the emotion recognition result as input and displays the adjusted interface or message as output.

[1951] Step 5:

[1952] The user enters personal information such as their name, address, and date of birth. The terminal receives the user's input data, structures it, and stores it in the terminal's memory. It receives personal information such as name, address, and date of birth as input and generates structured data (e.g., in JSON format) as output.

[1953] Step 6:

[1954] The device encrypts structured personal information and sends it to the server. It uses the latest encryption technology (e.g., AES). It receives structured data as input, performs encryption as data processing, and sends the encrypted data to the server as output.

[1955] Step 7:

[1956] The server receives encrypted data and decrypts it. It receives encrypted data as input, performs decryption as data processing, and obtains decrypted data as output.

[1957] Step 8:

[1958] The server verifies the integrity of the decrypted data. It receives the decrypted data as input, performs an integrity check (e.g., comparing hash values) as a data operation, and obtains the integrity verification result as output. If the integrity is confirmed, it proceeds to the next step.

[1959] Step 9:

[1960] The server passes the data, whose integrity has been verified, to a generative artificial intelligence (AI) system, which then inserts the data into a public document template to automatically generate the document. It receives decrypted data as input, performs data processing including data insertion into the template and document generation, and outputs a generated PDF document.

[1961] Step 10:

[1962] The server saves the generated public documents in PDF format. It receives the generated PDF documents as input and saves them to server storage as output.

[1963] Step 11:

[1964] The server generates an access URL for the generated PDF file and sends it to the user's terminal. It receives the PDF file's save path as input, processes the data to generate the access URL, and sends the generated access URL to the user's terminal as output.

[1965] Step 12:

[1966] The user clicks the URL displayed on their device to download the generated official document. The system receives the access URL as input, performs a data calculation to download the PDF file, and obtains the downloaded PDF file as output.

[1967] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1968] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1969] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1970] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1971] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1972] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1973] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1974] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1975] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1976] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1977] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1978] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1979] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1980] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1981] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1982] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1983] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1984] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1985] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1986] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1987] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1988] The following is further disclosed regarding the embodiments described above.

[1989] (Claim 1)

[1990] An interface for users to select official documents and enter personal information,

[1991] A means of encrypting and transmitting the entered personal information,

[1992] A means for receiving and decrypting encrypted data,

[1993] A generative artificial intelligence system that verifies the integrity of received data, inserts the data into a template for official documents, and automatically generates documents.

[1994] A method for generating and saving official documents in PDF format,

[1995] A system including means for sending an access URL for a generated document to a user's terminal.

[1996] (Claim 2)

[1997] The system according to claim 1, further comprising a user authentication means, which authenticates a user by verifying authentication information.

[1998] (Claim 3)

[1999] The system according to claim 1, further comprising a preview means for confirming the content of the entered data, and displaying the preview to the user.

[2000] "Example 1"

[2001] (Claim 1)

[2002] An interface for users to select official documents and enter personal information,

[2003] A method for structuring the entered personal information in JSON format, encrypting it, and transmitting it,

[2004] A means for receiving and decrypting encrypted data,

[2005] A means to verify the integrity of received data and detect missing information or format errors,

[2006] A generative artificial intelligence method that automatically generates documents by inserting received data into official document templates,

[2007] A method for generating and saving official documents in PDF format,

[2008] A system including means for generating an access URL for a generated document and sending it to the user's terminal.

[2009] (Claim 2)

[2010] The system according to claim 1, further comprising a user authentication means, which authenticates a user by verifying authentication information.

[2011] (Claim 3)

[2012] The system according to claim 1, further comprising a preview means for confirming the content of the entered data, and displaying the preview to the user.

[2013] "Application Example 1"

[2014] (Claim 1)

[2015] An interface for users to select official documents and enter personal information,

[2016] A means of encrypting and transmitting the entered personal information,

[2017] A means for receiving and decrypting encrypted data,

[2018] A generative artificial intelligence system that verifies the integrity of received data, inserts the data into logistics-related document templates, and automatically generates documents.

[2019] A method for generating and saving the generated logistics-related documents in PDF format,

[2020] A means of sending the access URL for the generated document to the user's terminal,

[2021] A system including means of access for downloading and printing generated documents.

[2022] (Claim 2)

[2023] The system according to claim 1, further comprising a user authentication means, which authenticates a user by verifying authentication information.

[2024] (Claim 3)

[2025] The system according to claim 1, further comprising a preview means for confirming the content of the entered data, and displaying the preview to the user.

[2026] "Example 2 of combining an emotion engine"

[2027] (Claim 1)

[2028] A screen for users to select official documents and to enter personal information,

[2029] A means of encrypting and transmitting the entered personal information,

[2030] A means for receiving and decrypting encrypted data,

[2031] A generation AI method that verifies the integrity of received data and automatically generates documents by inserting the data into a public document template,

[2032] A means of generating and saving public documents in PDF format,

[2033] A means for sending access information for the generated document to the user terminal,

[2034] A means for recognizing user emotions and adjusting the interface,

[2035] A system including means for adjusting the user terminal's operation screen based on feedback from emotion recognition means.

[2036] (Claim 2)

[2037] The system according to claim 1, further comprising a user authentication means, which authenticates a user by verifying authentication information.

[2038] (Claim 3)

[2039] The system according to claim 1, further comprising a preview means for confirming the content of the entered data, and displaying the preview to the user.

[2040] "Application example 2 when combining with an emotional engine"

[2041] (Claim 1)

[2042] An interface for users to select official documents and enter personal information,

[2043] A means of recognizing the user's facial expressions and voice in real time and adjusting the interface according to their emotions,

[2044] A means of encrypting and transmitting the entered personal information,

[2045] A means for receiving and decrypting encrypted data,

[2046] A generative artificial intelligence system that verifies the integrity of received data, inserts the data into a template for official documents, and automatically generates documents.

[2047] A method for generating and saving official documents in PDF format,

[2048] A system including means for sending an access URL for a generated document to a user's terminal.

[2049] (Claim 2)

[2050] The system according to claim 1, further comprising a user authentication means, which authenticates a user by verifying authentication information.

[2051] (Claim 3)

[2052] The system according to claim 1, further comprising a preview means for confirming the content of the entered data, and displaying the preview to the user. [Explanation of Symbols]

[2053] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. An interface for users to select official documents and enter personal information, A means of encrypting and transmitting the entered personal information, A means for receiving and decrypting encrypted data, A generative artificial intelligence system that verifies the integrity of received data, inserts the data into a template for official documents, and automatically generates documents. A method for generating and saving official documents in PDF format, A system including means for sending an access URL for a generated document to a user's terminal.

2. The system according to claim 1, further comprising a user authentication means, which authenticates a user by verifying authentication information.

3. The system according to claim 1, further comprising a preview means for confirming the content of the entered data, and displaying the preview to the user.

Images