System

Abstract

A system is provided.SOLUTION: The system includes a means for receiving information inputted by a user, a means for transmitting the information to a server, a means for acquiring additional information from a database based on the information received by the server, a means for automatically generating an application form based on the acquired information, and a means for providing the generated application form to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The traditional process of creating official applications involves a lot of manual work, which takes time and effort for users. Furthermore, manual input is prone to errors and formatting mistakes, which often prevent applications from progressing smoothly. There is a need for a system that can solve these problems and allow users to easily create application forms. [Means for solving the problem]

[0005] The present invention is a system including means for receiving information entered by a user, means for transmitting the information to a server, means for the server to acquire additional information from a database based on the information received, means for automatically generating an application form based on the acquired information, and means for providing the generated application form to the user. With the present invention, the user simply inputs the necessary information, and the application form is automatically generated, thereby reducing the effort required for manual work and the risk of input errors. Furthermore, the generated application form is provided in PDF format or the like, allowing the user to easily download and use it.

[0006] "User" means an individual or organization that uses this system to create an application form.

[0007] "Information to be entered" refers to data provided by the user to create the application form, and includes personal information such as name, date of birth, address, and contact details.

[0008] "Means for receiving" refers to the devices and processes used to input information entered by the user into the system.

[0009] A "server" is a computer system that receives information sent by a user, retrieves necessary information from a database, and generates an application form.

[0010] The "transmission means" refers to the protocol or communication means by which the terminal sends the information input by the user to the server.

[0011] A "database" is a system that stores and manages information and allows a server to search and extract data as needed.

[0012] "Additional Information" refers to supplemental data retrieved from a database based on information entered by the user, including past application history and other relevant information.

[0013] "Means for automatic generation" refers to the process or algorithm that creates an application form in a specified format based on the information obtained by the server.

[0014] "Application Form" means a document required for carrying out a specific official procedure, and is automatically generated by this system.

[0015] The "means of providing" refers to the functions and mechanisms that allow the generated application form to be downloaded in a format that the user can use (e.g., PDF).

[0016] "PDF format" is an abbreviation for Portable Document Format, a file format for electronically storing and distributing generated application forms. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9]1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[0039] This system is composed of the following main components: user terminals, a server, and a database.

[0040] User

[0041] First, the user accesses a dedicated application or website using a device. The user is then presented with a form to enter the necessary information (name, date of birth, address, driver's license number, etc.). When the user enters the necessary information into the form and presses the send button, the device sends the input data to the server.

[0042] Terminal

[0043] The terminal receives the information entered by the user and converts it into an appropriate data format, such as JSON or XML, and then transmits the converted data securely to the server over the network using a protocol such as HTTPS.

[0044] server

[0045] When the server receives the input data, it first validates the data, checking whether the input data is in the correct format and whether any required fields are missing. If validation is successful, the server accesses a database to retrieve additional information related to the information provided by the user. For example, it may extract past application history and other relevant data. Using this information, the server uses a template engine to automatically generate an application form.

[0046] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[0047] User (after provision)

[0048] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then sends the application form to the designated submission address or submits it online.

[0049] Specific examples

[0050] For example, consider the case of applying for driver's license renewal. A user accesses a website and enters the required information (such as name, date of birth, and current license number), and their device sends that information to a server. The server validates the information and retrieves relevant information from a database (such as past violation history). Using this information, the server automatically generates a license renewal application form and provides it to the user in PDF format. The user then downloads and prints the application, signs it, fills in the necessary fields, and submits it.

[0051] The present invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[0052] The processing flow will be explained below.

[0053] Step 1:

[0054] The user accesses a dedicated application or website and is presented with a form to fill out.

[0055] Step 2:

[0056] The user enters the required information such as name, date of birth, address, driver's license number, etc. into the displayed form and clicks the submit button.

[0057] Step 3:

[0058] The device receives information entered by the user and converts it into JSON or XML format data.

[0059] Step 4:

[0060] The terminal sends the converted data to the server using the HTTPS protocol.

[0061] Step 5:

[0062] The server receives the HTTPS request and parses the data sent.

[0063] Step 6:

[0064] Validate the data parsed by the server, ensuring all required fields are filled in and the data is formatted correctly.

[0065] Step 7:

[0066] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[0067] Step 8:

[0068] The server combines the additional information acquired with the information provided by the user and automatically generates an application form using a template engine.

[0069] Step 9:

[0070] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[0071] Step 10:

[0072] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[0073] Step 11:

[0074] The terminal receives the response from the server and displays the download link on the user interface.

[0075] Step 12:

[0076] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[0077] Step 13:

[0078] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[0079] Step 14:

[0080] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[0081] Example 1

[0082] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0083] The traditional process of creating official application forms is time-consuming and laborious, with a high risk of reapplication due to input errors or incomplete data. Furthermore, creating application forms requires a lot of manual work, hindering the speed of application procedures. Therefore, there is a need for a system that streamlines the creation of official application forms and reduces the burden on users.

[0084] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0085] In this invention, the server includes means for receiving information entered by a user, means for the terminal to convert the information into an appropriate data format and transmit it to the server, means for the server to retrieve additional information from a database based on the received information, means for automatically generating an application form using a template engine based on the retrieved information, and means for saving the generated application form in PDF format and generating a download link for it to provide to the user. This makes it possible to automate the time-consuming process of creating application forms, reducing the burden on users and enabling quick and accurate application procedures.

[0086] "User" means an individual or legal entity that utilizes the System to enter information and complete official applications.

[0087] A "terminal" is a device (e.g., computer, smartphone, tablet) that a user uses to enter information.

[0088] A "server" is a computer system that receives data sent from a terminal, processes it, and automatically generates an application form.

[0089] The "means for receiving information" is an interface for acquiring data such as name, date of birth, address, and driver's license number provided by the user.

[0090] "Means of converting into data format" refers to the process of converting information obtained from the user into an appropriate format such as JSON or XML.

[0091] The "means of transmission" is a protocol for transmitting the converted data to the server in a secure manner, such as the HTTPS protocol.

[0092] "Database" refers to a data storage system used by the server to manage past application history and related information.

[0093] The "means for obtaining additional information" is the process by which the server accesses the database to search for and obtain the required information.

[0094] A "template engine" is a software component that embeds acquired data into an application form template.

[0095] The "means for automatically generating an application form" is a process for creating an application form by using a template engine to fill in the necessary data.

[0096] "Saving in PDF format" refers to the process of saving the automatically generated application form to a file in Portable Document Format (PDF).

[0097] The "means for generating a download link" is the process of creating an access link to the generated PDF file and providing it to the user.

[0098] The present invention relates to a system that automatically generates official application forms by linking information entered by a user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[0099] This system includes the following main components: a user terminal, a server, and a database. Specifically, they are as follows:

[0100] User

[0101] A user accesses a dedicated application or website using a device. A web form is displayed, and the user enters the necessary information, such as name, date of birth, address, driver's license number, etc. Once the information is entered, the user presses a submit button, and the input data is sent to the server via the device.

[0102] Terminal

[0103] The device uses JavaScript or other client-side scripts to convert user-entered information into JSON or XML format, after which the data is securely transmitted to the server using the HTTPS protocol.

[0104] server

[0105] The server receives the data using Python's Flask framework or a similar web framework. First, it validates the data, checking that the data format is correct and that required fields are not missing. If the error check is successful, the server accesses the database and retrieves relevant information from an SQL database such as MySQL (registered trademark) or PostgreSQL. Based on the retrieved information, the server uses a template engine such as Jinja2 to automatically generate an application form. The generated application form is converted to PDF format using a library such as WeasyPrint or wkhtmltopdf and saved. A download link for the PDF file is generated and sent back to the terminal.

[0106] User (after provision)

[0107] The user accesses the link returned from the server via their device and downloads the generated application form. After downloading, the user opens the file, checks the contents, signs and stamps the application as required, and finally sends the application to the designated submission address or submits it online.

[0108] Specific examples

[0109] Consider the case of applying for a driver's license renewal. A user accesses a website and enters the required information (name, date of birth, current license number, etc.). The input data is converted to JSON format by the terminal and sent to the server via the HTTPS protocol. The server verifies the validity of the data and retrieves related information such as past violation history from a database. Using a template engine, a license renewal application form is automatically generated and provided to the user in PDF format. The user downloads the application form, prints it, signs it, fills in the necessary fields, and submits it.

[0110] An example prompt sentence for a specific implementation of this system is as follows:

[0111] Prompt: I am developing a program to automatically generate driver's license renewal application forms. The user enters the necessary information, such as name, date of birth, address, and driver's license number, and the server retrieves past application history data and generates the application form based on that information. This requires integration with a template engine and a database.

[0112] This invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[0113] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0114] Step 1:

[0115] The user accesses a dedicated application or website and enters the necessary information into a form, such as their name, date of birth, address, driver's license number, etc. After entering the information, they press the send button, and the form data is sent to the device.

[0116] Input: Information entered by the user (name, date of birth, address, driver's license number).

[0117] Data processing: None.

[0118] Output: The form data is sent to the terminal.

[0119] What happens: A user fills in the fields of a web form and clicks the submit button.

[0120] Step 2:

[0121] The device retrieves the information received from the user and converts it into JSON or XML format using a client-side script such as JavaScript.

[0122] Input: The data in the form.

[0123] Data processing: Convert the data obtained from the form into JSON or XML format.

[0124] Output: The transformed JSON or XML data.

[0125] Specific behavior: JavaScript code retrieves the form data and converts it to JSON format using a method such as JSON.stringify().

[0126] Step 3:

[0127] The terminal transmits the converted data to the server using the HTTPS protocol.

[0128] Input: The transformed JSON or XML data.

[0129] Data processing: None.

[0130] Output: The HTTP request sent to the server.

[0131] Specific behavior: Creates and sends an HTTP POST request containing the converted data using the XMLHttpRequest or Fetch API.

[0132] Step 4:

[0133] The server receives the data sent from the device, analyzes it using Python's Flask framework, and verifies its validity by checking whether the data format is correct and whether all required fields are filled in.

[0134] Input: HTTP request data (JSON or XML) arriving at the server.

[0135] Data processing: Validating data format, checking required fields.

[0136] Output: Validation result (success or error message).

[0137] What happens: The Flask application receives the request and uses a JSON parser to check the data format and ensure required fields are present.

[0138] Step 5:

[0139] If the server successfully validates the data, it accesses the database to obtain additional information about the user, such as past application history, from a database system such as MySQL or PostgreSQL.

[0140] Input: Validated user data.

[0141] Data manipulation: Performing database queries to find and retrieve additional information.

[0142] Output: Additional information (such as past application history).

[0143] Specific operation: Executes an SQL query (e.g. SELECT FROM user_history WHERE user_id = ?) and retrieves the results.

[0144] Step 6:

[0145] The additional information obtained by the server is inserted into the application form template using a template engine (e.g. Jinja2) and the application form is automatically generated.

[0146] Input: Verified user data, additional information retrieved from database.

[0147] Data processing: Use a template engine to embed data into the application format.

[0148] Output: The generated application form (in HTML format).

[0149] What it does: Renders data into Jinja2 templates and intelligently composes the generated HTML.

[0150] Step 7:

[0151] The server converts the generated application form into PDF format and saves it using libraries such as WeasyPrint and wkhtmltopdf.

[0152] Input: Generated application form (HTML format).

[0153] Data processing: Convert HTML data into PDF format and save it on the server.

[0154] Output: PDF file.

[0155] What it does: Uses the WeasyPrint library to generate a PDF from an HTML template and saves it to the file system.

[0156] Step 8:

[0157] The server generates a download link for the PDF file and returns the link to the device.

[0158] Input: PDF file.

[0159] Data processing: Download link generation.

[0160] Output: Download link.

[0161] Specific operation: The server generates a link and returns JSON data containing link information to the device as an HTTP response.

[0162] Step 9:

[0163] The user accesses the download link provided by the server through their device and downloads the generated application form. After downloading, the user opens the file and checks its contents.

[0164] Input: Download link.

[0165] Data processing: None.

[0166] Output: Download PDF file.

[0167] What happens: The user clicks on the download link and the browser automatically starts downloading the PDF file.

[0168] Step 10:

[0169] The user signs and stamps the generated application form as required and sends it to the designated submission destination, or submits it online.

[0170] Input: The downloaded PDF file.

[0171] Data processing: None.

[0172] Output: Signed and stamped application form.

[0173] Specific behavior: The user prints the PDF file, signs or stamps it as required, and then submits it by mail or online.

[0174] (Application example 1)

[0175] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0176] Conventional public application systems require users to manually enter information and scan documents individually, which is inefficient and prone to errors. They also have environment-dependent issues, making it difficult to instantly create applications on the go. This makes it difficult to respond to unexpected application processing situations.

[0177] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0178] In this invention, the server includes a means for receiving information input by voice commands or gestures, a means for scanning documents using a built-in camera and performing optical character recognition, and a means for providing the generated application form to the user, thereby enabling the user to automatically generate application forms in real time using the smart glasses and complete official procedures quickly and efficiently.

[0179] "Voice instruction" refers to a method in which a user gives instructions to a device using voice.

[0180] A "gesture" is a method of giving instructions to a device using hand and finger movements.

[0181] An "integrated camera" is a camera built into a device that has the ability to capture images and videos.

[0182] "Optical character recognition" is a technology that automatically identifies characters from images or scanned documents and converts them into text data.

[0183] An "application form" is an official document required for an official procedure, containing specific information and having a prescribed format.

[0184] "Server" means a computer system that processes information received from users and stores, manages, and provides data.

[0185] A "digital signature" is a signature made by electronic means and is used to certify the legitimacy and authenticity of a document.

[0186] The system of the present invention allows users to input necessary information using voice commands or gestures, scan documents with a built-in camera, and automatically generate and provide application forms on a server. The system is composed of smart glasses with voice command and gesture recognition functions, a built-in camera, OCR (optical character recognition), a server, and software with digital signature functionality.

[0187] First, the user puts on the smart glasses and inputs the necessary information into the system using voice commands and gestures. The smart glasses are equipped with a built-in camera, which is used to scan documents. The scanned image is then converted into text data using OCR technology. Pytesseract can be used for this OCR process.

[0188] The server receives the input data provided by the user and the data extracted by OCR. It converts this data into an appropriate format and retrieves additional information from a database, such as past application history and other relevant information. This process uses a template engine to automatically generate the application form.

[0189] The generated application form is saved in PDF format and a link is provided to the user, who can view the link on the smart glasses display and digitally sign it if necessary. The digital signature is encrypted to ensure security.

[0190] As a concrete example, consider a case where a user applies for a visa while on the go. The user uses smart glasses to enter the necessary information using voice commands and scans their passport and other necessary documents with the built-in camera. The server automatically generates an application form in real time and provides the user with a link in PDF format. The user can then review the generated application form on the smart glasses' display and digitally sign it to instantly complete the application process.

[0191] Example prompt sentence:

[0192] Create a system that automatically generates official application forms by having the user enter the necessary information. The user uses smart glasses to input information using voice commands and gestures, and scans the necessary documents with the built-in camera. This information is sent to a server that automatically generates the application form and provides it to the user in PDF format.

[0193] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0194] Step 1:

[0195] The user puts on the smart glasses and inputs the necessary information using voice commands or gestures. The information entered by the user (such as name, date of birth, and address) is then stored in the smart glasses' internal system.

[0196] Input: User's voice commands or gesture operations

[0197] Output: Required information entered by the user

[0198] How it works: The smart glasses' voice and gesture recognition software analyzes the user's instructions and generates appropriate input data.

[0199] Step 2:

[0200] Users scan the required documents using the built-in camera, which captures an image of the document and converts it into text data using OCR technology.

[0201] Input: Image of document taken with built-in camera

[0202] Output: Text data converted by OCR

[0203] Specific operation: A document is photographed using the built-in camera on the smart glasses, and the image is subjected to OCR processing using pytesseract to extract text data.

[0204] Step 3:

[0205] The smart glasses convert the user's input data and scanned text data into JSON format and send it to the server.

[0206] Input: User input data, text data obtained by OCR processing

[0207] Output: Data converted to JSON format

[0208] How it works: The smart glasses' internal software converts the input data into JSON format and sends it to the server using the HTTPS protocol.

[0209] Step 4:

[0210] The server receives the data sent by the user, verifies its format, and if the data format is not correct, generates an error message and returns it to the terminal.

[0211] Input: JSON format data sent by the user

[0212] Output: Validation result (success or error message)

[0213] Specific behavior: The server verifies whether the received data is formatted correctly and checks whether required fields exist. If the required conditions are not met, it generates and returns an error message.

[0214] Step 5:

[0215] The server accesses a database with the appropriately formatted data to retrieve additional information, such as past filing history and relevant legal information.

[0216] Input: Properly validated user data

[0217] Output: Additional information retrieved from the database

[0218] Specific Actions: The server performs a database query to extract any additional information required.

[0219] Step 6:

[0220] The server automatically generates an application form using a template engine based on the acquired information, and the generated application form is saved in PDF format.

[0221] Input: User data and additional information from the database

[0222] Output: Automatically generated PDF application form

[0223] Specific operation: The server's template engine generates an application form based on the data and saves it in PDF format using the PDF library.

[0224] Step 7:

[0225] The server sends a download link for the generated application form back to the user's device, where the user can view the link on the smart glasses display.

[0226] Input: Application form saved in PDF format

[0227] Output: Download link

[0228] Specific operation: The server saves the generated PDF file and generates a download link to send to the user's smart glasses.

[0229] Step 8:

[0230] The user checks the download link through the smart glasses, downloads, views, and confirms the application form, and if necessary, digitally signs it.

[0231] Input: Download link

[0232] Output: Application form reviewed and digitally signed by the user

[0233] Specific operation: The user operates the smart glasses display to download and review the generated PDF application form and digitally sign it.

[0234] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0235] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user as required. Furthermore, the present invention incorporates an emotion engine that recognizes the user's emotions, and personalizes the contents and procedures of the application form according to the user's emotional state.

[0236] This system consists of the following main components: the user's terminal, a server, a database, and an emotion engine.

[0237] User

[0238] The user uses the device to access a dedicated application or website, which displays a form for the user to enter necessary information. The device then collects data via the camera and microphone to recognize the user's emotions. When the user enters the necessary information in the form and clicks the submit button, the device sends the input data and emotional data to the server.

[0239] Terminal

[0240] The device receives information entered by the user and converts it into an appropriate data format, such as JSON or XML. The converted data also includes the user's emotional data recognized by the emotion engine. The emotional data is used to identify the user's emotional state from their facial expressions and tone of voice using image processing and voice analysis technology. The converted data is then securely transmitted to the server via the network using protocols such as HTTPS.

[0241] server

[0242] When the server receives the input data, it first verifies the validity of the data. It checks whether the input data is in the correct format and whether any required fields are missing. If the validation is successful, the server accesses the database to obtain additional relevant information based on the information provided by the user. Taking into account the obtained information as well as the user's emotional data, the server automatically generates an application form. Based on the emotional data, the server personalizes the content and procedures of the application form. For example, if the user is in a hurry, it may simplify the instructions for the procedure.

[0243] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[0244] User (after provision)

[0245] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then submits the application form to the designated location or submits it online.

[0246] Specific examples

[0247] For example, consider the case of applying to renew a driver's license. When a user accesses a website and enters the necessary information (such as name, date of birth, and current license number), the emotion engine detects the user's level of stress from their facial expressions and voice. The device then sends this information to a server. The server then verifies the information entered and retrieves relevant information from a database (such as past violation history). Based on the emotion data, a personalized application form is automatically generated, with shortened instructions and other modifications to ensure the process goes smoothly. The generated application form is provided to the user in PDF format, who then downloads it, prints it, and submits it.

[0248] The present invention eliminates the manual work of filling out application forms, providing accurate and speedy application procedures. In addition, by utilizing an emotion engine, it reduces the psychological burden on users and provides a more user-friendly experience.

[0249] The processing flow will be explained below.

[0250] Step 1:

[0251] The user accesses a dedicated application or website and is presented with a form to fill out.

[0252] Step 2:

[0253] The device uses a camera and microphone to collect facial and voice data from the user, allowing it to recognize the user's emotional state in real time.

[0254] Step 3:

[0255] The user enters the required information such as name, date of birth, address, and driver's license number into the form and clicks the submit button.

[0256] Step 4:

[0257] The device receives information input by the user and converts the received information and emotion data into JSON or XML format data.

[0258] Step 5:

[0259] The terminal sends the converted data to the server using the HTTPS protocol.

[0260] Step 6:

[0261] The server receives the HTTPS request and parses the data sent.

[0262] Step 7:

[0263] Validate the data parsed by the server, ensuring that the input data is in the correct format and that all required fields are filled in.

[0264] Step 8:

[0265] The server analyzes the emotional data and determines the user's emotional state (e.g., stress, impatience, anger, etc.).

[0266] Step 9:

[0267] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[0268] Step 10:

[0269] The server combines the additional information acquired with the information provided by the user and uses a template engine to automatically generate an application form. The content of the application form and instructions are personalized based on emotion data.

[0270] Step 11:

[0271] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[0272] Step 12:

[0273] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[0274] Step 13:

[0275] The terminal receives the response from the server and displays the download link on the user interface.

[0276] Step 14:

[0277] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[0278] Step 15:

[0279] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[0280] Step 16:

[0281] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[0282] In this way, the present invention provides a process for automatically generating application forms that takes into account the user's emotions. Because the instructions and application form content are personalized based on the user's emotion data, the user can complete the application process more comfortably and without stress.

[0283] Example 2

[0284] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0285] Conventional systems require users to manually create application forms, which takes a lot of time and effort. Furthermore, they are unable to consider the user's emotional state while creating the application, resulting in a poor user experience. Furthermore, if the information entered by the user is incorrectly formatted, the application form based on that information may be inaccurate. To address these issues, a system is needed that can appropriately process the user's input information and emotional data and automatically generate personalized application forms.

[0286] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0287] In this invention, the server includes means for converting information entered by a user into an appropriate data format, means for collecting user emotion data, and means for transmitting the information and emotion data and retrieving additional information from a database. This makes it possible to personalize the contents of the application form based on the user emotion data and automatically generate application forms efficiently and accurately.

[0288] The "means for receiving information input by a user" is an interface for collecting information input by a user via a terminal.

[0289] "Means for converting into an appropriate data format" refers to the process or tool used to convert user-entered information into a data format (e.g., JSON or XML) that can be processed and transmitted by the system.

[0290] "Means for collecting user emotional data" refers to technology for identifying and collecting the user's emotional state from facial expressions and voice using devices such as cameras and microphones.

[0291] "Means for transmitting information and emotional data to the server" refers to a communication protocol or network for securely transmitting the user's input information and emotional data from the terminal to the server.

[0292] The "means by which the server obtains additional information from the database based on the information received" refers to a query or index function that allows the server to search and obtain the necessary data from the database based on the information input by the user.

[0293] The "means for automatically generating an application form based on acquired information and emotional data" refers to an algorithm that automatically creates an application form in accordance with a specific format, taking into account the information acquired by the server from the database and the user's emotional data.

[0294] "Means for providing the generated application form to the user" refers to a function that allows the generated application form to be saved in a PDF or other digital format and provided as a link or file that the user can download or access.

[0295] "Means for validating the format of information received by the server" means the process or tools by which the server checks the format and content of data sent by users to detect inaccurate or incomplete data.

[0296] "Means for generating an error message if the conditions are not met based on the validation results" is a function for creating and sending an error message to the user if the data format or content does not meet the server's standards.

[0297] "Means for personalizing the contents of application forms and procedures based on the user's emotional data" refers to technology that appropriately adjusts the contents of application forms and explanations of procedures according to the user's emotional state, providing them in a way that is easy for the user to understand and that reduces stress.

[0298] The "means for saving the generated application form in PDF format" is a function for saving the generated application form as a PDF file so that the user can easily access and download it.

[0299] This invention relates to a system that automatically generates official application forms by linking information entered by a user. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions, personalizing the application form content and procedures according to the user's emotional state. This system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[0300] User terminal operation

[0301] A user accesses a dedicated application or website using a device such as a PC or smartphone. They enter necessary information such as their name, date of birth, and address into a form displayed on the device. The device also uses a camera and microphone to collect the user's facial expressions and voice in real time, which are recognized as emotional data. When the user enters the necessary information into the form and clicks the submit button, the device sends the input data and emotional data to a server.

[0302] As a concrete example, consider the case where a user renews their driver's license. The user accesses a website and enters the necessary information, such as their name, date of birth, and license number, into a form. The device's camera then analyzes the user's facial expressions and uses an emotion engine to detect whether the user is anxious. This information is then sent to the server.

[0303] Device Role

[0304] After receiving the information entered by the user, the device converts it into JSON or XML format. This converted data also includes the user's emotional data analyzed by the emotion engine. Emotional data is identified from the user's facial expressions and tone of voice using image processing and voice analysis technology. The device then securely transmits the converted data to the server using the HTTPS protocol.

[0305] Server Operation

[0306] The server receives the data sent from the device. First, it validates the data, ensuring that the input data is in the correct format and that required fields are not missing. Next, the server accesses a database to retrieve additional relevant information based on the information provided by the user. In addition, the server takes into account emotional data and automatically generates an application form. For example, if the user is in a hurry, it can simplify the instructions for the procedure and provide other personalized information.

[0307] In a specific example, when applying for a driver's license renewal, the server retrieves the user's past violation history from the database and creates an application form by shortening the instructions based on the user's emotional state. The created application form is saved in PDF format and a download link is generated. This link is sent back to the device so the user can access it.

[0308] User operations (after provision)

[0309] The user accesses the download link returned from the server via their device and downloads the generated application form. They then check the contents of the downloaded application form and sign or stamp it as necessary. Finally, they submit the application form to the designated location or complete the submission online.

[0310] Prompt Sentence Examples

[0311] An example of a prompt to be input to the generative AI model is as follows:

[0312] "Please automatically generate the application form I need when I renew my driver's license. I have listed my name, date of birth, and current license number below. Please shorten the instructions to reduce user stress. Please also retrieve past violation history from the database and reflect it."

[0313] This invention eliminates the manual work of filling out application forms and provides accurate and speedy application procedures. Furthermore, by utilizing an emotion engine, it aims to reduce the psychological burden on users and provide a more user-friendly experience.

[0314] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0315] Step 1:

[0316] The user enters information

[0317] The user accesses a dedicated application or website using their device and enters the necessary information such as name, date of birth, and address. Specifically, they enter information such as "Taro Tanaka," "January 1, 1980," and "123-456 Shibuya-ku, Tokyo" into the form. Once the information is complete, they click the submit button.

[0318] Input data (name, date of birth, address) is collected and this data is sent as output to the next processing step.

[0319] Step 2:

[0320] Collect user sentiment data

[0321] The device uses a camera and microphone to collect the user's facial expressions and voice in real time. Specifically, the camera captures the user's facial expressions and the microphone records the tone of voice. The emotion engine analyzes this data and identifies the user's emotional state. For example, if the user is anxious, emotion data is generated.

[0322] The input is camera footage and microphone audio data, and the output is emotion data (e.g., impatience).

[0323] Step 3:

[0324] Converting data into the appropriate format

[0325] The device receives user input and emotion data and converts it into JSON or XML format, including name, date of birth, address, and emotion data.

[0326] It receives input data (user input, emotion data) and converts it into the following output format:

[0327] json

[0328] {

[0329] "name": "Taro Tanaka",

[0330] "birth_date": "1980-01-01",

[0331] "address": "123-456, Shibuya-ku, Tokyo",

[0332] "emotion": "stressed"

[0333] }

[0334] Step 4:

[0335] Sending data to the server

[0336] The device sends the converted data to the server using the HTTPS protocol, which uses encryption to ensure security.

[0337] The input is the converted data (JSON format), and the output is secure transmission to the server.

[0338] Step 5:

[0339] The server receives the data

[0340] The server validates the data it receives by checking that it is in the correct format and that required fields are not missing. For example, it checks that "Name" and "Date of Birth" are present and complete.

[0341] The input is the received data (JSON format) and the output is the validity verification result.

[0342] Step 6:

[0343] Retrieving relevant information from a database

[0344] The server accesses the database and retrieves additional relevant information based on the information provided by the user, such as a driver's license renewal, including any previous violations.

[0345] The input is the user's basic information, and the output is additional information retrieved from the database.

[0346] Step 7:

[0347] Generate an application form

[0348] The server automatically generates an application form based on the information and emotion data it acquires. For example, if the user is feeling anxious, it will simplify the instructions for the procedure. The generated application form is saved in PDF format.

[0349] The input is the acquired additional information and emotion data, and the output is an automatically generated PDF application form.

[0350] Step 8:

[0351] Generate a download link for the application form

[0352] The server saves the generated application form and generates a download link for it. For example, a link like "https: / / example.com / download / tanaka_form.pdf" is generated.

[0353] The input is the generated PDF file and the output is the download link.

[0354] Step 9:

[0355] Send the link to users

[0356] The server returns the generated download link to the device, and the user accesses this link to download the application form.

[0357] The input is a download link, and the output is sending the link to the user's device.

[0358] Step 10:

[0359] User downloads application form

[0360] The user accesses the link returned from the server using their device and downloads the application form. The user then checks the downloaded application form and signs or stamps it.

[0361] The input is the download link and the output is the downloaded application form.

[0362] Step 11:

[0363] User submits application

[0364] After the user has signed or stamped the downloaded application form as required, the user submits the application form to the designated location or submits it online.

[0365] The input is the downloaded application and the output is the submitted application.

[0366] This system aims to improve the efficiency of application procedures by minimizing the user's effort at each step and reflecting emotional data.

[0367] (Application example 2)

[0368] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0369] Many conventional public application generation systems automatically generate application forms based on information entered by users, but do not provide personalized support that takes into account the user's emotional state. This can cause users to feel stressed or anxious, making it difficult for them to understand and complete the procedures. Furthermore, users are often hesitant to download the generated application form because they are not provided with a download link. These issues need to be addressed.

[0370] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0371] In this invention, the server includes a means for recognizing the user's emotional state, a means for personalizing the application form content and procedures according to the emotional state, and a means for retrieving additional information from a database based on the information received by the server. This allows the user to proceed with the application process with peace of mind and enables smooth application completion. Furthermore, the server also realizes rapid and accurate application form generation and provision of a download link.

[0372] "Means for receiving user-input information" refers to interfaces and devices for receiving user-input information in digital form.

[0373] The "means for transmitting the information to the server" refers to a communication protocol and device for transferring the information entered by the user to the server via a network.

[0374] "Means for recognizing the user's emotional state" refers to technology and devices for detecting emotions from the user's facial expressions, voice, gestures, etc., and analyzing that state as digital data.

[0375] The "means for personalizing the contents of the application form and procedures according to the emotional state" refers to an algorithm and device for individually adjusting the contents of the application form and instructions for the procedures based on the user's emotional data.

[0376] "Means for obtaining additional information from a database based on the information received by the server" refers to a system and process by which the server uses the information received from the user to search the corresponding database and obtain related supplemental information.

[0377] "Means for automatically generating an application" refers to software and processing equipment that automatically generates a formatted application using information provided by a user and additional information retrieved from a database.

[0378] The "means for providing the generated application form to the user" refers to an interface and system for providing the automatically generated application form in a format that can be viewed or downloaded by the user.

[0379] "Means for validating the format of information received by the server" refers to the algorithms and processes used by the server to verify whether the data received from the user is in the correct format.

[0380] The "means for generating an error message when a condition is not met based on the verification result" refers to software and a system for sending an error message to a user when a condition is not met as a result of the formal verification of data.

[0381] "Means for saving the generated application form in PDF format" refers to software and a system for converting the generated application form into a file in the versatile and highly storable PDF format and saving it.

[0382] The "means for providing a user with a download link for the application form" refers to an interface and system for providing a user with an access link for the generated application form, allowing the user to download the application form.

[0383] This invention is a system that allows users to easily and effectively generate official application forms. The system mainly consists of a user terminal, emotional state recognition technology, a server, a database, and an automatic generation algorithm.

[0384] User's device

[0385] A smartphone is used as an interface for users to input information. A dedicated application is installed and an information input form is displayed.

[0386] Technology to recognize emotional states

[0387] The user's device is equipped with a camera and microphone, which are used to recognize the user's emotions. For example, open-source emotion recognition libraries are used to collect emotion data from the user's facial expressions and voice tone.

[0388] server

[0389] The server performs the following process.

[0390] 1. Receive information sent from the user's device, including the user's emotional data.

[0391] 2. Verify the validity of the information received, for example, by checking that all required fields have been completed.

[0392] 3. If valid, retrieve additional information from a database, for example, from applications previously submitted by the user.

[0393] 4. Automatically generate application forms based on information and emotion data, and personalize content and procedural instructions based on emotion data.

[0394] 5. Save the generated application form in PDF format and provide the user with a download link.

[0395] Data processing and calculation

[0396] Specifically, the following technologies are used:

[0397] Emotion recognition technology: Libraries such as EmotionRecognizer are used.

[0398] Data validation techniques: Regular expressions and data type checks are used to ensure the validity of received data.

[0399] PDF generation technology: Use the FPDF library or similar to save the generated application form in PDF format.

[0400] Communication technology: The HTTPS protocol is used to securely transmit user data to the server.

[0401] For example, when applying for a security clearance from the police, a user opens the application and enters necessary information such as their name, date of birth, and security ID. At the same time, emotional data is collected via the camera and microphone and sent to the server. The server automatically generates an application form based on this data, saves it in PDF format, and provides a download link to the user.

[0402] Example prompt for a generative AI model:

[0403] "Please generate a security clearance application form. The user name is Yamada Taro, the date of birth is January 1, 1990, and the security ID is XYZ12345. The user's emotional state is unstable. I would like the application form to be simplified based on the user's emotional state."

[0404] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0405] Step 1:

[0406] Accepts information entered by the user

[0407] The user launches the smartphone application and enters the necessary information (such as name, date of birth, and security ID). The device then uses the camera and microphone to collect the user's facial expressions and voice tone, and obtains emotional data.

[0408] Input: User information, emotion data

[0409] Output: Initial data saved in the device

[0410] Step 2:

[0411] Sending the information to a server

[0412] The device converts the information and emotion data entered by the user into JSON format and sends it to the server using the secure HTTPS protocol.

[0413] Input: Initial data in the device (user information, emotion data)

[0414] Output: Send data to the server

[0415] Step 3:

[0416] Verifying data validity on the server

[0417] The server validates the information it receives, for example by ensuring all required fields are filled in and the format is correct.

[0418] Input: Data sent to the server

[0419] Output: Validity check result (pass / error)

[0420] Step 4:

[0421] Processing data based on validation results

[0422] If the validation check passes, the server accesses a database to retrieve additional information based on the information provided by the user, such as past application history.

[0423] Input: Validated user information

[0424] Output: Additional information retrieved from the database

[0425] Step 5:

[0426] Personalization and automatic application generation based on emotion data

[0427] The server takes emotion data into consideration and personalizes the application form and procedures. Based on the emotion data, the application form is automatically generated after adjusting the wording and procedural instructions.

[0428] Input: Additional information and emotion data

[0429] Output: Personalized application form (PDF format)

[0430] Step 6:

[0431] Save the generated application form and provide it to the user

[0432] The server saves the generated application form in PDF format and generates a download link that the user can access. The server returns this link to the device so that the user can download the application form.

[0433] Input: Personalized Application Form

[0434] Output: Provide download link

[0435] Step 7:

[0436] User obtains application form

[0437] The user accesses the link sent from the server via their device and downloads the generated application form. They can then check the contents of the downloaded application form and print or sign it as necessary.

[0438] Input: Download link

[0439] Output: Application form saved to the user's computer

[0440] The above steps enable the automatic generation and provision of personalized application forms according to the user's emotional state.

[0441] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0442] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0443] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0444] [Second embodiment]

[0445] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0446] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0447] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0448] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0449] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0450] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0451] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0452] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0453] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0454] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0455] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0456] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0457] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[0458] This system is composed of the following main components: user terminals, a server, and a database.

[0459] User

[0460] First, the user accesses a dedicated application or website using a device. The user is then presented with a form to enter the necessary information (name, date of birth, address, driver's license number, etc.). When the user enters the necessary information into the form and presses the send button, the device sends the input data to the server.

[0461] Terminal

[0462] The terminal receives the information entered by the user and converts it into an appropriate data format, such as JSON or XML, and then transmits the converted data securely to the server over the network using a protocol such as HTTPS.

[0463] server

[0464] When the server receives the input data, it first validates the data, checking whether the input data is in the correct format and whether any required fields are missing. If validation is successful, the server accesses a database to retrieve additional information related to the information provided by the user. For example, it may extract past application history and other relevant data. Using this information, the server uses a template engine to automatically generate an application form.

[0465] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[0466] User (after provision)

[0467] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then sends the application form to the designated submission address or submits it online.

[0468] Specific examples

[0469] For example, consider the case of applying for driver's license renewal. A user accesses a website and enters the required information (such as name, date of birth, and current license number), and their device sends that information to a server. The server validates the information and retrieves relevant information from a database (such as past violation history). Using this information, the server automatically generates a license renewal application form and provides it to the user in PDF format. The user then downloads and prints the application, signs it, fills in the necessary fields, and submits it.

[0470] The present invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[0471] The processing flow will be explained below.

[0472] Step 1:

[0473] The user accesses a dedicated application or website and is presented with a form to fill out.

[0474] Step 2:

[0475] The user enters the required information such as name, date of birth, address, driver's license number, etc. into the displayed form and clicks the submit button.

[0476] Step 3:

[0477] The device receives information entered by the user and converts it into JSON or XML format data.

[0478] Step 4:

[0479] The terminal sends the converted data to the server using the HTTPS protocol.

[0480] Step 5:

[0481] The server receives the HTTPS request and parses the data sent.

[0482] Step 6:

[0483] Validate the data parsed by the server, ensuring all required fields are filled in and the data is formatted correctly.

[0484] Step 7:

[0485] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[0486] Step 8:

[0487] The server combines the additional information acquired with the information provided by the user and automatically generates an application form using a template engine.

[0488] Step 9:

[0489] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[0490] Step 10:

[0491] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[0492] Step 11:

[0493] The terminal receives the response from the server and displays the download link on the user interface.

[0494] Step 12:

[0495] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[0496] Step 13:

[0497] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[0498] Step 14:

[0499] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[0500] Example 1

[0501] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0502] The traditional process of creating official application forms is time-consuming and laborious, with a high risk of reapplication due to input errors or incomplete data. Furthermore, creating application forms requires a lot of manual work, hindering the speed of application procedures. Therefore, there is a need for a system that streamlines the creation of official application forms and reduces the burden on users.

[0503] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0504] In this invention, the server includes means for receiving information entered by a user, means for the terminal to convert the information into an appropriate data format and transmit it to the server, means for the server to retrieve additional information from a database based on the received information, means for automatically generating an application form using a template engine based on the retrieved information, and means for saving the generated application form in PDF format and generating a download link for it to provide to the user. This makes it possible to automate the time-consuming process of creating application forms, reducing the burden on users and enabling quick and accurate application procedures.

[0505] "User" means an individual or legal entity that utilizes the System to enter information and complete official applications.

[0506] A "terminal" is a device (e.g., computer, smartphone, tablet) that a user uses to enter information.

[0507] A "server" is a computer system that receives data sent from a terminal, processes it, and automatically generates an application form.

[0508] The "means for receiving information" is an interface for acquiring data such as name, date of birth, address, and driver's license number provided by the user.

[0509] "Means of converting into data format" refers to the process of converting information obtained from the user into an appropriate format such as JSON or XML.

[0510] The "means of transmission" is a protocol for transmitting the converted data to the server in a secure manner, such as the HTTPS protocol.

[0511] "Database" refers to a data storage system used by the server to manage past application history and related information.

[0512] The "means for obtaining additional information" is the process by which the server accesses the database to search for and obtain the required information.

[0513] A "template engine" is a software component that embeds acquired data into an application form template.

[0514] The "means for automatically generating an application form" is a process for creating an application form by using a template engine to fill in the necessary data.

[0515] "Saving in PDF format" refers to the process of saving the automatically generated application form to a file in Portable Document Format (PDF).

[0516] The "means for generating a download link" is the process of creating an access link to the generated PDF file and providing it to the user.

[0517] The present invention relates to a system that automatically generates official application forms by linking information entered by a user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[0518] This system includes the following main components: a user terminal, a server, and a database. Specifically, they are as follows:

[0519] User

[0520] A user accesses a dedicated application or website using a device. A web form is displayed, and the user enters the necessary information, such as name, date of birth, address, driver's license number, etc. Once the information is entered, the user presses a submit button, and the input data is sent to the server via the device.

[0521] Terminal

[0522] The device uses JavaScript or other client-side scripts to convert user-entered information into JSON or XML format, after which the data is securely transmitted to the server using the HTTPS protocol.

[0523] server

[0524] The server receives the data using Python's Flask framework or a similar web framework. First, it validates the data, checking that the data format is correct and that required fields are not missing. If the error check is successful, the server accesses the database and retrieves relevant information from an SQL database such as MySQL or PostgreSQL. Based on the retrieved information, the server uses a template engine such as Jinja2 to automatically generate an application form. The generated application form is converted to PDF format using a library such as WeasyPrint or wkhtmltopdf and saved. A download link for the PDF file is generated and sent back to the terminal.

[0525] User (after provision)

[0526] The user accesses the link returned from the server via their device and downloads the generated application form. After downloading, the user opens the file, checks the contents, signs and stamps the application as required, and finally sends the application to the designated submission address or submits it online.

[0527] Specific examples

[0528] Consider the case of applying for a driver's license renewal. A user accesses a website and enters the required information (name, date of birth, current license number, etc.). The input data is converted to JSON format by the terminal and sent to the server via the HTTPS protocol. The server verifies the validity of the data and retrieves related information such as past violation history from a database. Using a template engine, a license renewal application form is automatically generated and provided to the user in PDF format. The user downloads the application form, prints it, signs it, fills in the necessary fields, and submits it.

[0529] An example prompt sentence for a specific implementation of this system is as follows:

[0530] Prompt: I am developing a program to automatically generate driver's license renewal application forms. The user enters the necessary information, such as name, date of birth, address, and driver's license number, and the server retrieves past application history data and generates the application form based on that information. This requires integration with a template engine and a database.

[0531] This invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[0532] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0533] Step 1:

[0534] The user accesses a dedicated application or website and enters the necessary information into a form, such as their name, date of birth, address, driver's license number, etc. After entering the information, they press the send button, and the form data is sent to the device.

[0535] Input: Information entered by the user (name, date of birth, address, driver's license number).

[0536] Data processing: None.

[0537] Output: The form data is sent to the terminal.

[0538] What happens: A user fills in the fields of a web form and clicks the submit button.

[0539] Step 2:

[0540] The device retrieves the information received from the user and converts it into JSON or XML format using a client-side script such as JavaScript.

[0541] Input: The data in the form.

[0542] Data processing: Convert the data obtained from the form into JSON or XML format.

[0543] Output: The transformed JSON or XML data.

[0544] Specific behavior: JavaScript code retrieves the form data and converts it to JSON format using a method such as JSON.stringify().

[0545] Step 3:

[0546] The terminal transmits the converted data to the server using the HTTPS protocol.

[0547] Input: The transformed JSON or XML data.

[0548] Data processing: None.

[0549] Output: The HTTP request sent to the server.

[0550] Specific behavior: Creates and sends an HTTP POST request containing the converted data using the XMLHttpRequest or Fetch API.

[0551] Step 4:

[0552] The server receives the data sent from the device, analyzes it using Python's Flask framework, and verifies its validity by checking whether the data format is correct and whether all required fields are filled in.

[0553] Input: HTTP request data (JSON or XML) arriving at the server.

[0554] Data processing: Validating data format, checking required fields.

[0555] Output: Validation result (success or error message).

[0556] What happens: The Flask application receives the request and uses a JSON parser to check the data format and ensure required fields are present.

[0557] Step 5:

[0558] If the server successfully validates the data, it accesses the database to obtain additional information about the user, such as past application history, from a database system such as MySQL or PostgreSQL.

[0559] Input: Validated user data.

[0560] Data manipulation: Performing database queries to find and retrieve additional information.

[0561] Output: Additional information (such as past application history).

[0562] Specific operation: Executes an SQL query (e.g. SELECT FROM user_history WHERE user_id = ?) and retrieves the results.

[0563] Step 6:

[0564] The additional information obtained by the server is inserted into the application form template using a template engine (e.g. Jinja2) and the application form is automatically generated.

[0565] Input: Verified user data, additional information retrieved from database.

[0566] Data processing: Use a template engine to embed data into the application format.

[0567] Output: The generated application form (in HTML format).

[0568] What it does: Renders data into Jinja2 templates and intelligently composes the generated HTML.

[0569] Step 7:

[0570] The server converts the generated application form into PDF format and saves it using libraries such as WeasyPrint and wkhtmltopdf.

[0571] Input: Generated application form (HTML format).

[0572] Data processing: Convert HTML data into PDF format and save it on the server.

[0573] Output: PDF file.

[0574] What it does: Uses the WeasyPrint library to generate a PDF from an HTML template and saves it to the file system.

[0575] Step 8:

[0576] The server generates a download link for the PDF file and returns the link to the device.

[0577] Input: PDF file.

[0578] Data processing: Download link generation.

[0579] Output: Download link.

[0580] Specific operation: The server generates a link and returns JSON data containing link information to the device as an HTTP response.

[0581] Step 9:

[0582] The user accesses the download link provided by the server through their device and downloads the generated application form. After downloading, the user opens the file and checks its contents.

[0583] Input: Download link.

[0584] Data processing: None.

[0585] Output: Download PDF file.

[0586] What happens: The user clicks on the download link and the browser automatically starts downloading the PDF file.

[0587] Step 10:

[0588] The user signs and stamps the generated application form as required and sends it to the designated submission destination, or submits it online.

[0589] Input: The downloaded PDF file.

[0590] Data processing: None.

[0591] Output: Signed and stamped application form.

[0592] Specific behavior: The user prints the PDF file, signs or stamps it as required, and then submits it by mail or online.

[0593] (Application example 1)

[0594] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0595] Conventional public application systems require users to manually enter information and scan documents individually, which is inefficient and prone to errors. They also have environment-dependent issues, making it difficult to instantly create applications on the go. This makes it difficult to respond to unexpected application processing situations.

[0596] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0597] In this invention, the server includes a means for receiving information input by voice commands or gestures, a means for scanning documents using a built-in camera and performing optical character recognition, and a means for providing the generated application form to the user, thereby enabling the user to automatically generate application forms in real time using the smart glasses and complete official procedures quickly and efficiently.

[0598] "Voice instruction" refers to a method in which a user gives instructions to a device using voice.

[0599] A "gesture" is a method of giving instructions to a device using hand and finger movements.

[0600] An "integrated camera" is a camera built into a device that has the ability to capture images and videos.

[0601] "Optical character recognition" is a technology that automatically identifies characters from images or scanned documents and converts them into text data.

[0602] An "application form" is an official document required for an official procedure, containing specific information and having a prescribed format.

[0603] "Server" means a computer system that processes information received from users and stores, manages, and provides data.

[0604] A "digital signature" is a signature made by electronic means and is used to certify the legitimacy and authenticity of a document.

[0605] The system of the present invention allows users to input necessary information using voice commands or gestures, scan documents with a built-in camera, and automatically generate and provide application forms on a server. The system is composed of smart glasses with voice command and gesture recognition functions, a built-in camera, OCR (optical character recognition), a server, and software with digital signature functionality.

[0606] First, the user puts on the smart glasses and inputs the necessary information into the system using voice commands and gestures. The smart glasses are equipped with a built-in camera, which is used to scan documents. The scanned image is then converted into text data using OCR technology. Pytesseract can be used for this OCR process.

[0607] The server receives the input data provided by the user and the data extracted by OCR. It converts this data into an appropriate format and retrieves additional information from a database, such as past application history and other relevant information. This process uses a template engine to automatically generate the application form.

[0608] The generated application form is saved in PDF format and a link is provided to the user, who can view the link on the smart glasses display and digitally sign it if necessary. The digital signature is encrypted to ensure security.

[0609] As a concrete example, consider a case where a user applies for a visa while on the go. The user uses smart glasses to enter the necessary information using voice commands and scans their passport and other necessary documents with the built-in camera. The server automatically generates an application form in real time and provides the user with a link in PDF format. The user can then review the generated application form on the smart glasses' display and digitally sign it to instantly complete the application process.

[0610] Example prompt sentence:

[0611] Create a system that automatically generates official application forms by having the user enter the necessary information. The user uses smart glasses to input information using voice commands and gestures, and scans the necessary documents with the built-in camera. This information is sent to a server that automatically generates the application form and provides it to the user in PDF format.

[0612] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0613] Step 1:

[0614] The user puts on the smart glasses and inputs the necessary information using voice commands or gestures. The information entered by the user (such as name, date of birth, and address) is then stored in the smart glasses' internal system.

[0615] Input: User's voice commands or gesture operations

[0616] Output: Required information entered by the user

[0617] How it works: The smart glasses' voice and gesture recognition software analyzes the user's instructions and generates appropriate input data.

[0618] Step 2:

[0619] Users scan the required documents using the built-in camera, which captures an image of the document and converts it into text data using OCR technology.

[0620] Input: Image of document taken with built-in camera

[0621] Output: Text data converted by OCR

[0622] Specific operation: A document is photographed using the built-in camera on the smart glasses, and the image is subjected to OCR processing using pytesseract to extract text data.

[0623] Step 3:

[0624] The smart glasses convert the user's input data and scanned text data into JSON format and send it to the server.

[0625] Input: User input data, text data obtained by OCR processing

[0626] Output: Data converted to JSON format

[0627] How it works: The smart glasses' internal software converts the input data into JSON format and sends it to the server using the HTTPS protocol.

[0628] Step 4:

[0629] The server receives the data sent by the user, verifies its format, and if the data format is not correct, generates an error message and returns it to the terminal.

[0630] Input: JSON format data sent by the user

[0631] Output: Validation result (success or error message)

[0632] Specific behavior: The server verifies whether the received data is formatted correctly and checks whether required fields exist. If the required conditions are not met, it generates and returns an error message.

[0633] Step 5:

[0634] The server accesses a database with the appropriately formatted data to retrieve additional information, such as past filing history and relevant legal information.

[0635] Input: Properly validated user data

[0636] Output: Additional information retrieved from the database

[0637] Specific Actions: The server performs a database query to extract any additional information required.

[0638] Step 6:

[0639] The server automatically generates an application form using a template engine based on the acquired information, and the generated application form is saved in PDF format.

[0640] Input: User data and additional information from the database

[0641] Output: Automatically generated PDF application form

[0642] Specific operation: The server's template engine generates an application form based on the data and saves it in PDF format using the PDF library.

[0643] Step 7:

[0644] The server sends a download link for the generated application form back to the user's device, where the user can view the link on the smart glasses display.

[0645] Input: Application form saved in PDF format

[0646] Output: Download link

[0647] Specific operation: The server saves the generated PDF file and generates a download link to send to the user's smart glasses.

[0648] Step 8:

[0649] The user checks the download link through the smart glasses, downloads, views, and confirms the application form, and if necessary, digitally signs it.

[0650] Input: Download link

[0651] Output: Application form reviewed and digitally signed by the user

[0652] Specific operation: The user operates the smart glasses display to download and review the generated PDF application form and digitally sign it.

[0653] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0654] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user as required. Furthermore, the present invention incorporates an emotion engine that recognizes the user's emotions, and personalizes the contents and procedures of the application form according to the user's emotional state.

[0655] This system consists of the following main components: the user's terminal, a server, a database, and an emotion engine.

[0656] User

[0657] The user uses the device to access a dedicated application or website, which displays a form for the user to enter necessary information. The device then collects data via the camera and microphone to recognize the user's emotions. When the user enters the necessary information in the form and clicks the submit button, the device sends the input data and emotional data to the server.

[0658] Terminal

[0659] The device receives information entered by the user and converts it into an appropriate data format, such as JSON or XML. The converted data also includes the user's emotional data recognized by the emotion engine. The emotional data is used to identify the user's emotional state from their facial expressions and tone of voice using image processing and voice analysis technology. The converted data is then securely transmitted to the server via the network using protocols such as HTTPS.

[0660] server

[0661] When the server receives the input data, it first verifies the validity of the data. It checks whether the input data is in the correct format and whether any required fields are missing. If the validation is successful, the server accesses the database to obtain additional relevant information based on the information provided by the user. Taking into account the obtained information as well as the user's emotional data, the server automatically generates an application form. Based on the emotional data, the server personalizes the content and procedures of the application form. For example, if the user is in a hurry, it may simplify the instructions for the procedure.

[0662] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[0663] User (after provision)

[0664] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then submits the application form to the designated location or submits it online.

[0665] Specific examples

[0666] For example, consider the case of applying to renew a driver's license. When a user accesses a website and enters the necessary information (such as name, date of birth, and current license number), the emotion engine detects the user's level of stress from their facial expressions and voice. The device then sends this information to a server. The server then verifies the information entered and retrieves relevant information from a database (such as past violation history). Based on the emotion data, a personalized application form is automatically generated, with shortened instructions and other modifications to ensure the process goes smoothly. The generated application form is provided to the user in PDF format, who then downloads it, prints it, and submits it.

[0667] The present invention eliminates the manual work of filling out application forms, providing accurate and speedy application procedures. In addition, by utilizing an emotion engine, it reduces the psychological burden on users and provides a more user-friendly experience.

[0668] The processing flow will be explained below.

[0669] Step 1:

[0670] The user accesses a dedicated application or website and is presented with a form to fill out.

[0671] Step 2:

[0672] The device uses a camera and microphone to collect facial and voice data from the user, allowing it to recognize the user's emotional state in real time.

[0673] Step 3:

[0674] The user enters the required information such as name, date of birth, address, and driver's license number into the form and clicks the submit button.

[0675] Step 4:

[0676] The device receives information input by the user and converts the received information and emotion data into JSON or XML format data.

[0677] Step 5:

[0678] The terminal sends the converted data to the server using the HTTPS protocol.

[0679] Step 6:

[0680] The server receives the HTTPS request and parses the data sent.

[0681] Step 7:

[0682] Validate the data parsed by the server, ensuring that the input data is in the correct format and that all required fields are filled in.

[0683] Step 8:

[0684] The server analyzes the emotional data and determines the user's emotional state (e.g., stress, impatience, anger, etc.).

[0685] Step 9:

[0686] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[0687] Step 10:

[0688] The server combines the additional information acquired with the information provided by the user and uses a template engine to automatically generate an application form. The content of the application form and instructions are personalized based on emotion data.

[0689] Step 11:

[0690] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[0691] Step 12:

[0692] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[0693] Step 13:

[0694] The terminal receives the response from the server and displays the download link on the user interface.

[0695] Step 14:

[0696] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[0697] Step 15:

[0698] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[0699] Step 16:

[0700] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[0701] In this way, the present invention provides a process for automatically generating application forms that takes into account the user's emotions. Because the instructions and application form content are personalized based on the user's emotion data, the user can complete the application process more comfortably and without stress.

[0702] Example 2

[0703] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0704] Conventional systems require users to manually create application forms, which takes a lot of time and effort. Furthermore, they are unable to consider the user's emotional state while creating the application, resulting in a poor user experience. Furthermore, if the information entered by the user is incorrectly formatted, the application form based on that information may be inaccurate. To address these issues, a system is needed that can appropriately process the user's input information and emotional data and automatically generate personalized application forms.

[0705] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0706] In this invention, the server includes means for converting information entered by a user into an appropriate data format, means for collecting user emotion data, and means for transmitting the information and emotion data and retrieving additional information from a database. This makes it possible to personalize the contents of the application form based on the user emotion data and automatically generate application forms efficiently and accurately.

[0707] The "means for receiving information input by a user" is an interface for collecting information input by a user via a terminal.

[0708] "Means for converting into an appropriate data format" refers to the process or tool used to convert user-entered information into a data format (e.g., JSON or XML) that can be processed and transmitted by the system.

[0709] "Means for collecting user emotional data" refers to technology for identifying and collecting the user's emotional state from facial expressions and voice using devices such as cameras and microphones.

[0710] "Means for transmitting information and emotional data to the server" refers to a communication protocol or network for securely transmitting the user's input information and emotional data from the terminal to the server.

[0711] The "means by which the server obtains additional information from the database based on the information received" refers to a query or index function that allows the server to search and obtain the necessary data from the database based on the information input by the user.

[0712] The "means for automatically generating an application form based on acquired information and emotional data" refers to an algorithm that automatically creates an application form in accordance with a specific format, taking into account the information acquired by the server from the database and the user's emotional data.

[0713] "Means for providing the generated application form to the user" refers to a function that allows the generated application form to be saved in a PDF or other digital format and provided as a link or file that the user can download or access.

[0714] "Means for validating the format of information received by the server" means the process or tools by which the server checks the format and content of data sent by users to detect inaccurate or incomplete data.

[0715] "Means for generating an error message if the conditions are not met based on the validation results" is a function for creating and sending an error message to the user if the data format or content does not meet the server's standards.

[0716] "Means for personalizing the contents of application forms and procedures based on the user's emotional data" refers to technology that appropriately adjusts the contents of application forms and explanations of procedures according to the user's emotional state, providing them in a way that is easy for the user to understand and that reduces stress.

[0717] The "means for saving the generated application form in PDF format" is a function for saving the generated application form as a PDF file so that the user can easily access and download it.

[0718] This invention relates to a system that automatically generates official application forms by linking information entered by a user. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions, personalizing the application form content and procedures according to the user's emotional state. This system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[0719] User terminal operation

[0720] A user accesses a dedicated application or website using a device such as a PC or smartphone. They enter necessary information such as their name, date of birth, and address into a form displayed on the device. The device also uses a camera and microphone to collect the user's facial expressions and voice in real time, which are recognized as emotional data. When the user enters the necessary information into the form and clicks the submit button, the device sends the input data and emotional data to a server.

[0721] As a concrete example, consider the case where a user renews their driver's license. The user accesses a website and enters the necessary information, such as their name, date of birth, and license number, into a form. The device's camera then analyzes the user's facial expressions and uses an emotion engine to detect whether the user is anxious. This information is then sent to the server.

[0722] Device Role

[0723] After receiving the information entered by the user, the device converts it into JSON or XML format. This converted data also includes the user's emotional data analyzed by the emotion engine. Emotional data is identified from the user's facial expressions and tone of voice using image processing and voice analysis technology. The device then securely transmits the converted data to the server using the HTTPS protocol.

[0724] Server Operation

[0725] The server receives the data sent from the device. First, it validates the data, ensuring that the input data is in the correct format and that required fields are not missing. Next, the server accesses a database to retrieve additional relevant information based on the information provided by the user. In addition, the server takes into account emotional data and automatically generates an application form. For example, if the user is in a hurry, it can simplify the instructions for the procedure and provide other personalized information.

[0726] In a specific example, when applying for a driver's license renewal, the server retrieves the user's past violation history from the database and creates an application form by shortening the instructions based on the user's emotional state. The created application form is saved in PDF format and a download link is generated. This link is sent back to the device so the user can access it.

[0727] User operations (after provision)

[0728] The user accesses the download link returned from the server via their device and downloads the generated application form. They then check the contents of the downloaded application form and sign or stamp it as necessary. Finally, they submit the application form to the designated location or complete the submission online.

[0729] Prompt Sentence Examples

[0730] An example of a prompt to be input to the generative AI model is as follows:

[0731] "Please automatically generate the application form I need when I renew my driver's license. I have listed my name, date of birth, and current license number below. Please shorten the instructions to reduce user stress. Please also retrieve past violation history from the database and reflect it."

[0732] This invention eliminates the manual work of filling out application forms and provides accurate and speedy application procedures. Furthermore, by utilizing an emotion engine, it aims to reduce the psychological burden on users and provide a more user-friendly experience.

[0733] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0734] Step 1:

[0735] The user enters information

[0736] The user accesses a dedicated application or website using their device and enters the necessary information such as name, date of birth, and address. Specifically, they enter information such as "Taro Tanaka," "January 1, 1980," and "123-456 Shibuya-ku, Tokyo" into the form. Once the information is complete, they click the submit button.

[0737] Input data (name, date of birth, address) is collected and this data is sent as output to the next processing step.

[0738] Step 2:

[0739] Collect user sentiment data

[0740] The device uses a camera and microphone to collect the user's facial expressions and voice in real time. Specifically, the camera captures the user's facial expressions and the microphone records the tone of voice. The emotion engine analyzes this data and identifies the user's emotional state. For example, if the user is anxious, emotion data is generated.

[0741] The input is camera footage and microphone audio data, and the output is emotion data (e.g., impatience).

[0742] Step 3:

[0743] Converting data into the appropriate format

[0744] The device receives user input and emotion data and converts it into JSON or XML format, including name, date of birth, address, and emotion data.

[0745] It receives input data (user input, emotion data) and converts it into the following output format:

[0746] json

[0747] {

[0748] "name": "Taro Tanaka",

[0749] "birth_date": "1980-01-01",

[0750] "address": "123-456, Shibuya-ku, Tokyo",

[0751] "emotion": "stressed"

[0752] }

[0753] Step 4:

[0754] Sending data to the server

[0755] The device sends the converted data to the server using the HTTPS protocol, which uses encryption to ensure security.

[0756] The input is the converted data (JSON format), and the output is secure transmission to the server.

[0757] Step 5:

[0758] The server receives the data

[0759] The server validates the data it receives by checking that it is in the correct format and that required fields are not missing. For example, it checks that "Name" and "Date of Birth" are present and complete.

[0760] The input is the received data (JSON format) and the output is the validity verification result.

[0761] Step 6:

[0762] Retrieving relevant information from a database

[0763] The server accesses the database and retrieves additional relevant information based on the information provided by the user, such as a driver's license renewal, including any previous violations.

[0764] The input is the user's basic information, and the output is additional information retrieved from the database.

[0765] Step 7:

[0766] Generate an application form

[0767] The server automatically generates an application form based on the information and emotion data it acquires. For example, if the user is feeling anxious, it will simplify the instructions for the procedure. The generated application form is saved in PDF format.

[0768] The input is the acquired additional information and emotion data, and the output is an automatically generated PDF application form.

[0769] Step 8:

[0770] Generate a download link for the application form

[0771] The server saves the generated application form and generates a download link for it. For example, a link like "https: / / example.com / download / tanaka_form.pdf" is generated.

[0772] The input is the generated PDF file and the output is the download link.

[0773] Step 9:

[0774] Send the link to users

[0775] The server returns the generated download link to the device, and the user accesses this link to download the application form.

[0776] The input is a download link, and the output is sending the link to the user's device.

[0777] Step 10:

[0778] User downloads application form

[0779] The user accesses the link returned from the server using their device and downloads the application form. The user then checks the downloaded application form and signs or stamps it.

[0780] The input is the download link and the output is the downloaded application form.

[0781] Step 11:

[0782] User submits application

[0783] After the user has signed or stamped the downloaded application form as required, the user submits the application form to the designated location or submits it online.

[0784] The input is the downloaded application and the output is the submitted application.

[0785] This system aims to improve the efficiency of application procedures by minimizing the user's effort at each step and reflecting emotional data.

[0786] (Application example 2)

[0787] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0788] Many conventional public application generation systems automatically generate application forms based on information entered by users, but do not provide personalized support that takes into account the user's emotional state. This can cause users to feel stressed or anxious, making it difficult for them to understand and complete the procedures. Furthermore, users are often hesitant to download the generated application form because they are not provided with a download link. These issues need to be addressed.

[0789] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0790] In this invention, the server includes a means for recognizing the user's emotional state, a means for personalizing the application form content and procedures according to the emotional state, and a means for retrieving additional information from a database based on the information received by the server. This allows the user to proceed with the application process with peace of mind and enables smooth application completion. Furthermore, the server also realizes rapid and accurate application form generation and provision of a download link.

[0791] "Means for receiving user-input information" refers to interfaces and devices for receiving user-input information in digital form.

[0792] The "means for transmitting the information to the server" refers to a communication protocol and device for transferring the information entered by the user to the server via a network.

[0793] "Means for recognizing the user's emotional state" refers to technology and devices for detecting emotions from the user's facial expressions, voice, gestures, etc., and analyzing that state as digital data.

[0794] The "means for personalizing the contents of the application form and procedures according to the emotional state" refers to an algorithm and device for individually adjusting the contents of the application form and instructions for the procedures based on the user's emotional data.

[0795] "Means for obtaining additional information from a database based on the information received by the server" refers to a system and process by which the server uses the information received from the user to search the corresponding database and obtain related supplemental information.

[0796] "Means for automatically generating an application" refers to software and processing equipment that automatically generates a formatted application using information provided by a user and additional information retrieved from a database.

[0797] The "means for providing the generated application form to the user" refers to an interface and system for providing the automatically generated application form in a format that can be viewed or downloaded by the user.

[0798] "Means for validating the format of information received by the server" refers to the algorithms and processes used by the server to verify whether the data received from the user is in the correct format.

[0799] The "means for generating an error message when a condition is not met based on the verification result" refers to software and a system for sending an error message to a user when a condition is not met as a result of the formal verification of data.

[0800] "Means for saving the generated application form in PDF format" refers to software and a system for converting the generated application form into a file in the versatile and highly storable PDF format and saving it.

[0801] The "means for providing a user with a download link for the application form" refers to an interface and system for providing a user with an access link for the generated application form, allowing the user to download the application form.

[0802] This invention is a system that allows users to easily and effectively generate official application forms. The system mainly consists of a user terminal, emotional state recognition technology, a server, a database, and an automatic generation algorithm.

[0803] User's device

[0804] A smartphone is used as an interface for users to input information. A dedicated application is installed and an information input form is displayed.

[0805] Technology to recognize emotional states

[0806] The user's device is equipped with a camera and microphone, which are used to recognize the user's emotions. For example, open-source emotion recognition libraries are used to collect emotion data from the user's facial expressions and voice tone.

[0807] server

[0808] The server performs the following process.

[0809] 1. Receive information sent from the user's device, including the user's emotional data.

[0810] 2. Verify the validity of the information received, for example, by checking that all required fields have been completed.

[0811] 3. If valid, retrieve additional information from a database, for example, from applications previously submitted by the user.

[0812] 4. Automatically generate application forms based on information and emotion data, and personalize content and procedural instructions based on emotion data.

[0813] 5. Save the generated application form in PDF format and provide the user with a download link.

[0814] Data processing and calculation

[0815] Specifically, the following technologies are used:

[0816] Emotion recognition technology: Libraries such as EmotionRecognizer are used.

[0817] Data validation techniques: Regular expressions and data type checks are used to ensure the validity of received data.

[0818] PDF generation technology: Use the FPDF library or similar to save the generated application form in PDF format.

[0819] Communication technology: The HTTPS protocol is used to securely transmit user data to the server.

[0820] For example, when applying for a security clearance from the police, a user opens the application and enters necessary information such as their name, date of birth, and security ID. At the same time, emotional data is collected via the camera and microphone and sent to the server. The server automatically generates an application form based on this data, saves it in PDF format, and provides a download link to the user.

[0821] Example prompt for a generative AI model:

[0822] "Please generate a security clearance application form. The user name is Yamada Taro, the date of birth is January 1, 1990, and the security ID is XYZ12345. The user's emotional state is unstable. I would like the application form to be simplified based on the user's emotional state."

[0823] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0824] Step 1:

[0825] Accepts information entered by the user

[0826] The user launches the smartphone application and enters the necessary information (such as name, date of birth, and security ID). The device then uses the camera and microphone to collect the user's facial expressions and voice tone, and obtains emotional data.

[0827] Input: User information, emotion data

[0828] Output: Initial data saved in the device

[0829] Step 2:

[0830] Sending the information to a server

[0831] The device converts the information and emotion data entered by the user into JSON format and sends it to the server using the secure HTTPS protocol.

[0832] Input: Initial data in the device (user information, emotion data)

[0833] Output: Send data to the server

[0834] Step 3:

[0835] Verifying data validity on the server

[0836] The server validates the information it receives, for example by ensuring all required fields are filled in and the format is correct.

[0837] Input: Data sent to the server

[0838] Output: Validity check result (pass / error)

[0839] Step 4:

[0840] Processing data based on validation results

[0841] If the validation check passes, the server accesses a database to retrieve additional information based on the information provided by the user, such as past application history.

[0842] Input: Validated user information

[0843] Output: Additional information retrieved from the database

[0844] Step 5:

[0845] Personalization and automatic application generation based on emotion data

[0846] The server takes emotion data into consideration and personalizes the application form and procedures. Based on the emotion data, the application form is automatically generated after adjusting the wording and procedural instructions.

[0847] Input: Additional information and emotion data

[0848] Output: Personalized application form (PDF format)

[0849] Step 6:

[0850] Save the generated application form and provide it to the user

[0851] The server saves the generated application form in PDF format and generates a download link that the user can access. The server returns this link to the device so that the user can download the application form.

[0852] Input: Personalized Application Form

[0853] Output: Provide download link

[0854] Step 7:

[0855] User obtains application form

[0856] The user accesses the link sent from the server via their device and downloads the generated application form. They can then check the contents of the downloaded application form and print or sign it as necessary.

[0857] Input: Download link

[0858] Output: Application form saved to the user's computer

[0859] The above steps enable the automatic generation and provision of personalized application forms according to the user's emotional state.

[0860] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0861] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0862] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0863] [Third embodiment]

[0864] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0865] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0866] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0867] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0868] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0869] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0870] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0871] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0872] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0873] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0874] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0875] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0876] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[0877] This system is composed of the following main components: user terminals, a server, and a database.

[0878] User

[0879] First, the user accesses a dedicated application or website using a device. The user is then presented with a form to enter the necessary information (name, date of birth, address, driver's license number, etc.). When the user enters the necessary information into the form and presses the send button, the device sends the input data to the server.

[0880] Terminal

[0881] The terminal receives the information entered by the user and converts it into an appropriate data format, such as JSON or XML, and then transmits the converted data securely to the server over the network using a protocol such as HTTPS.

[0882] server

[0883] When the server receives the input data, it first validates the data, checking whether the input data is in the correct format and whether any required fields are missing. If validation is successful, the server accesses a database to retrieve additional information related to the information provided by the user. For example, it may extract past application history and other relevant data. Using this information, the server uses a template engine to automatically generate an application form.

[0884] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[0885] User (after provision)

[0886] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then sends the application form to the designated submission address or submits it online.

[0887] Specific examples

[0888] For example, consider the case of applying for driver's license renewal. A user accesses a website and enters the required information (such as name, date of birth, and current license number), and their device sends that information to a server. The server validates the information and retrieves relevant information from a database (such as past violation history). Using this information, the server automatically generates a license renewal application form and provides it to the user in PDF format. The user then downloads and prints the application, signs it, fills in the necessary fields, and submits it.

[0889] The present invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[0890] The processing flow will be explained below.

[0891] Step 1:

[0892] The user accesses a dedicated application or website and is presented with a form to fill out.

[0893] Step 2:

[0894] The user enters the required information such as name, date of birth, address, driver's license number, etc. into the displayed form and clicks the submit button.

[0895] Step 3:

[0896] The device receives information entered by the user and converts it into JSON or XML format data.

[0897] Step 4:

[0898] The terminal sends the converted data to the server using the HTTPS protocol.

[0899] Step 5:

[0900] The server receives the HTTPS request and parses the data sent.

[0901] Step 6:

[0902] Validate the data parsed by the server, ensuring all required fields are filled in and the data is formatted correctly.

[0903] Step 7:

[0904] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[0905] Step 8:

[0906] The server combines the additional information acquired with the information provided by the user and automatically generates an application form using a template engine.

[0907] Step 9:

[0908] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[0909] Step 10:

[0910] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[0911] Step 11:

[0912] The terminal receives the response from the server and displays the download link on the user interface.

[0913] Step 12:

[0914] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[0915] Step 13:

[0916] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[0917] Step 14:

[0918] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[0919] Example 1

[0920] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0921] The traditional process of creating official application forms is time-consuming and laborious, with a high risk of reapplication due to input errors or incomplete data. Furthermore, creating application forms requires a lot of manual work, hindering the speed of application procedures. Therefore, there is a need for a system that streamlines the creation of official application forms and reduces the burden on users.

[0922] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0923] In this invention, the server includes means for receiving information entered by a user, means for the terminal to convert the information into an appropriate data format and transmit it to the server, means for the server to retrieve additional information from a database based on the received information, means for automatically generating an application form using a template engine based on the retrieved information, and means for saving the generated application form in PDF format and generating a download link for it to provide to the user. This makes it possible to automate the time-consuming process of creating application forms, reducing the burden on users and enabling quick and accurate application procedures.

[0924] "User" means an individual or legal entity that utilizes the System to enter information and complete official applications.

[0925] A "terminal" is a device (e.g., computer, smartphone, tablet) that a user uses to enter information.

[0926] A "server" is a computer system that receives data sent from a terminal, processes it, and automatically generates an application form.

[0927] The "means for receiving information" is an interface for acquiring data such as name, date of birth, address, and driver's license number provided by the user.

[0928] "Means of converting into data format" refers to the process of converting information obtained from the user into an appropriate format such as JSON or XML.

[0929] The "means of transmission" is a protocol for transmitting the converted data to the server in a secure manner, such as the HTTPS protocol.

[0930] "Database" refers to a data storage system used by the server to manage past application history and related information.

[0931] The "means for obtaining additional information" is the process by which the server accesses the database to search for and obtain the required information.

[0932] A "template engine" is a software component that embeds acquired data into an application form template.

[0933] The "means for automatically generating an application form" is a process for creating an application form by using a template engine to fill in the necessary data.

[0934] "Saving in PDF format" refers to the process of saving the automatically generated application form to a file in Portable Document Format (PDF).

[0935] The "means for generating a download link" is the process of creating an access link to the generated PDF file and providing it to the user.

[0936] The present invention relates to a system that automatically generates official application forms by linking information entered by a user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[0937] This system includes the following main components: a user terminal, a server, and a database. Specifically, they are as follows:

[0938] User

[0939] A user accesses a dedicated application or website using a device. A web form is displayed, and the user enters the necessary information, such as name, date of birth, address, driver's license number, etc. Once the information is entered, the user presses a submit button, and the input data is sent to the server via the device.

[0940] Terminal

[0941] The device uses JavaScript or other client-side scripts to convert user-entered information into JSON or XML format, after which the data is securely transmitted to the server using the HTTPS protocol.

[0942] server

[0943] The server receives the data using Python's Flask framework or a similar web framework. First, it validates the data, checking that the data format is correct and that required fields are not missing. If the error check is successful, the server accesses the database and retrieves relevant information from an SQL database such as MySQL or PostgreSQL. Based on the retrieved information, the server uses a template engine such as Jinja2 to automatically generate an application form. The generated application form is converted to PDF format using a library such as WeasyPrint or wkhtmltopdf and saved. A download link for the PDF file is generated and sent back to the terminal.

[0944] User (after provision)

[0945] The user accesses the link returned from the server via their device and downloads the generated application form. After downloading, the user opens the file, checks the contents, signs and stamps the application as required, and finally sends the application to the designated submission address or submits it online.

[0946] Specific examples

[0947] Consider the case of applying for a driver's license renewal. A user accesses a website and enters the required information (name, date of birth, current license number, etc.). The input data is converted to JSON format by the terminal and sent to the server via the HTTPS protocol. The server verifies the validity of the data and retrieves related information such as past violation history from a database. Using a template engine, a license renewal application form is automatically generated and provided to the user in PDF format. The user downloads the application form, prints it, signs it, fills in the necessary fields, and submits it.

[0948] An example prompt sentence for a specific implementation of this system is as follows:

[0949] Prompt: I am developing a program to automatically generate driver's license renewal application forms. The user enters the necessary information, such as name, date of birth, address, and driver's license number, and the server retrieves past application history data and generates the application form based on that information. This requires integration with a template engine and a database.

[0950] This invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[0951] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0952] Step 1:

[0953] The user accesses a dedicated application or website and enters the necessary information into a form, such as their name, date of birth, address, driver's license number, etc. After entering the information, they press the send button, and the form data is sent to the device.

[0954] Input: Information entered by the user (name, date of birth, address, driver's license number).

[0955] Data processing: None.

[0956] Output: The form data is sent to the terminal.

[0957] What happens: A user fills in the fields of a web form and clicks the submit button.

[0958] Step 2:

[0959] The device retrieves the information received from the user and converts it into JSON or XML format using a client-side script such as JavaScript.

[0960] Input: The data in the form.

[0961] Data processing: Convert the data obtained from the form into JSON or XML format.

[0962] Output: The transformed JSON or XML data.

[0963] Specific behavior: JavaScript code retrieves the form data and converts it to JSON format using a method such as JSON.stringify().

[0964] Step 3:

[0965] The terminal transmits the converted data to the server using the HTTPS protocol.

[0966] Input: The transformed JSON or XML data.

[0967] Data processing: None.

[0968] Output: The HTTP request sent to the server.

[0969] Specific behavior: Creates and sends an HTTP POST request containing the converted data using the XMLHttpRequest or Fetch API.

[0970] Step 4:

[0971] The server receives the data sent from the device, analyzes it using Python's Flask framework, and verifies its validity by checking whether the data format is correct and whether all required fields are filled in.

[0972] Input: HTTP request data (JSON or XML) arriving at the server.

[0973] Data processing: Validating data format, checking required fields.

[0974] Output: Validation result (success or error message).

[0975] What happens: The Flask application receives the request and uses a JSON parser to check the data format and ensure required fields are present.

[0976] Step 5:

[0977] If the server successfully validates the data, it accesses the database to obtain additional information about the user, such as past application history, from a database system such as MySQL or PostgreSQL.

[0978] Input: Validated user data.

[0979] Data manipulation: Performing database queries to find and retrieve additional information.

[0980] Output: Additional information (such as past application history).

[0981] Specific operation: Executes an SQL query (e.g. SELECT FROM user_history WHERE user_id = ?) and retrieves the results.

[0982] Step 6:

[0983] The additional information obtained by the server is inserted into the application form template using a template engine (e.g. Jinja2) and the application form is automatically generated.

[0984] Input: Verified user data, additional information retrieved from database.

[0985] Data processing: Use a template engine to embed data into the application format.

[0986] Output: The generated application form (in HTML format).

[0987] What it does: Renders data into Jinja2 templates and intelligently composes the generated HTML.

[0988] Step 7:

[0989] The server converts the generated application form into PDF format and saves it using libraries such as WeasyPrint and wkhtmltopdf.

[0990] Input: Generated application form (HTML format).

[0991] Data processing: Convert HTML data into PDF format and save it on the server.

[0992] Output: PDF file.

[0993] What it does: Uses the WeasyPrint library to generate a PDF from an HTML template and saves it to the file system.

[0994] Step 8:

[0995] The server generates a download link for the PDF file and returns the link to the device.

[0996] Input: PDF file.

[0997] Data processing: Download link generation.

[0998] Output: Download link.

[0999] Specific operation: The server generates a link and returns JSON data containing link information to the device as an HTTP response.

[1000] Step 9:

[1001] The user accesses the download link provided by the server through their device and downloads the generated application form. After downloading, the user opens the file and checks its contents.

[1002] Input: Download link.

[1003] Data processing: None.

[1004] Output: Download PDF file.

[1005] What happens: The user clicks on the download link and the browser automatically starts downloading the PDF file.

[1006] Step 10:

[1007] The user signs and stamps the generated application form as required and sends it to the designated submission destination, or submits it online.

[1008] Input: The downloaded PDF file.

[1009] Data processing: None.

[1010] Output: Signed and stamped application form.

[1011] Specific behavior: The user prints the PDF file, signs or stamps it as required, and then submits it by mail or online.

[1012] (Application example 1)

[1013] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1014] Conventional public application systems require users to manually enter information and scan documents individually, which is inefficient and prone to errors. They also have environment-dependent issues, making it difficult to instantly create applications on the go. This makes it difficult to respond to unexpected application processing situations.

[1015] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1016] In this invention, the server includes a means for receiving information input by voice commands or gestures, a means for scanning documents using a built-in camera and performing optical character recognition, and a means for providing the generated application form to the user, thereby enabling the user to automatically generate application forms in real time using the smart glasses and complete official procedures quickly and efficiently.

[1017] "Voice instruction" refers to a method in which a user gives instructions to a device using voice.

[1018] A "gesture" is a method of giving instructions to a device using hand and finger movements.

[1019] An "integrated camera" is a camera built into a device that has the ability to capture images and videos.

[1020] "Optical character recognition" is a technology that automatically identifies characters from images or scanned documents and converts them into text data.

[1021] An "application form" is an official document required for an official procedure, containing specific information and having a prescribed format.

[1022] "Server" means a computer system that processes information received from users and stores, manages, and provides data.

[1023] A "digital signature" is a signature made by electronic means and is used to certify the legitimacy and authenticity of a document.

[1024] The system of the present invention allows users to input necessary information using voice commands or gestures, scan documents with a built-in camera, and automatically generate and provide application forms on a server. The system is composed of smart glasses with voice command and gesture recognition functions, a built-in camera, OCR (optical character recognition), a server, and software with digital signature functionality.

[1025] First, the user puts on the smart glasses and inputs the necessary information into the system using voice commands and gestures. The smart glasses are equipped with a built-in camera, which is used to scan documents. The scanned image is then converted into text data using OCR technology. Pytesseract can be used for this OCR process.

[1026] The server receives the input data provided by the user and the data extracted by OCR. It converts this data into an appropriate format and retrieves additional information from a database, such as past application history and other relevant information. This process uses a template engine to automatically generate the application form.

[1027] The generated application form is saved in PDF format and a link is provided to the user, who can view the link on the smart glasses display and digitally sign it if necessary. The digital signature is encrypted to ensure security.

[1028] As a concrete example, consider a case where a user applies for a visa while on the go. The user uses smart glasses to enter the necessary information using voice commands and scans their passport and other necessary documents with the built-in camera. The server automatically generates an application form in real time and provides the user with a link in PDF format. The user can then review the generated application form on the smart glasses' display and digitally sign it to instantly complete the application process.

[1029] Example prompt sentence:

[1030] Create a system that automatically generates official application forms by having the user enter the necessary information. The user uses smart glasses to input information using voice commands and gestures, and scans the necessary documents with the built-in camera. This information is sent to a server that automatically generates the application form and provides it to the user in PDF format.

[1031] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1032] Step 1:

[1033] The user puts on the smart glasses and inputs the necessary information using voice commands or gestures. The information entered by the user (such as name, date of birth, and address) is then stored in the smart glasses' internal system.

[1034] Input: User's voice commands or gesture operations

[1035] Output: Required information entered by the user

[1036] How it works: The smart glasses' voice and gesture recognition software analyzes the user's instructions and generates appropriate input data.

[1037] Step 2:

[1038] Users scan the required documents using the built-in camera, which captures an image of the document and converts it into text data using OCR technology.

[1039] Input: Image of document taken with built-in camera

[1040] Output: Text data converted by OCR

[1041] Specific operation: A document is photographed using the built-in camera on the smart glasses, and the image is subjected to OCR processing using pytesseract to extract text data.

[1042] Step 3:

[1043] The smart glasses convert the user's input data and scanned text data into JSON format and send it to the server.

[1044] Input: User input data, text data obtained by OCR processing

[1045] Output: Data converted to JSON format

[1046] How it works: The smart glasses' internal software converts the input data into JSON format and sends it to the server using the HTTPS protocol.

[1047] Step 4:

[1048] The server receives the data sent by the user, verifies its format, and if the data format is not correct, generates an error message and returns it to the terminal.

[1049] Input: JSON format data sent by the user

[1050] Output: Validation result (success or error message)

[1051] Specific behavior: The server verifies whether the received data is formatted correctly and checks whether required fields exist. If the required conditions are not met, it generates and returns an error message.

[1052] Step 5:

[1053] The server accesses a database with the appropriately formatted data to retrieve additional information, such as past filing history and relevant legal information.

[1054] Input: Properly validated user data

[1055] Output: Additional information retrieved from the database

[1056] Specific Actions: The server performs a database query to extract any additional information required.

[1057] Step 6:

[1058] The server automatically generates an application form using a template engine based on the acquired information, and the generated application form is saved in PDF format.

[1059] Input: User data and additional information from the database

[1060] Output: Automatically generated PDF application form

[1061] Specific operation: The server's template engine generates an application form based on the data and saves it in PDF format using the PDF library.

[1062] Step 7:

[1063] The server sends a download link for the generated application form back to the user's device, where the user can view the link on the smart glasses display.

[1064] Input: Application form saved in PDF format

[1065] Output: Download link

[1066] Specific operation: The server saves the generated PDF file and generates a download link to send to the user's smart glasses.

[1067] Step 8:

[1068] The user checks the download link through the smart glasses, downloads, views, and confirms the application form, and if necessary, digitally signs it.

[1069] Input: Download link

[1070] Output: Application form reviewed and digitally signed by the user

[1071] Specific operation: The user operates the smart glasses display to download and review the generated PDF application form and digitally sign it.

[1072] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1073] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user as required. Furthermore, the present invention incorporates an emotion engine that recognizes the user's emotions, and personalizes the contents and procedures of the application form according to the user's emotional state.

[1074] This system consists of the following main components: the user's terminal, a server, a database, and an emotion engine.

[1075] User

[1076] The user uses the device to access a dedicated application or website, which displays a form for the user to enter necessary information. The device then collects data via the camera and microphone to recognize the user's emotions. When the user enters the necessary information in the form and clicks the submit button, the device sends the input data and emotional data to the server.

[1077] Terminal

[1078] The device receives information entered by the user and converts it into an appropriate data format, such as JSON or XML. The converted data also includes the user's emotional data recognized by the emotion engine. The emotional data is used to identify the user's emotional state from their facial expressions and tone of voice using image processing and voice analysis technology. The converted data is then securely transmitted to the server via the network using protocols such as HTTPS.

[1079] server

[1080] When the server receives the input data, it first verifies the validity of the data. It checks whether the input data is in the correct format and whether any required fields are missing. If the validation is successful, the server accesses the database to obtain additional relevant information based on the information provided by the user. Taking into account the obtained information as well as the user's emotional data, the server automatically generates an application form. Based on the emotional data, the server personalizes the content and procedures of the application form. For example, if the user is in a hurry, it may simplify the instructions for the procedure.

[1081] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[1082] User (after provision)

[1083] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then submits the application form to the designated location or submits it online.

[1084] Specific examples

[1085] For example, consider the case of applying to renew a driver's license. When a user accesses a website and enters the necessary information (such as name, date of birth, and current license number), the emotion engine detects the user's level of stress from their facial expressions and voice. The device then sends this information to a server. The server then verifies the information entered and retrieves relevant information from a database (such as past violation history). Based on the emotion data, a personalized application form is automatically generated, with shortened instructions and other modifications to ensure the process goes smoothly. The generated application form is provided to the user in PDF format, who then downloads it, prints it, and submits it.

[1086] The present invention eliminates the manual work of filling out application forms, providing accurate and speedy application procedures. In addition, by utilizing an emotion engine, it reduces the psychological burden on users and provides a more user-friendly experience.

[1087] The processing flow will be explained below.

[1088] Step 1:

[1089] The user accesses a dedicated application or website and is presented with a form to fill out.

[1090] Step 2:

[1091] The device uses a camera and microphone to collect facial and voice data from the user, allowing it to recognize the user's emotional state in real time.

[1092] Step 3:

[1093] The user enters the required information such as name, date of birth, address, and driver's license number into the form and clicks the submit button.

[1094] Step 4:

[1095] The device receives information input by the user and converts the received information and emotion data into JSON or XML format data.

[1096] Step 5:

[1097] The terminal sends the converted data to the server using the HTTPS protocol.

[1098] Step 6:

[1099] The server receives the HTTPS request and parses the data sent.

[1100] Step 7:

[1101] Validate the data parsed by the server, ensuring that the input data is in the correct format and that all required fields are filled in.

[1102] Step 8:

[1103] The server analyzes the emotional data and determines the user's emotional state (e.g., stress, impatience, anger, etc.).

[1104] Step 9:

[1105] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[1106] Step 10:

[1107] The server combines the additional information acquired with the information provided by the user and uses a template engine to automatically generate an application form. The content of the application form and instructions are personalized based on emotion data.

[1108] Step 11:

[1109] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[1110] Step 12:

[1111] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[1112] Step 13:

[1113] The terminal receives the response from the server and displays the download link on the user interface.

[1114] Step 14:

[1115] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[1116] Step 15:

[1117] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[1118] Step 16:

[1119] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[1120] In this way, the present invention provides a process for automatically generating application forms that takes into account the user's emotions. Because the instructions and application form content are personalized based on the user's emotion data, the user can complete the application process more comfortably and without stress.

[1121] Example 2

[1122] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1123] Conventional systems require users to manually create application forms, which takes a lot of time and effort. Furthermore, they are unable to consider the user's emotional state while creating the application, resulting in a poor user experience. Furthermore, if the information entered by the user is incorrectly formatted, the application form based on that information may be inaccurate. To address these issues, a system is needed that can appropriately process the user's input information and emotional data and automatically generate personalized application forms.

[1124] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1125] In this invention, the server includes means for converting information entered by a user into an appropriate data format, means for collecting user emotion data, and means for transmitting the information and emotion data and retrieving additional information from a database. This makes it possible to personalize the contents of the application form based on the user emotion data and automatically generate application forms efficiently and accurately.

[1126] The "means for receiving information input by a user" is an interface for collecting information input by a user via a terminal.

[1127] "Means for converting into an appropriate data format" refers to the process or tool used to convert user-entered information into a data format (e.g., JSON or XML) that can be processed and transmitted by the system.

[1128] "Means for collecting user emotional data" refers to technology for identifying and collecting the user's emotional state from facial expressions and voice using devices such as cameras and microphones.

[1129] "Means for transmitting information and emotional data to the server" refers to a communication protocol or network for securely transmitting the user's input information and emotional data from the terminal to the server.

[1130] The "means by which the server obtains additional information from the database based on the information received" refers to a query or index function that allows the server to search and obtain the necessary data from the database based on the information input by the user.

[1131] The "means for automatically generating an application form based on acquired information and emotional data" refers to an algorithm that automatically creates an application form in accordance with a specific format, taking into account the information acquired by the server from the database and the user's emotional data.

[1132] "Means for providing the generated application form to the user" refers to a function that allows the generated application form to be saved in a PDF or other digital format and provided as a link or file that the user can download or access.

[1133] "Means for validating the format of information received by the server" means the process or tools by which the server checks the format and content of data sent by users to detect inaccurate or incomplete data.

[1134] "Means for generating an error message if the conditions are not met based on the validation results" is a function for creating and sending an error message to the user if the data format or content does not meet the server's standards.

[1135] "Means for personalizing the contents of application forms and procedures based on the user's emotional data" refers to technology that appropriately adjusts the contents of application forms and explanations of procedures according to the user's emotional state, providing them in a way that is easy for the user to understand and that reduces stress.

[1136] The "means for saving the generated application form in PDF format" is a function for saving the generated application form as a PDF file so that the user can easily access and download it.

[1137] This invention relates to a system that automatically generates official application forms by linking information entered by a user. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions, personalizing the application form content and procedures according to the user's emotional state. This system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[1138] User terminal operation

[1139] A user accesses a dedicated application or website using a device such as a PC or smartphone. They enter necessary information such as their name, date of birth, and address into a form displayed on the device. The device also uses a camera and microphone to collect the user's facial expressions and voice in real time, which are recognized as emotional data. When the user enters the necessary information into the form and clicks the submit button, the device sends the input data and emotional data to a server.

[1140] As a concrete example, consider the case where a user renews their driver's license. The user accesses a website and enters the necessary information, such as their name, date of birth, and license number, into a form. The device's camera then analyzes the user's facial expressions and uses an emotion engine to detect whether the user is anxious. This information is then sent to the server.

[1141] Device Role

[1142] After receiving the information entered by the user, the device converts it into JSON or XML format. This converted data also includes the user's emotional data analyzed by the emotion engine. Emotional data is identified from the user's facial expressions and tone of voice using image processing and voice analysis technology. The device then securely transmits the converted data to the server using the HTTPS protocol.

[1143] Server Operation

[1144] The server receives the data sent from the device. First, it validates the data, ensuring that the input data is in the correct format and that required fields are not missing. Next, the server accesses a database to retrieve additional relevant information based on the information provided by the user. In addition, the server takes into account emotional data and automatically generates an application form. For example, if the user is in a hurry, it can simplify the instructions for the procedure and provide other personalized information.

[1145] In a specific example, when applying for a driver's license renewal, the server retrieves the user's past violation history from the database and creates an application form by shortening the instructions based on the user's emotional state. The created application form is saved in PDF format and a download link is generated. This link is sent back to the device so the user can access it.

[1146] User operations (after provision)

[1147] The user accesses the download link returned from the server via their device and downloads the generated application form. They then check the contents of the downloaded application form and sign or stamp it as necessary. Finally, they submit the application form to the designated location or complete the submission online.

[1148] Prompt Sentence Examples

[1149] An example of a prompt to be input to the generative AI model is as follows:

[1150] "Please automatically generate the application form I need when I renew my driver's license. I have listed my name, date of birth, and current license number below. Please shorten the instructions to reduce user stress. Please also retrieve past violation history from the database and reflect it."

[1151] This invention eliminates the manual work of filling out application forms and provides accurate and speedy application procedures. Furthermore, by utilizing an emotion engine, it aims to reduce the psychological burden on users and provide a more user-friendly experience.

[1152] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1153] Step 1:

[1154] The user enters information

[1155] The user accesses a dedicated application or website using their device and enters the necessary information such as name, date of birth, and address. Specifically, they enter information such as "Taro Tanaka," "January 1, 1980," and "123-456 Shibuya-ku, Tokyo" into the form. Once the information is complete, they click the submit button.

[1156] Input data (name, date of birth, address) is collected and this data is sent as output to the next processing step.

[1157] Step 2:

[1158] Collect user sentiment data

[1159] The device uses a camera and microphone to collect the user's facial expressions and voice in real time. Specifically, the camera captures the user's facial expressions and the microphone records the tone of voice. The emotion engine analyzes this data and identifies the user's emotional state. For example, if the user is anxious, emotion data is generated.

[1160] The input is camera footage and microphone audio data, and the output is emotion data (e.g., impatience).

[1161] Step 3:

[1162] Converting data into the appropriate format

[1163] The device receives user input and emotion data and converts it into JSON or XML format, including name, date of birth, address, and emotion data.

[1164] It receives input data (user input, emotion data) and converts it into the following output format:

[1165] json

[1166] {

[1167] "name": "Taro Tanaka",

[1168] "birth_date": "1980-01-01",

[1169] "address": "123-456, Shibuya-ku, Tokyo",

[1170] "emotion": "stressed"

[1171] }

[1172] Step 4:

[1173] Sending data to the server

[1174] The device sends the converted data to the server using the HTTPS protocol, which uses encryption to ensure security.

[1175] The input is the converted data (JSON format), and the output is secure transmission to the server.

[1176] Step 5:

[1177] The server receives the data

[1178] The server validates the data it receives by checking that it is in the correct format and that required fields are not missing. For example, it checks that "Name" and "Date of Birth" are present and complete.

[1179] The input is the received data (JSON format) and the output is the validity verification result.

[1180] Step 6:

[1181] Retrieving relevant information from a database

[1182] The server accesses the database and retrieves additional relevant information based on the information provided by the user, such as a driver's license renewal, including any previous violations.

[1183] The input is the user's basic information, and the output is additional information retrieved from the database.

[1184] Step 7:

[1185] Generate an application form

[1186] The server automatically generates an application form based on the information and emotion data it acquires. For example, if the user is feeling anxious, it will simplify the instructions for the procedure. The generated application form is saved in PDF format.

[1187] The input is the acquired additional information and emotion data, and the output is an automatically generated PDF application form.

[1188] Step 8:

[1189] Generate a download link for the application form

[1190] The server saves the generated application form and generates a download link for it. For example, a link like "https: / / example.com / download / tanaka_form.pdf" is generated.

[1191] The input is the generated PDF file and the output is the download link.

[1192] Step 9:

[1193] Send the link to users

[1194] The server returns the generated download link to the device, and the user accesses this link to download the application form.

[1195] The input is a download link, and the output is sending the link to the user's device.

[1196] Step 10:

[1197] User downloads application form

[1198] The user accesses the link returned from the server using their device and downloads the application form. The user then checks the downloaded application form and signs or stamps it.

[1199] The input is the download link and the output is the downloaded application form.

[1200] Step 11:

[1201] User submits application

[1202] After the user has signed or stamped the downloaded application form as required, the user submits the application form to the designated location or submits it online.

[1203] The input is the downloaded application and the output is the submitted application.

[1204] This system aims to improve the efficiency of application procedures by minimizing the user's effort at each step and reflecting emotional data.

[1205] (Application example 2)

[1206] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1207] Many conventional public application generation systems automatically generate application forms based on information entered by users, but do not provide personalized support that takes into account the user's emotional state. This can cause users to feel stressed or anxious, making it difficult for them to understand and complete the procedures. Furthermore, users are often hesitant to download the generated application form because they are not provided with a download link. These issues need to be addressed.

[1208] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1209] In this invention, the server includes a means for recognizing the user's emotional state, a means for personalizing the application form content and procedures according to the emotional state, and a means for retrieving additional information from a database based on the information received by the server. This allows the user to proceed with the application process with peace of mind and enables smooth application completion. Furthermore, the server also realizes rapid and accurate application form generation and provision of a download link.

[1210] "Means for receiving user-input information" refers to interfaces and devices for receiving user-input information in digital form.

[1211] The "means for transmitting the information to the server" refers to a communication protocol and device for transferring the information entered by the user to the server via a network.

[1212] "Means for recognizing the user's emotional state" refers to technology and devices for detecting emotions from the user's facial expressions, voice, gestures, etc., and analyzing that state as digital data.

[1213] The "means for personalizing the contents of the application form and procedures according to the emotional state" refers to an algorithm and device for individually adjusting the contents of the application form and instructions for the procedures based on the user's emotional data.

[1214] "Means for obtaining additional information from a database based on the information received by the server" refers to a system and process by which the server uses the information received from the user to search the corresponding database and obtain related supplemental information.

[1215] "Means for automatically generating an application" refers to software and processing equipment that automatically generates a formatted application using information provided by a user and additional information retrieved from a database.

[1216] The "means for providing the generated application form to the user" refers to an interface and system for providing the automatically generated application form in a format that can be viewed or downloaded by the user.

[1217] "Means for validating the format of information received by the server" refers to the algorithms and processes used by the server to verify whether the data received from the user is in the correct format.

[1218] The "means for generating an error message when a condition is not met based on the verification result" refers to software and a system for sending an error message to a user when a condition is not met as a result of the formal verification of data.

[1219] "Means for saving the generated application form in PDF format" refers to software and a system for converting the generated application form into a file in the versatile and highly storable PDF format and saving it.

[1220] The "means for providing a user with a download link for the application form" refers to an interface and system for providing a user with an access link for the generated application form, allowing the user to download the application form.

[1221] This invention is a system that allows users to easily and effectively generate official application forms. The system mainly consists of a user terminal, emotional state recognition technology, a server, a database, and an automatic generation algorithm.

[1222] User's device

[1223] A smartphone is used as an interface for users to input information. A dedicated application is installed and an information input form is displayed.

[1224] Technology to recognize emotional states

[1225] The user's device is equipped with a camera and microphone, which are used to recognize the user's emotions. For example, open-source emotion recognition libraries are used to collect emotion data from the user's facial expressions and voice tone.

[1226] server

[1227] The server performs the following process.

[1228] 1. Receive information sent from the user's device, including the user's emotional data.

[1229] 2. Verify the validity of the information received, for example, by checking that all required fields have been completed.

[1230] 3. If valid, retrieve additional information from a database, for example, from applications previously submitted by the user.

[1231] 4. Automatically generate application forms based on information and emotion data, and personalize content and procedural instructions based on emotion data.

[1232] 5. Save the generated application form in PDF format and provide the user with a download link.

[1233] Data processing and calculation

[1234] Specifically, the following technologies are used:

[1235] Emotion recognition technology: Libraries such as EmotionRecognizer are used.

[1236] Data validation techniques: Regular expressions and data type checks are used to ensure the validity of received data.

[1237] PDF generation technology: Use the FPDF library or similar to save the generated application form in PDF format.

[1238] Communication technology: The HTTPS protocol is used to securely transmit user data to the server.

[1239] For example, when applying for a security clearance from the police, a user opens the application and enters necessary information such as their name, date of birth, and security ID. At the same time, emotional data is collected via the camera and microphone and sent to the server. The server automatically generates an application form based on this data, saves it in PDF format, and provides a download link to the user.

[1240] Example prompt for a generative AI model:

[1241] "Please generate a security clearance application form. The user name is Yamada Taro, the date of birth is January 1, 1990, and the security ID is XYZ12345. The user's emotional state is unstable. I would like the application form to be simplified based on the user's emotional state."

[1242] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1243] Step 1:

[1244] Accepts information entered by the user

[1245] The user launches the smartphone application and enters the necessary information (such as name, date of birth, and security ID). The device then uses the camera and microphone to collect the user's facial expressions and voice tone, and obtains emotional data.

[1246] Input: User information, emotion data

[1247] Output: Initial data saved in the device

[1248] Step 2:

[1249] Sending the information to a server

[1250] The device converts the information and emotion data entered by the user into JSON format and sends it to the server using the secure HTTPS protocol.

[1251] Input: Initial data in the device (user information, emotion data)

[1252] Output: Send data to the server

[1253] Step 3:

[1254] Verifying data validity on the server

[1255] The server validates the information it receives, for example by ensuring all required fields are filled in and the format is correct.

[1256] Input: Data sent to the server

[1257] Output: Validity check result (pass / error)

[1258] Step 4:

[1259] Processing data based on validation results

[1260] If the validation check passes, the server accesses a database to retrieve additional information based on the information provided by the user, such as past application history.

[1261] Input: Validated user information

[1262] Output: Additional information retrieved from the database

[1263] Step 5:

[1264] Personalization and automatic application generation based on emotion data

[1265] The server takes emotion data into consideration and personalizes the application form and procedures. Based on the emotion data, the application form is automatically generated after adjusting the wording and procedural instructions.

[1266] Input: Additional information and emotion data

[1267] Output: Personalized application form (PDF format)

[1268] Step 6:

[1269] Save the generated application form and provide it to the user

[1270] The server saves the generated application form in PDF format and generates a download link that the user can access. The server returns this link to the device so that the user can download the application form.

[1271] Input: Personalized Application Form

[1272] Output: Provide download link

[1273] Step 7:

[1274] User obtains application form

[1275] The user accesses the link sent from the server via their device and downloads the generated application form. They can then check the contents of the downloaded application form and print or sign it as necessary.

[1276] Input: Download link

[1277] Output: Application form saved to the user's computer

[1278] The above steps enable the automatic generation and provision of personalized application forms according to the user's emotional state.

[1279] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1280] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1281] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1282] [Fourth embodiment]

[1283] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1284] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1285] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1286] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1287] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1288] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1289] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1290] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1291] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1292] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1293] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1294] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1295] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1296] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[1297] This system is composed of the following main components: user terminals, a server, and a database.

[1298] User

[1299] First, the user accesses a dedicated application or website using a device. The user is then presented with a form to enter the necessary information (name, date of birth, address, driver's license number, etc.). When the user enters the necessary information into the form and presses the send button, the device sends the input data to the server.

[1300] Terminal

[1301] The terminal receives the information entered by the user and converts it into an appropriate data format, such as JSON or XML, and then transmits the converted data securely to the server over the network using a protocol such as HTTPS.

[1302] server

[1303] When the server receives the input data, it first validates the data, checking whether the input data is in the correct format and whether any required fields are missing. If validation is successful, the server accesses a database to retrieve additional information related to the information provided by the user. For example, it may extract past application history and other relevant data. Using this information, the server uses a template engine to automatically generate an application form.

[1304] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[1305] User (after provision)

[1306] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then sends the application form to the designated submission address or submits it online.

[1307] Specific examples

[1308] For example, consider the case of applying for driver's license renewal. A user accesses a website and enters the required information (such as name, date of birth, and current license number), and their device sends that information to a server. The server validates the information and retrieves relevant information from a database (such as past violation history). Using this information, the server automatically generates a license renewal application form and provides it to the user in PDF format. The user then downloads and prints the application, signs it, fills in the necessary fields, and submits it.

[1309] The present invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[1310] The processing flow will be explained below.

[1311] Step 1:

[1312] The user accesses a dedicated application or website and is presented with a form to fill out.

[1313] Step 2:

[1314] The user enters the required information such as name, date of birth, address, driver's license number, etc. into the displayed form and clicks the submit button.

[1315] Step 3:

[1316] The device receives information entered by the user and converts it into JSON or XML format data.

[1317] Step 4:

[1318] The terminal sends the converted data to the server using the HTTPS protocol.

[1319] Step 5:

[1320] The server receives the HTTPS request and parses the data sent.

[1321] Step 6:

[1322] Validate the data parsed by the server, ensuring all required fields are filled in and the data is formatted correctly.

[1323] Step 7:

[1324] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[1325] Step 8:

[1326] The server combines the additional information acquired with the information provided by the user and automatically generates an application form using a template engine.

[1327] Step 9:

[1328] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[1329] Step 10:

[1330] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[1331] Step 11:

[1332] The terminal receives the response from the server and displays the download link on the user interface.

[1333] Step 12:

[1334] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[1335] Step 13:

[1336] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[1337] Step 14:

[1338] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[1339] Example 1

[1340] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1341] The traditional process of creating official application forms is time-consuming and laborious, with a high risk of reapplication due to input errors or incomplete data. Furthermore, creating application forms requires a lot of manual work, hindering the speed of application procedures. Therefore, there is a need for a system that streamlines the creation of official application forms and reduces the burden on users.

[1342] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1343] In this invention, the server includes means for receiving information entered by a user, means for the terminal to convert the information into an appropriate data format and transmit it to the server, means for the server to retrieve additional information from a database based on the received information, means for automatically generating an application form using a template engine based on the retrieved information, and means for saving the generated application form in PDF format and generating a download link for it to provide to the user. This makes it possible to automate the time-consuming process of creating application forms, reducing the burden on users and enabling quick and accurate application procedures.

[1344] "User" means an individual or legal entity that utilizes the System to enter information and complete official applications.

[1345] A "terminal" is a device (e.g., computer, smartphone, tablet) that a user uses to enter information.

[1346] A "server" is a computer system that receives data sent from a terminal, processes it, and automatically generates an application form.

[1347] The "means for receiving information" is an interface for acquiring data such as name, date of birth, address, and driver's license number provided by the user.

[1348] "Means of converting into data format" refers to the process of converting information obtained from the user into an appropriate format such as JSON or XML.

[1349] The "means of transmission" is a protocol for transmitting the converted data to the server in a secure manner, such as the HTTPS protocol.

[1350] "Database" refers to a data storage system used by the server to manage past application history and related information.

[1351] The "means for obtaining additional information" is the process by which the server accesses the database to search for and obtain the required information.

[1352] A "template engine" is a software component that embeds acquired data into an application form template.

[1353] The "means for automatically generating an application form" is a process for creating an application form by using a template engine to fill in the necessary data.

[1354] "Saving in PDF format" refers to the process of saving the automatically generated application form to a file in Portable Document Format (PDF).

[1355] The "means for generating a download link" is the process of creating an access link to the generated PDF file and providing it to the user.

[1356] The present invention relates to a system that automatically generates official application forms by linking information entered by a user when the user inputs the necessary information. This system streamlines official procedures by automatically generating application forms based on the input data provided by the user and providing them to the user.

[1357] This system includes the following main components: a user terminal, a server, and a database. Specifically, they are as follows:

[1358] User

[1359] A user accesses a dedicated application or website using a device. A web form is displayed, and the user enters the necessary information, such as name, date of birth, address, driver's license number, etc. Once the information is entered, the user presses a submit button, and the input data is sent to the server via the device.

[1360] Terminal

[1361] The device uses JavaScript or other client-side scripts to convert user-entered information into JSON or XML format, after which the data is securely transmitted to the server using the HTTPS protocol.

[1362] server

[1363] The server receives the data using Python's Flask framework or a similar web framework. First, it validates the data, checking that the data format is correct and that required fields are not missing. If the error check is successful, the server accesses the database and retrieves relevant information from an SQL database such as MySQL or PostgreSQL. Based on the retrieved information, the server uses a template engine such as Jinja2 to automatically generate an application form. The generated application form is converted to PDF format using a library such as WeasyPrint or wkhtmltopdf and saved. A download link for the PDF file is generated and sent back to the terminal.

[1364] User (after provision)

[1365] The user accesses the link returned from the server via their device and downloads the generated application form. After downloading, the user opens the file, checks the contents, signs and stamps the application as required, and finally sends the application to the designated submission address or submits it online.

[1366] Specific examples

[1367] Consider the case of applying for a driver's license renewal. A user accesses a website and enters the required information (name, date of birth, current license number, etc.). The input data is converted to JSON format by the terminal and sent to the server via the HTTPS protocol. The server verifies the validity of the data and retrieves related information such as past violation history from a database. Using a template engine, a license renewal application form is automatically generated and provided to the user in PDF format. The user downloads the application form, prints it, signs it, fills in the necessary fields, and submits it.

[1368] An example prompt sentence for a specific implementation of this system is as follows:

[1369] Prompt: I am developing a program to automatically generate driver's license renewal application forms. The user enters the necessary information, such as name, date of birth, address, and driver's license number, and the server retrieves past application history data and generates the application form based on that information. This requires integration with a template engine and a database.

[1370] This invention eliminates the need to manually create application forms, enabling accurate and speedy application procedures. Furthermore, because error checks and other procedures are performed automatically, the risk of having to reapply due to input errors is reduced.

[1371] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1372] Step 1:

[1373] The user accesses a dedicated application or website and enters the necessary information into a form, such as their name, date of birth, address, driver's license number, etc. After entering the information, they press the send button, and the form data is sent to the device.

[1374] Input: Information entered by the user (name, date of birth, address, driver's license number).

[1375] Data processing: None.

[1376] Output: The form data is sent to the terminal.

[1377] What happens: A user fills in the fields of a web form and clicks the submit button.

[1378] Step 2:

[1379] The device retrieves the information received from the user and converts it into JSON or XML format using a client-side script such as JavaScript.

[1380] Input: The data in the form.

[1381] Data processing: Convert the data obtained from the form into JSON or XML format.

[1382] Output: The transformed JSON or XML data.

[1383] Specific behavior: JavaScript code retrieves the form data and converts it to JSON format using a method such as JSON.stringify().

[1384] Step 3:

[1385] The terminal transmits the converted data to the server using the HTTPS protocol.

[1386] Input: The transformed JSON or XML data.

[1387] Data processing: None.

[1388] Output: The HTTP request sent to the server.

[1389] Specific behavior: Creates and sends an HTTP POST request containing the converted data using the XMLHttpRequest or Fetch API.

[1390] Step 4:

[1391] The server receives the data sent from the device, analyzes it using Python's Flask framework, and verifies its validity by checking whether the data format is correct and whether all required fields are filled in.

[1392] Input: HTTP request data (JSON or XML) arriving at the server.

[1393] Data processing: Validating data format, checking required fields.

[1394] Output: Validation result (success or error message).

[1395] What happens: The Flask application receives the request and uses a JSON parser to check the data format and ensure required fields are present.

[1396] Step 5:

[1397] If the server successfully validates the data, it accesses the database to obtain additional information about the user, such as past application history, from a database system such as MySQL or PostgreSQL.

[1398] Input: Validated user data.

[1399] Data manipulation: Performing database queries to find and retrieve additional information.

[1400] Output: Additional information (such as past application history).

[1401] Specific operation: Executes an SQL query (e.g. SELECT FROM user_history WHERE user_id = ?) and retrieves the results.

[1402] Step 6:

[1403] The additional information obtained by the server is inserted into the application form template using a template engine (e.g. Jinja2) and the application form is automatically generated.

[1404] Input: Verified user data, additional information retrieved from database.

[1405] Data processing: Use a template engine to embed data into the application format.

[1406] Output: The generated application form (in HTML format).

[1407] What it does: Renders data into Jinja2 templates and intelligently composes the generated HTML.

[1408] Step 7:

[1409] The server converts the generated application form into PDF format and saves it using libraries such as WeasyPrint and wkhtmltopdf.

[1410] Input: Generated application form (HTML format).

[1411] Data processing: Convert HTML data into PDF format and save it on the server.

[1412] Output: PDF file.

[1413] What it does: Uses the WeasyPrint library to generate a PDF from an HTML template and saves it to the file system.

[1414] Step 8:

[1415] The server generates a download link for the PDF file and returns the link to the device.

[1416] Input: PDF file.

[1417] Data processing: Download link generation.

[1418] Output: Download link.

[1419] Specific operation: The server generates a link and returns JSON data containing link information to the device as an HTTP response.

[1420] Step 9:

[1421] The user accesses the download link provided by the server through their device and downloads the generated application form. After downloading, the user opens the file and checks its contents.

[1422] Input: Download link.

[1423] Data processing: None.

[1424] Output: Download PDF file.

[1425] What happens: The user clicks on the download link and the browser automatically starts downloading the PDF file.

[1426] Step 10:

[1427] The user signs and stamps the generated application form as required and sends it to the designated submission destination, or submits it online.

[1428] Input: The downloaded PDF file.

[1429] Data processing: None.

[1430] Output: Signed and stamped application form.

[1431] Specific behavior: The user prints the PDF file, signs or stamps it as required, and then submits it by mail or online.

[1432] (Application example 1)

[1433] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1434] Conventional public application systems require users to manually enter information and scan documents individually, which is inefficient and prone to errors. They also have environment-dependent issues, making it difficult to instantly create applications on the go. This makes it difficult to respond to unexpected application processing situations.

[1435] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1436] In this invention, the server includes a means for receiving information input by voice commands or gestures, a means for scanning documents using a built-in camera and performing optical character recognition, and a means for providing the generated application form to the user, thereby enabling the user to automatically generate application forms in real time using the smart glasses and complete official procedures quickly and efficiently.

[1437] "Voice instruction" refers to a method in which a user gives instructions to a device using voice.

[1438] A "gesture" is a method of giving instructions to a device using hand and finger movements.

[1439] An "integrated camera" is a camera built into a device that has the ability to capture images and videos.

[1440] "Optical character recognition" is a technology that automatically identifies characters from images or scanned documents and converts them into text data.

[1441] An "application form" is an official document required for an official procedure, containing specific information and having a prescribed format.

[1442] "Server" means a computer system that processes information received from users and stores, manages, and provides data.

[1443] A "digital signature" is a signature made by electronic means and is used to certify the legitimacy and authenticity of a document.

[1444] The system of the present invention allows users to input necessary information using voice commands or gestures, scan documents with a built-in camera, and automatically generate and provide application forms on a server. The system is composed of smart glasses with voice command and gesture recognition functions, a built-in camera, OCR (optical character recognition), a server, and software with digital signature functionality.

[1445] First, the user puts on the smart glasses and inputs the necessary information into the system using voice commands and gestures. The smart glasses are equipped with a built-in camera, which is used to scan documents. The scanned image is then converted into text data using OCR technology. Pytesseract can be used for this OCR process.

[1446] The server receives the input data provided by the user and the data extracted by OCR. It converts this data into an appropriate format and retrieves additional information from a database, such as past application history and other relevant information. This process uses a template engine to automatically generate the application form.

[1447] The generated application form is saved in PDF format and a link is provided to the user, who can view the link on the smart glasses display and digitally sign it if necessary. The digital signature is encrypted to ensure security.

[1448] As a concrete example, consider a case where a user applies for a visa while on the go. The user uses smart glasses to enter the necessary information using voice commands and scans their passport and other necessary documents with the built-in camera. The server automatically generates an application form in real time and provides the user with a link in PDF format. The user can then review the generated application form on the smart glasses' display and digitally sign it to instantly complete the application process.

[1449] Example prompt sentence:

[1450] Create a system that automatically generates official application forms by having the user enter the necessary information. The user uses smart glasses to input information using voice commands and gestures, and scans the necessary documents with the built-in camera. This information is sent to a server that automatically generates the application form and provides it to the user in PDF format.

[1451] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1452] Step 1:

[1453] The user puts on the smart glasses and inputs the necessary information using voice commands or gestures. The information entered by the user (such as name, date of birth, and address) is then stored in the smart glasses' internal system.

[1454] Input: User's voice commands or gesture operations

[1455] Output: Required information entered by the user

[1456] How it works: The smart glasses' voice and gesture recognition software analyzes the user's instructions and generates appropriate input data.

[1457] Step 2:

[1458] Users scan the required documents using the built-in camera, which captures an image of the document and converts it into text data using OCR technology.

[1459] Input: Image of document taken with built-in camera

[1460] Output: Text data converted by OCR

[1461] Specific operation: A document is photographed using the built-in camera on the smart glasses, and the image is subjected to OCR processing using pytesseract to extract text data.

[1462] Step 3:

[1463] The smart glasses convert the user's input data and scanned text data into JSON format and send it to the server.

[1464] Input: User input data, text data obtained by OCR processing

[1465] Output: Data converted to JSON format

[1466] How it works: The smart glasses' internal software converts the input data into JSON format and sends it to the server using the HTTPS protocol.

[1467] Step 4:

[1468] The server receives the data sent by the user, verifies its format, and if the data format is not correct, generates an error message and returns it to the terminal.

[1469] Input: JSON format data sent by the user

[1470] Output: Validation result (success or error message)

[1471] Specific behavior: The server verifies whether the received data is formatted correctly and checks whether required fields exist. If the required conditions are not met, it generates and returns an error message.

[1472] Step 5:

[1473] The server accesses a database with the appropriately formatted data to retrieve additional information, such as past filing history and relevant legal information.

[1474] Input: Properly validated user data

[1475] Output: Additional information retrieved from the database

[1476] Specific Actions: The server performs a database query to extract any additional information required.

[1477] Step 6:

[1478] The server automatically generates an application form using a template engine based on the acquired information, and the generated application form is saved in PDF format.

[1479] Input: User data and additional information from the database

[1480] Output: Automatically generated PDF application form

[1481] Specific operation: The server's template engine generates an application form based on the data and saves it in PDF format using the PDF library.

[1482] Step 7:

[1483] The server sends a download link for the generated application form back to the user's device, where the user can view the link on the smart glasses display.

[1484] Input: Application form saved in PDF format

[1485] Output: Download link

[1486] Specific operation: The server saves the generated PDF file and generates a download link to send to the user's smart glasses.

[1487] Step 8:

[1488] The user checks the download link through the smart glasses, downloads, views, and confirms the application form, and if necessary, digitally signs it.

[1489] Input: Download link

[1490] Output: Application form reviewed and digitally signed by the user

[1491] Specific operation: The user operates the smart glasses display to download and review the generated PDF application form and digitally sign it.

[1492] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1493] The present invention relates to a system that automatically generates official application forms by linking the information entered by the user as required. Furthermore, the present invention incorporates an emotion engine that recognizes the user's emotions, and personalizes the contents and procedures of the application form according to the user's emotional state.

[1494] This system consists of the following main components: the user's terminal, a server, a database, and an emotion engine.

[1495] User

[1496] The user uses the device to access a dedicated application or website, which displays a form for the user to enter necessary information. The device then collects data via the camera and microphone to recognize the user's emotions. When the user enters the necessary information in the form and clicks the submit button, the device sends the input data and emotional data to the server.

[1497] Terminal

[1498] The device receives information entered by the user and converts it into an appropriate data format, such as JSON or XML. The converted data also includes the user's emotional data recognized by the emotion engine. The emotional data is used to identify the user's emotional state from their facial expressions and tone of voice using image processing and voice analysis technology. The converted data is then securely transmitted to the server via the network using protocols such as HTTPS.

[1499] server

[1500] When the server receives the input data, it first verifies the validity of the data. It checks whether the input data is in the correct format and whether any required fields are missing. If the validation is successful, the server accesses the database to obtain additional relevant information based on the information provided by the user. Taking into account the obtained information as well as the user's emotional data, the server automatically generates an application form. Based on the emotional data, the server personalizes the content and procedures of the application form. For example, if the user is in a hurry, it may simplify the instructions for the procedure.

[1501] The server saves the generated application form in PDF format or other format and generates a download link for it, which is then sent back to the device so that the user can access it.

[1502] User (after provision)

[1503] The user accesses the link returned from the server via their device and downloads the generated application form. The user opens the downloaded file and checks the contents. If necessary, they print the application form and sign or stamp it. The user then submits the application form to the designated location or submits it online.

[1504] Specific examples

[1505] For example, consider the case of applying to renew a driver's license. When a user accesses a website and enters the necessary information (such as name, date of birth, and current license number), the emotion engine detects the user's level of stress from their facial expressions and voice. The device then sends this information to a server. The server then verifies the information entered and retrieves relevant information from a database (such as past violation history). Based on the emotion data, a personalized application form is automatically generated, with shortened instructions and other modifications to ensure the process goes smoothly. The generated application form is provided to the user in PDF format, who then downloads it, prints it, and submits it.

[1506] The present invention eliminates the manual work of filling out application forms, providing accurate and speedy application procedures. In addition, by utilizing an emotion engine, it reduces the psychological burden on users and provides a more user-friendly experience.

[1507] The processing flow will be explained below.

[1508] Step 1:

[1509] The user accesses a dedicated application or website and is presented with a form to fill out.

[1510] Step 2:

[1511] The device uses a camera and microphone to collect facial and voice data from the user, allowing it to recognize the user's emotional state in real time.

[1512] Step 3:

[1513] The user enters the required information such as name, date of birth, address, and driver's license number into the form and clicks the submit button.

[1514] Step 4:

[1515] The device receives information input by the user and converts the received information and emotion data into JSON or XML format data.

[1516] Step 5:

[1517] The terminal sends the converted data to the server using the HTTPS protocol.

[1518] Step 6:

[1519] The server receives the HTTPS request and parses the data sent.

[1520] Step 7:

[1521] Validate the data parsed by the server, ensuring that the input data is in the correct format and that all required fields are filled in.

[1522] Step 8:

[1523] The server analyzes the emotional data and determines the user's emotional state (e.g., stress, impatience, anger, etc.).

[1524] Step 9:

[1525] Based on the data that the server has successfully validated, it accesses a database to retrieve any additional information it needs, such as past application history or other relevant information.

[1526] Step 10:

[1527] The server combines the additional information acquired with the information provided by the user and uses a template engine to automatically generate an application form. The content of the application form and instructions are personalized based on emotion data.

[1528] Step 11:

[1529] The server saves the generated application form in PDF format, and stores the file in cloud storage or on a file server if necessary.

[1530] Step 12:

[1531] The server generates a download link for the saved PDF file and returns a response containing that link to the terminal.

[1532] Step 13:

[1533] The terminal receives the response from the server and displays the download link on the user interface.

[1534] Step 14:

[1535] The user clicks the download link displayed on the device and downloads the generated application form (PDF file).

[1536] Step 15:

[1537] The user opens the downloaded PDF file, checks the contents, and, if necessary, prints it and signs or stamps the application form.

[1538] Step 16:

[1539] The user submits the completed application to the designated location. If necessary, online submission is also possible.

[1540] In this way, the present invention provides a process for automatically generating application forms that takes into account the user's emotions. Because the instructions and application form content are personalized based on the user's emotion data, the user can complete the application process more comfortably and without stress.

[1541] Example 2

[1542] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1543] Conventional systems require users to manually create application forms, which takes a lot of time and effort. Furthermore, they are unable to consider the user's emotional state while creating the application, resulting in a poor user experience. Furthermore, if the information entered by the user is incorrectly formatted, the application form based on that information may be inaccurate. To address these issues, a system is needed that can appropriately process the user's input information and emotional data and automatically generate personalized application forms.

[1544] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1545] In this invention, the server includes means for converting information entered by a user into an appropriate data format, means for collecting user emotion data, and means for transmitting the information and emotion data and retrieving additional information from a database. This makes it possible to personalize the contents of the application form based on the user emotion data and automatically generate application forms efficiently and accurately.

[1546] The "means for receiving information input by a user" is an interface for collecting information input by a user via a terminal.

[1547] "Means for converting into an appropriate data format" refers to the process or tool used to convert user-entered information into a data format (e.g., JSON or XML) that can be processed and transmitted by the system.

[1548] "Means for collecting user emotional data" refers to technology for identifying and collecting the user's emotional state from facial expressions and voice using devices such as cameras and microphones.

[1549] "Means for transmitting information and emotional data to the server" refers to a communication protocol or network for securely transmitting the user's input information and emotional data from the terminal to the server.

[1550] The "means by which the server obtains additional information from the database based on the information received" refers to a query or index function that allows the server to search and obtain the necessary data from the database based on the information input by the user.

[1551] The "means for automatically generating an application form based on acquired information and emotional data" refers to an algorithm that automatically creates an application form in accordance with a specific format, taking into account the information acquired by the server from the database and the user's emotional data.

[1552] "Means for providing the generated application form to the user" refers to a function that allows the generated application form to be saved in a PDF or other digital format and provided as a link or file that the user can download or access.

[1553] "Means for validating the format of information received by the server" means the process or tools by which the server checks the format and content of data sent by users to detect inaccurate or incomplete data.

[1554] "Means for generating an error message if the conditions are not met based on the validation results" is a function for creating and sending an error message to the user if the data format or content does not meet the server's standards.

[1555] "Means for personalizing the contents of application forms and procedures based on the user's emotional data" refers to technology that appropriately adjusts the contents of application forms and explanations of procedures according to the user's emotional state, providing them in a way that is easy for the user to understand and that reduces stress.

[1556] The "means for saving the generated application form in PDF format" is a function for saving the generated application form as a PDF file so that the user can easily access and download it.

[1557] This invention relates to a system that automatically generates official application forms by linking information entered by a user. Furthermore, this invention incorporates an emotion engine that recognizes the user's emotions, personalizing the application form content and procedures according to the user's emotional state. This system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[1558] User terminal operation

[1559] A user accesses a dedicated application or website using a device such as a PC or smartphone. They enter necessary information such as their name, date of birth, and address into a form displayed on the device. The device also uses a camera and microphone to collect the user's facial expressions and voice in real time, which are recognized as emotional data. When the user enters the necessary information into the form and clicks the submit button, the device sends the input data and emotional data to a server.

[1560] As a concrete example, consider the case where a user renews their driver's license. The user accesses a website and enters the necessary information, such as their name, date of birth, and license number, into a form. The device's camera then analyzes the user's facial expressions and uses an emotion engine to detect whether the user is anxious. This information is then sent to the server.

[1561] Device Role

[1562] After receiving the information entered by the user, the device converts it into JSON or XML format. This converted data also includes the user's emotional data analyzed by the emotion engine. Emotional data is identified from the user's facial expressions and tone of voice using image processing and voice analysis technology. The device then securely transmits the converted data to the server using the HTTPS protocol.

[1563] Server Operation

[1564] The server receives the data sent from the device. First, it validates the data, ensuring that the input data is in the correct format and that required fields are not missing. Next, the server accesses a database to retrieve additional relevant information based on the information provided by the user. In addition, the server takes into account emotional data and automatically generates an application form. For example, if the user is in a hurry, it can simplify the instructions for the procedure and provide other personalized information.

[1565] In a specific example, when applying for a driver's license renewal, the server retrieves the user's past violation history from the database and creates an application form by shortening the instructions based on the user's emotional state. The created application form is saved in PDF format and a download link is generated. This link is sent back to the device so the user can access it.

[1566] User operations (after provision)

[1567] The user accesses the download link returned from the server via their device and downloads the generated application form. They then check the contents of the downloaded application form and sign or stamp it as necessary. Finally, they submit the application form to the designated location or complete the submission online.

[1568] Prompt Sentence Examples

[1569] An example of a prompt to be input to the generative AI model is as follows:

[1570] "Please automatically generate the application form I need when I renew my driver's license. I have listed my name, date of birth, and current license number below. Please shorten the instructions to reduce user stress. Please also retrieve past violation history from the database and reflect it."

[1571] This invention eliminates the manual work of filling out application forms and provides accurate and speedy application procedures. Furthermore, by utilizing an emotion engine, it aims to reduce the psychological burden on users and provide a more user-friendly experience.

[1572] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1573] Step 1:

[1574] The user enters information

[1575] The user accesses a dedicated application or website using their device and enters the necessary information such as name, date of birth, and address. Specifically, they enter information such as "Taro Tanaka," "January 1, 1980," and "123-456 Shibuya-ku, Tokyo" into the form. Once the information is complete, they click the submit button.

[1576] Input data (name, date of birth, address) is collected and this data is sent as output to the next processing step.

[1577] Step 2:

[1578] Collect user sentiment data

[1579] The device uses a camera and microphone to collect the user's facial expressions and voice in real time. Specifically, the camera captures the user's facial expressions and the microphone records the tone of voice. The emotion engine analyzes this data and identifies the user's emotional state. For example, if the user is anxious, emotion data is generated.

[1580] The input is camera footage and microphone audio data, and the output is emotion data (e.g., impatience).

[1581] Step 3:

[1582] Converting data into the appropriate format

[1583] The device receives user input and emotion data and converts it into JSON or XML format, including name, date of birth, address, and emotion data.

[1584] It receives input data (user input, emotion data) and converts it into the following output format:

[1585] json

[1586] {

[1587] "name": "Taro Tanaka",

[1588] "birth_date": "1980-01-01",

[1589] "address": "123-456, Shibuya-ku, Tokyo",

[1590] "emotion": "stressed"

[1591] }

[1592] Step 4:

[1593] Sending data to the server

[1594] The device sends the converted data to the server using the HTTPS protocol, which uses encryption to ensure security.

[1595] The input is the converted data (JSON format), and the output is secure transmission to the server.

[1596] Step 5:

[1597] The server receives the data

[1598] The server validates the data it receives by checking that it is in the correct format and that required fields are not missing. For example, it checks that "Name" and "Date of Birth" are present and complete.

[1599] The input is the received data (JSON format) and the output is the validity verification result.

[1600] Step 6:

[1601] Retrieving relevant information from a database

[1602] The server accesses the database and retrieves additional relevant information based on the information provided by the user, such as a driver's license renewal, including any previous violations.

[1603] The input is the user's basic information, and the output is additional information retrieved from the database.

[1604] Step 7:

[1605] Generate an application form

[1606] The server automatically generates an application form based on the information and emotion data it acquires. For example, if the user is feeling anxious, it will simplify the instructions for the procedure. The generated application form is saved in PDF format.

[1607] The input is the acquired additional information and emotion data, and the output is an automatically generated PDF application form.

[1608] Step 8:

[1609] Generate a download link for the application form

[1610] The server saves the generated application form and generates a download link for it. For example, a link like "https: / / example.com / download / tanaka_form.pdf" is generated.

[1611] The input is the generated PDF file and the output is the download link.

[1612] Step 9:

[1613] Send the link to users

[1614] The server returns the generated download link to the device, and the user accesses this link to download the application form.

[1615] The input is a download link, and the output is sending the link to the user's device.

[1616] Step 10:

[1617] User downloads application form

[1618] The user accesses the link returned from the server using their device and downloads the application form. The user then checks the downloaded application form and signs or stamps it.

[1619] The input is the download link and the output is the downloaded application form.

[1620] Step 11:

[1621] User submits application

[1622] After the user has signed or stamped the downloaded application form as required, the user submits the application form to the designated location or submits it online.

[1623] The input is the downloaded application and the output is the submitted application.

[1624] This system aims to improve the efficiency of application procedures by minimizing the user's effort at each step and reflecting emotional data.

[1625] (Application example 2)

[1626] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1627] Many conventional public application generation systems automatically generate application forms based on information entered by users, but do not provide personalized support that takes into account the user's emotional state. This can cause users to feel stressed or anxious, making it difficult for them to understand and complete the procedures. Furthermore, users are often hesitant to download the generated application form because they are not provided with a download link. These issues need to be addressed.

[1628] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1629] In this invention, the server includes a means for recognizing the user's emotional state, a means for personalizing the application form content and procedures according to the emotional state, and a means for retrieving additional information from a database based on the information received by the server. This allows the user to proceed with the application process with peace of mind and enables smooth application completion. Furthermore, the server also realizes rapid and accurate application form generation and provision of a download link.

[1630] "Means for receiving user-input information" refers to interfaces and devices for receiving user-input information in digital form.

[1631] The "means for transmitting the information to the server" refers to a communication protocol and device for transferring the information entered by the user to the server via a network.

[1632] "Means for recognizing the user's emotional state" refers to technology and devices for detecting emotions from the user's facial expressions, voice, gestures, etc., and analyzing that state as digital data.

[1633] The "means for personalizing the contents of the application form and procedures according to the emotional state" refers to an algorithm and device for individually adjusting the contents of the application form and instructions for the procedures based on the user's emotional data.

[1634] "Means for obtaining additional information from a database based on the information received by the server" refers to a system and process by which the server uses the information received from the user to search the corresponding database and obtain related supplemental information.

[1635] "Means for automatically generating an application" refers to software and processing equipment that automatically generates a formatted application using information provided by a user and additional information retrieved from a database.

[1636] The "means for providing the generated application form to the user" refers to an interface and system for providing the automatically generated application form in a format that can be viewed or downloaded by the user.

[1637] "Means for validating the format of information received by the server" refers to the algorithms and processes used by the server to verify whether the data received from the user is in the correct format.

[1638] The "means for generating an error message when a condition is not met based on the verification result" refers to software and a system for sending an error message to a user when a condition is not met as a result of the formal verification of data.

[1639] "Means for saving the generated application form in PDF format" refers to software and a system for converting the generated application form into a file in the versatile and highly storable PDF format and saving it.

[1640] The "means for providing a user with a download link for the application form" refers to an interface and system for providing a user with an access link for the generated application form, allowing the user to download the application form.

[1641] This invention is a system that allows users to easily and effectively generate official application forms. The system mainly consists of a user terminal, emotional state recognition technology, a server, a database, and an automatic generation algorithm.

[1642] User's device

[1643] A smartphone is used as an interface for users to input information. A dedicated application is installed and an information input form is displayed.

[1644] Technology to recognize emotional states

[1645] The user's device is equipped with a camera and microphone, which are used to recognize the user's emotions. For example, open-source emotion recognition libraries are used to collect emotion data from the user's facial expressions and voice tone.

[1646] server

[1647] The server performs the following process.

[1648] 1. Receive information sent from the user's device, including the user's emotional data.

[1649] 2. Verify the validity of the information received, for example, by checking that all required fields have been completed.

[1650] 3. If valid, retrieve additional information from a database, for example, from applications previously submitted by the user.

[1651] 4. Automatically generate application forms based on information and emotion data, and personalize content and procedural instructions based on emotion data.

[1652] 5. Save the generated application form in PDF format and provide the user with a download link.

[1653] Data processing and calculation

[1654] Specifically, the following technologies are used:

[1655] Emotion recognition technology: Libraries such as EmotionRecognizer are used.

[1656] Data validation techniques: Regular expressions and data type checks are used to ensure the validity of received data.

[1657] PDF generation technology: Use the FPDF library or similar to save the generated application form in PDF format.

[1658] Communication technology: The HTTPS protocol is used to securely transmit user data to the server.

[1659] For example, when applying for a security clearance from the police, a user opens the application and enters necessary information such as their name, date of birth, and security ID. At the same time, emotional data is collected via the camera and microphone and sent to the server. The server automatically generates an application form based on this data, saves it in PDF format, and provides a download link to the user.

[1660] Example prompt for a generative AI model:

[1661] "Please generate a security clearance application form. The user name is Yamada Taro, the date of birth is January 1, 1990, and the security ID is XYZ12345. The user's emotional state is unstable. I would like the application form to be simplified based on the user's emotional state."

[1662] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1663] Step 1:

[1664] Accepts information entered by the user

[1665] The user launches the smartphone application and enters the necessary information (such as name, date of birth, and security ID). The device then uses the camera and microphone to collect the user's facial expressions and voice tone, and obtains emotional data.

[1666] Input: User information, emotion data

[1667] Output: Initial data saved in the device

[1668] Step 2:

[1669] Sending the information to a server

[1670] The device converts the information and emotion data entered by the user into JSON format and sends it to the server using the secure HTTPS protocol.

[1671] Input: Initial data in the device (user information, emotion data)

[1672] Output: Send data to the server

[1673] Step 3:

[1674] Verifying data validity on the server

[1675] The server validates the information it receives, for example by ensuring all required fields are filled in and the format is correct.

[1676] Input: Data sent to the server

[1677] Output: Validity check result (pass / error)

[1678] Step 4:

[1679] Processing data based on validation results

[1680] If the validation check passes, the server accesses a database to retrieve additional information based on the information provided by the user, such as past application history.

[1681] Input: Validated user information

[1682] Output: Additional information retrieved from the database

[1683] Step 5:

[1684] Personalization and automatic application generation based on emotion data

[1685] The server takes emotion data into consideration and personalizes the application form and procedures. Based on the emotion data, the application form is automatically generated after adjusting the wording and procedural instructions.

[1686] Input: Additional information and emotion data

[1687] Output: Personalized application form (PDF format)

[1688] Step 6:

[1689] Save the generated application form and provide it to the user

[1690] The server saves the generated application form in PDF format and generates a download link that the user can access. The server returns this link to the device so that the user can download the application form.

[1691] Input: Personalized Application Form

[1692] Output: Provide download link

[1693] Step 7:

[1694] User obtains application form

[1695] The user accesses the link sent from the server via their device and downloads the generated application form. They can then check the contents of the downloaded application form and print or sign it as necessary.

[1696] Input: Download link

[1697] Output: Application form saved to the user's computer

[1698] The above steps enable the automatic generation and provision of personalized application forms according to the user's emotional state.

[1699] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1700] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1701] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1702] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1703] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1704] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1705] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1706] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1707] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1708] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1709] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1710] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1711] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1712] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1713] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1714] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1715] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1716] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1717] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1718] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1719] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1720] The following is further disclosed regarding the above embodiment.

[1721] (Claim 1)

[1722] means for receiving user input information;

[1723] means for transmitting the information to a server;

[1724] means for acquiring additional information from a database based on the information received by the server;

[1725] means for automatically generating an application form based on the acquired information;

[1726] means for providing the generated application to a user;

[1727] A system including:

[1728] (Claim 2)

[1729] means for verifying the format of the information received by the server;

[1730] and means for generating an error message if the condition is not met based on the verification result.

[1731] 10. The system of claim 1.

[1732] (Claim 3)

[1733] further comprising means for saving the generated application form in PDF format;

[1734] 10. The system of claim 1.

[1735] "Example 1"

[1736] (Claim 1)

[1737] means for receiving user input information;

[1738] means for converting the information into an appropriate data format by the terminal and transmitting the information to the server;

[1739] means for acquiring additional information from a database based on the information received by the server;

[1740] means for automatically generating an application form using a template engine based on the acquired information;

[1741] A means for saving the generated application form in PDF format and generating a download link for the application form and providing it to the user;

[1742] A system including:

[1743] (Claim 2)

[1744] means for the server to validate the format of the information received and check for missing required fields;

[1745] The method further includes means for generating an error message and notifying a user when the condition is not satisfied based on the verification result.

[1746] 10. The system of claim 1.

[1747] (Claim 3)

[1748] and means for a user to download and review the generated application.

[1749] 10. The system of claim 1.

[1750] "Application Example 1"

[1751] (Claim 1)

[1752] means for receiving information input by a user through voice commands or gestures;

[1753] means for scanning documents using an integrated camera and performing optical character recognition;

[1754] means for transmitting the information to a server;

[1755] means for acquiring additional information from a database based on the information received by the server;

[1756] means for automatically generating an application form based on the acquired information;

[1757] means for providing the generated application to a user;

[1758] A system including:

[1759] (Claim 2)

[1760] means for verifying the format of the information received by the server;

[1761] and means for generating an error message if the condition is not met based on the verification result.

[1762] 10. The system of claim 1.

[1763] (Claim 3)

[1764] further comprising means for allowing a user to digitally sign;

[1765] 10. The system of claim 1.

[1766] "Example 2: Combining Emotion Engines"

[1767] (Claim 1)

[1768] means for receiving user input information;

[1769] means for converting said information into a suitable data format;

[1770] means for collecting user emotion data;

[1771] means for transmitting the information and emotion data to a server;

[1772] means for acquiring additional information from a database based on the information received by the server;

[1773] means for automatically generating an application form based on the acquired information and emotion data;

[1774] means for providing the generated application to a user;

[1775] A system including:

[1776] (Claim 2)

[1777] means for verifying the format of the information received by the server;

[1778] and means for generating an error message if the condition is not met based on the verification result.

[1779] 10. The system of claim 1.

[1780] (Claim 3)

[1781] and means for personalizing the application content and procedures based on the user's emotional data.

[1782] 10. The system of claim 1.

[1783] (Claim 4)

[1784] further comprising means for saving the generated application form in PDF format;

[1785] 10. The system of claim 1.

[1786] "Application example 2 when combining emotion engines"

[1787] (Claim 1)

[1788] means for receiving user input information;

[1789] means for transmitting the information to a server;

[1790] means for recognizing the emotional state of a user;

[1791] a means to personalize the application content and process based on emotional state;

[1792] means for acquiring additional information from a database based on the information received by the server;

[1793] means for automatically generating an application form based on the acquired information;

[1794] means for providing the generated application to a user;

[1795] A system including:

[1796] (Claim 2)

[1797] means for verifying the format of the information received by the server;

[1798] and means for generating an error message if the condition is not met based on the verification result.

[1799] 10. The system of claim 1.

[1800] (Claim 3)

[1801] A means to save the generated application form in PDF format,

[1802] further comprising means for providing a download link for the application form to the user;

[1803] 10. The system of claim 1. [Explanation of symbols]

[1804] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving user input information; means for transmitting the information to a server; means for acquiring additional information from a database based on the information received by the server; means for automatically generating an application form based on the acquired information; means for providing the generated application to a user; A system including:

2. means for verifying the format of the information received by the server; and means for generating an error message if the condition is not met based on the verification result. The system of claim 1 .

3. further comprising means for saving the generated application form in PDF format; The system of claim 1 .

Images