system

Abstract

Provide a system. A means for parents to input basic information about their children; A means to automatically input the basic information into various application templates, A means to store the entered information and allow it to be modified and reused as needed; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The purpose of this invention is to reduce the burden on parents of creating a large amount of handwritten documents during the season when children enter kindergarten or school. It also aims to reduce the burden of managing paper documents in educational settings and improve the current situation where it is difficult to efficiently store and manage information. [Means for solving the problem]

[0005] The system of the present invention includes a means for parents to input basic information about their children and a means for automatically inputting the information into various application templates based on that basic information. The system also includes a means for saving the input information and allowing it to be revised and reused as needed. This system significantly reduces the amount of paperwork parents have to complete and improves the efficiency of paper document management in educational settings. Furthermore, the use of a voice input function simplifies the input process, and it is also possible to link application information for siblings based on the saved information.

[0006] "Parents" refers to the guardians who prepare the necessary paperwork for their children's admission to kindergarten or school.

[0007] "Children" refers to those who are old enough to go through kindergarten and school admission procedures and whose information is entered by their parents.

[0008] "Basic information" refers to personal information required to complete the application form, such as the child's name, date of birth, address, and emergency contact information.

[0009] "Means" refers to the method or apparatus employed by the system to perform a particular function.

[0010] "Means of input" refers to the way in which a user manually inputs information into the system or provides information through voice input.

[0011] "Means for automatic input" refers to the function that automatically applies the input basic information to various application form templates.

[0012] "Means of storage" refers to the method of storing input information in a storage medium such as a database.

[0013] "Means to modify" refers to the ability to change or update stored information.

[0014] "Means for reuse" refers to the ability to reuse information that has been saved once for subsequent procedures.

[0015] "Voice input" refers to a method in which a user provides information to a system by speaking, which is then converted into text data.

[0016] A "template" refers to a standard format for various application forms, in which basic information is automatically entered.

[0017] "Linking information about siblings" refers to a function that allows one child's basic information to be used when filling out applications for other siblings. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. The main components of the system include a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function.

[0040] Basic information input phase

[0041] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. At this time, voice recognition technology converts the voice into text data.

[0042] The device receives the information entered by the user, assigns it to the appropriate fields, stores it, and can also convert voice input to text if necessary.

[0043] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[0044] Document preparation phase

[0045] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[0046] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[0047] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[0048] Document verification and submission phase

[0049] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[0050] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[0051] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[0052] Specific examples

[0053] 1. Enter basic information

[0054] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0055] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0056] The server stores this information in a database and manages it in a secure environment.

[0057] 2. Document preparation and confirmation

[0058] The user selects "Application for Admission."

[0059] The device will display a template and automatically fill in the pre-stored information.

[0060] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0061] The user inputs the corrections by voice and performs final confirmation.

[0062] The device will update with the corrections and check again.

[0063] 3. Submission

[0064] The user finalizes the document and selects electronic transmission.

[0065] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[0066] The server stores the document data and manages it for future reference.

[0067] This will significantly reduce the burden on parents of creating documents and improve the efficiency of paper document management in educational settings. By introducing voice input, information can be entered even more efficiently, realizing consistent document management.

[0068] The processing flow will be explained below.

[0069] Step 1:

[0070] A user logs in to a dedicated web or mobile application.

[0071] Step 2:

[0072] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[0073] Step 3:

[0074] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[0075] Step 4:

[0076] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[0077] Step 5:

[0078] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[0079] Step 6:

[0080] The terminal transmits the verified basic information to the server.

[0081] Step 7:

[0082] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[0083] Step 8:

[0084] The server returns a status of successful saving to the terminal.

[0085] Step 9:

[0086] The device displays a message to the user confirming successful save.

[0087] Step 10:

[0088] The user selects document creation and chooses the desired document template (e.g., admission application).

[0089] Step 11:

[0090] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[0091] Step 12:

[0092] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[0093] Step 13:

[0094] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[0095] Step 14:

[0096] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[0097] Step 15:

[0098] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[0099] Step 16:

[0100] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[0101] Step 17:

[0102] The terminal displays a final confirmation screen to the user and provides a confirm button.

[0103] Step 18:

[0104] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[0105] Step 19:

[0106] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[0107] Step 20:

[0108] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[0109] Step 21:

[0110] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[0111] This will make processing across the entire system more efficient, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings.

[0112] Example 1

[0113] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0114] With conventional document creation systems, parents had to manually input the same information every time, which was a huge burden in terms of time and effort. Furthermore, since voice input was not possible, efficient input was not possible. Furthermore, it was not easy to edit created documents or reuse past information, making document management cumbersome.

[0115] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0116] In this invention, the server includes a means for parents to input basic information about their children, a means for selecting a specific document template and automatically inputting the pre-saved basic information into the template, a means for inputting the basic information using voice input and converting it into text data using voice recognition technology, and a means for saving or printing the confirmed document data as an electronic file depending on the input format, thereby significantly reducing the parent's workload and enabling efficient document creation and management.

[0117] The "basic information input means" is a means by which parents input information such as their child's name, date of birth, address, and emergency contact information.

[0118] "Speech recognition technology" is a technology that converts voice-input information into text data, accurately recognizing voice and converting it into text information.

[0119] An "application template" is a predefined form for a specific document format, into which information entered by a user can be automatically incorporated.

[0120] The "automatic input means" is a function that automatically inputs the saved basic information into the appropriate fields of the application template.

[0121] "Means for correction" refers to the means by which a user can check the automatically entered information and change or correct the information as necessary.

[0122] "Reuse means" is a function that allows saved information and created documents to be reused the next time an application is created.

[0123] "Electronic file storage means" refers to a means for storing confirmed document data as a digital file.

[0124] The "printing means" is a means for printing the determined document data onto physical paper.

[0125] "Document submission means" means the electronic transmission or physical submission of finalized documents.

[0126] "Server" means a computer system that receives input information, safely stores and manages it, and provides and transmits information as needed.

[0127] This invention is a system that streamlines the preparation of documents required by parents when their children enroll in kindergarten or school. The system includes a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function. Below, we will explain how each part of the system works.

[0128] Basic information input phase

[0129] User

[0130] Users access the application and proceed to the dashboard from the login screen, where they enter basic information about their child.

[0131] For example, enter information such as "Ichiro Tanaka, March 15, 2015, 1-1-1 Minami-Aoyama, Minato-ku, Tokyo, 080-1234-5678." When using voice input, say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[0132] Example prompt: "Please enter your child's information: name, date of birth, address, and emergency contact information, in that order."

[0133] Terminal

[0134] Receives and temporarily stores text data entered by the user. If voice input is used, converts the voice into text data using voice recognition technology, for example, Google® Speech-to-Text API.

[0135] Assign each piece of information to the appropriate field.

[0136] server

[0137] The server receives the data sent from the device and stores it securely in a database, encrypting it using the AES-256 encryption algorithm.

[0138] Document preparation phase

[0139] User

[0140] Select the desired document template (e.g., application form) from the "Create Document" menu on your dashboard.

[0141] Example prompt: "Please complete your application form. Please review the required information and enter any corrections."

[0142] Terminal

[0143] The selected template is displayed on the screen, and the pre-saved basic information is automatically entered into the appropriate fields of the template.

[0144] server

[0145] A template with auto-filling completed is generated, and confirmation data is sent to the terminal, where it is displayed so that the user can check and correct it.

[0146] Document verification and submission phase

[0147] User

[0148] The user can check the automatically entered document contents and make corrections as necessary. Corrections can also be made by voice input.

[0149] Example of correction: Voice input "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0150] Once confirmed, the user selects the submission format: electronic file saving, printing, or electronic submission to the school.

[0151] Example prompt: "Would you like to finalize and submit your documents? Please answer yes or no."

[0152] Terminal

[0153] Receives the finalized document data and processes it based on the selected submission format, for example converting it to PDF format and saving it as an electronic file or sending it to a printer.

[0154] server

[0155] Securely store finalized document data and manage it for future use. Manage data so it can be reused for multiple years.

[0156] This system significantly reduces the amount of paperwork parents have to fill out when enrolling their children in kindergarten or school, enabling efficient document management. The introduction of a voice input function also allows for efficient information entry.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1: Enter basic information

[0159] The user accesses the application and logs in. After accessing the dashboard, they enter their child's basic information (name, date of birth, address, emergency contact, etc.) into the form. If using voice input, they can say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[0160] Input: Your child's basic information, including name, date of birth, address, and emergency contact details.

[0161] Output: If voice is used, text data is generated by speech recognition and saved as text data.

[0162] What it does: When a user enters information into a form, it is automatically saved. If the user enters information by voice, the device converts the voice data into text using the Google Speech-to-Text API.

[0163] Step 2: Save your data

[0164] The device temporarily stores the entered text data, and if voice input is used, the converted text data as well.

[0165] Input: Text data entered by the user or data converted from speech.

[0166] Output: Well-formed text data.

[0167] Specific behavior: Assigns input data to appropriate fields. Formats it according to a specific format.

[0168] Step 3: Data transmission and encryption storage

[0169] The terminal transmits the well-formatted data to the server.

[0170] The server encrypts the received data using an encryption algorithm such as AES-256 and stores it securely in a database.

[0171] Input: Well-formed text data.

[0172] Output: The encrypted text data is stored in the database.

[0173] Specific operation: After the device sends data, the server immediately encrypts the received data and stores it in a secure database, and also performs data integrity checks.

[0174] Step 4: Select a document template

[0175] The user selects the "Document Creation" menu on the dashboard and chooses the desired document template (e.g., application for admission).

[0176] Input: User selection from a list of document templates.

[0177] Output: The selected template will be displayed on the screen.

[0178] Specific operation: Based on the user's selection, the terminal loads a template from the list and displays it on the screen.

[0179] Step 5: Autofill

[0180] The device automatically fills in the appropriate fields in a template with basic information stored in advance, such as a child's name, address, and emergency contact information, into a school application template.

[0181] Input: Pre-saved basic information.

[0182] Output: A template with basic information automatically filled in.

[0183] Specific action: Map and enter the appropriate basic information for each field in the template.

[0184] Step 6: Generate and send verification data

[0185] The server generates a template with the automatic input completed and sends the confirmation data to the terminal.

[0186] Input: Auto-filled template data.

[0187] Output: Verification data is sent to the terminal.

[0188] Specific operation: The server checks the template data and sends it to the terminal for the user to confirm.

[0189] Step 7: Check and correct the document contents

[0190] The user can check the automatically entered document contents on the screen and make corrections as necessary. Voice input is also possible. For example, a user can say, "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0191] Input: Document template for confirmation, correction details.

[0192] Output: Corrected final confirmation document.

[0193] Specific operation: The user's modifications are reflected and the confirmation screen is displayed again to the user.

[0194] Step 8: Finalize documents and select submission format

[0195] The user makes a final review of the documents and selects the submission format (electronic file saving, printout, or electronic submission to the school).

[0196] Input: Final confirmed document data, selection of submission format.

[0197] Output: Finalized document data.

[0198] Specific Actions: Starts processing based on the submission format selected by the user, for example converting to PDF and deciding whether to save as an electronic file or send to a printer.

[0199] Step 9: Save and send the document

[0200] The terminal transmits the determined document data to the server for processing based on the selected format.

[0201] The server securely stores the finalized document data and processes it appropriately based on the selected format (electronic file storage, print transmission).

[0202] Input: Confirmed document data, submission format.

[0203] Output: Saved document data.

[0204] What happens: The server stores the data and sends or saves the document in the format selected by the user.

[0205] (Application example 1)

[0206] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0207] Previously, when parents prepared the various application documents required for their children's school or kindergarten enrollment, it took a great deal of time and effort, and the process of inputting and checking information was extremely cumbersome. Furthermore, manual input of information made it prone to errors, creating a need for efficient document management. Furthermore, submissions to educational institutions were typically made on paper, with insufficient support for electronic data transmission. To solve these issues, a system was needed that allowed parents to easily and efficiently prepare and manage application documents and submit them electronically.

[0208] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0209] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for inputting information using voice recognition technology and converting voice data into text data, and a means for electronically transmitting the information to various devices. This allows parents to efficiently input, manage, and modify information without cumbersome manual work, and enables the entire process from document creation to submission to be done electronically.

[0210] The "means for parents to input basic information about their children" refers to a device or system that provides an interface for users to input basic information such as their children's names, birth dates, addresses, and emergency contact details.

[0211] "Means for automatically entering data into various application templates based on basic information" refers to a function that uses the entered basic information to automatically fill in the necessary data into pre-prepared application templates.

[0212] "Means for saving input information and enabling it to be modified or reused as necessary" refers to technical means for saving input information in a database or the like, and for later checking, modifying, or reusing the information.

[0213] "Means of using voice recognition technology to input information and convert voice data into text data" refers to a method that uses voice recognition technology to analyze data input by voice and convert it into text format.

[0214] "Means for electronic transmission to various devices" refers to a function for transmitting generated documents and data to various electronic devices such as mobile terminals and computers.

[0215] "Means for linking information about siblings" refers to technology that automatically links information about siblings based on stored information, allowing them to be mutually referenced.

[0216] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. This system can be implemented using the following hardware and software configuration.

[0217] Basic information input phase

[0218] The first thing a user does is enter basic information. Using a device such as a smartphone or tablet, users enter basic information about their child. Specifically, they enter information such as name, date of birth, address, and emergency contact information into a form. A voice input function is also available, allowing users to enter information using their voice. In this case, voice recognition technology (such as Google Cloud Speech-to-Text) converts the voice into text data. The device receives the information entered by the user and stores it by appropriately assigning it to each field. The server receives the information sent from the device and securely stores it in a database (such as MongoDB). The information is encrypted when stored to prevent unauthorized access from outside.

[0219] Document preparation phase

[0220] When a user wants to create a specific document, they access the application and select the desired document template from the menu. The device displays the selected template on the screen and automatically fills in the appropriate fields with pre-stored information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically filled in. The server generates the completed template and sends confirmation data to the device. The user can review the content and make corrections as necessary. They can also use voice input again to make corrections.

[0221] Document verification and submission phase

[0222] The user checks the automatically entered document contents and makes any necessary corrections. Once the corrections are complete, the user confirms the document. The terminal receives the confirmed document data and provides the option to save it as an electronic file or print it out as needed. It can also be sent electronically to the educational institution. The server stores the final confirmed document data and manages it for future use. For example, the information can be retained so that it can be reused in the next year's admissions process.

[0223] Specific examples

[0224] 1. Enter basic information

[0225] The user opens the application and enters basic information about their child. For example, they might say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, and his emergency contact number is 090-1234-5678."

[0226] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0227] The server stores this information in a database and manages it in a secure environment.

[0228] 2. Document preparation and confirmation

[0229] The user selects "Application for Admission."

[0230] The device will display a template and automatically fill in the pre-stored information.

[0231] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0232] The user inputs the corrections by voice and performs final confirmation.

[0233] The device will update with the corrections and check again.

[0234] 3. Submission

[0235] The user finalizes the document and selects electronic transmission.

[0236] The device sends the finalized data to a server, where it is stored as an electronic file or sent to the educational institution.

[0237] The server stores the document data and manages it for future reference.

[0238] Prompt Sentence Examples

[0239] "Please enter your child's basic information. Enter their name, date of birth, address, and emergency contact information in that order."

[0240] "The following template will be automatically filled in based on the information you entered. Please review the content and make any necessary corrections by voice or text input."

[0241] This system frees parents from the hassle of completing complicated paperwork and allows them to complete the application process efficiently and accurately.

[0242] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0243] Step 1:

[0244] The user enters basic information about their child using a device such as a smartphone or tablet. Input methods include text input and voice input. When using voice input, the device uses voice recognition technology to convert speech into text data. Specifically, the Google Cloud Speech-to-Text API is used to convert voice data into text in real time. The entered information (e.g., name, date of birth, address, emergency contact information, etc.) is temporarily stored in the device's memory.

[0245] Input: Child's basic information in voice or text format

[0246] Processing: Converts voice data into text data, stores the text data in memory

[0247] Output: Basic information data in text format

[0248] Step 2:

[0249] The device sends the entered basic information to the server. The server encrypts the received data and stores it in a database. This is done using a database system such as MongoDB to ensure secure management. The encryption process uses, for example, AES (Advanced Encryption Standard) technology.

[0250] Input: Basic information data in text format

[0251] Processing: Encrypting data and storing it in a database

[0252] Output: Encrypted basic information data stored in a database

[0253] Step 3:

[0254] When a user wants to create a particular document, they select the desired document template from the application's menu, which is then generated by a template engine (e.g., Handlebars.js) and displayed on the screen.

[0255] Input: User's template selection

[0256] Processing: Generate and display the template

[0257] Output: Screen display of the selected template

[0258] Step 4:

[0259] The server automatically fills in the appropriate fields in the template with the basic information stored in the form, such as the child's name, address, and emergency contact information, and generates the document automatically.

[0260] Input: Template, basic information data

[0261] Action: Auto-fill template

[0262] Output: Auto-filled document data

[0263] Step 5:

[0264] The user can review the automatically entered document contents and make corrections as necessary. Both text and voice input methods are available for corrections. In the case of voice input, voice recognition technology is again used to convert the voice into text data.

[0265] Input: Auto-filled document data, corrections (text or voice)

[0266] Processing: speech recognition and text conversion, data correction

[0267] Output: Corrected document data

[0268] Step 6:

[0269] The user validates the document. The device sends the validated document data to the server, which stores it in a database. Furthermore, electronic submission to the educational institution is possible, for example by email or through a dedicated online submission system.

[0270] Input: Confirmed document data

[0271] Processing: storage in database, electronic transmission to educational institution

[0272] Output: Saved final document data, electronic transmission confirmation

[0273] Step 7:

[0274] The server manages the finalized document data for future use. For example, it retains the information so that it can be reused for the next year's admissions process. This data management process also includes data backup and restore functions.

[0275] Input: Confirmed document data

[0276] Processing: Data management, backup, and restoration

[0277] Output: A reusable dataset

[0278] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0279] This invention is a system that streamlines the process of parents preparing the necessary documents for their children's kindergarten and school enrollment, and also has the ability to recognize the user's emotions and adjust the guide accordingly. The main components of the system include the following: a user interface for parents to enter their child's basic information, an emotion engine, a database, a template engine, and an automatic document generation and management function.

[0280] Basic information input phase

[0281] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. Speech recognition technology converts the voice into text data.

[0282] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[0283] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[0284] Supported by an emotional engine

[0285] The system incorporates an emotion engine that recognizes the user's emotions.

[0286] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[0287] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and displays it to the user. For example, if the user is feeling frustrated, the server will suggest ways to make input easier, such as copy and paste.

[0288] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[0289] Document preparation phase

[0290] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[0291] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[0292] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[0293] Document verification and submission phase

[0294] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[0295] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[0296] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[0297] Specific examples

[0298] 1. Enter basic information

[0299] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0300] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0301] The server stores this information in a database and manages it in a secure environment.

[0302] 2. Support by Emotion Engine

[0303] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[0304] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[0305] The device displays suggestions to the user and prompts them to enter input according to the guide.

[0306] 3. Document preparation and confirmation

[0307] The user selects "Application for Admission."

[0308] The device will display a template and automatically fill in the pre-stored information.

[0309] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0310] The user inputs the corrections by voice and performs final confirmation.

[0311] The device will update with the corrections and check again.

[0312] 4. Submission

[0313] The user finalizes the document and selects electronic transmission.

[0314] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[0315] The server stores the document data and manages it for future reference.

[0316] This not only significantly reduces the burden of paperwork for parents, but also reduces stress through user emotion analysis, providing an efficient communication environment. The introduction of an emotion engine improves the user experience, enabling smoother and more accurate input.

[0317] The processing flow will be explained below.

[0318] Step 1:

[0319] A user logs in to a dedicated web or mobile application.

[0320] Step 2:

[0321] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[0322] Step 3:

[0323] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[0324] Step 4:

[0325] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[0326] Step 5:

[0327] The device evaluates the user's emotions through an emotion engine that analyzes emotions in real time using facial images and voice tones.

[0328] Step 6:

[0329] The server determines the user's emotional state based on the emotional data sent from the emotion engine. For example, it analyzes whether the user is having trouble or is inputting information smoothly.

[0330] Step 7:

[0331] Based on the results of the assessment, the device will display input guidance or support messages as necessary. For example, if it determines that the user is having difficulty, it will display a message saying, "Using voice input will make input easier."

[0332] Step 8:

[0333] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[0334] Step 9:

[0335] The terminal transmits the verified basic information to the server.

[0336] Step 10:

[0337] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[0338] Step 11:

[0339] The server returns a status of successful saving to the terminal.

[0340] Step 12:

[0341] The device displays a message to the user confirming successful save.

[0342] Step 13:

[0343] The user selects document creation and chooses the desired document template (e.g., admission application).

[0344] Step 14:

[0345] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[0346] Step 15:

[0347] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[0348] Step 16:

[0349] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[0350] Step 17:

[0351] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[0352] Step 18:

[0353] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[0354] Step 19:

[0355] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[0356] Step 20:

[0357] The terminal displays a final confirmation screen to the user and provides a confirm button.

[0358] Step 21:

[0359] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[0360] Step 22:

[0361] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[0362] Step 23:

[0363] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[0364] Step 24:

[0365] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[0366] This will improve the efficiency of the system's overall processing, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings. The introduction of the emotion engine will improve the user experience and make input work even smoother.

[0367] Example 2

[0368] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0369] In the previous system, parents had to fill out a lot of paperwork when enrolling their children in kindergarten or school, which was time-consuming and made it difficult to complete the paperwork efficiently. The complicated input process often led to mistakes and stress. Furthermore, the system lacked the ability to recognize users' emotions and provide appropriate feedback, resulting in a poor user experience.

[0370] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0371] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for recognizing the user's emotions and generating appropriate feedback, and a means for displaying the generated feedback to the user. This reduces the burden on parents when completing documents, reduces input errors and stress, and enables an improved user experience through emotion recognition.

[0372] "Parent" means the legal guardian or guardian of a child.

[0373] "Child" refers to a minor who is planning to enroll in an educational institution.

[0374] "Basic information" refers to information that can be used to identify a specific individual, such as name, date of birth, address, and emergency contact information.

[0375] An "application template" refers to a standard document format for entering the necessary information for a specific purpose.

[0376] "Autofill" refers to the process of automatically filling in information into input fields using pre-stored data.

[0377] "Saving" refers to recording the input information in a storage device such as a database.

[0378] "Modification" refers to making changes to existing input data.

[0379] "Reuse" refers to the reuse of information that has been stored at a later time.

[0380] "Emotion recognition" refers to technology that analyzes a user's facial expressions and vocal tone to estimate their emotional state.

[0381] "Feedback" refers to suggestions and advice provided based on a user's behavior or state.

[0382] "User" refers to a person who uses this system to create documents.

[0383] "Terminal" refers to a device used by a user, such as a computer or smartphone.

[0384] "Server" refers to a remote computing system for processing and storing data.

[0385] This invention is a system that streamlines the process of parents filling out the necessary paperwork for their children's kindergarten and school enrollment, and also recognizes the user's emotions and provides appropriate guidance. The system consists of the following main components:

[0386] 1. User Interface (UI)

[0387] It provides a user interface (UI) that can be accessed on a smartphone or PC as a means for parents to enter basic information about their children. This UI is equipped with a voice input function in addition to keyboard input. Voice input uses the Google Cloud Speech-to-Text API to convert voice data into text data.

[0388] 2. Database

[0389] The basic information entered is securely stored in a database. The server applies AES encryption to the received data and stores it in a database in an environment protected from unauthorized access. The database is designed to permanently store and manage information for future use.

[0390] 3. Emotion Engine

[0391] The user interface uses a camera and microphone for real-time facial recognition and voice tone analysis to identify the user's emotions. Emotion recognition uses OpenCV and Python. For example, if the user expresses confusion or nervousness while typing, the system will detect this and generate appropriate feedback.

[0392] 4. Template Engine

[0393] A template engine is used to automatically generate documents. For example, by using Handlebars.js, pre-saved basic information can be automatically embedded into various application templates. Once a template is selected, the necessary information is automatically loaded.

[0394] 5. Automatic document generation and management function

[0395] When a user selects a specific document template, basic information is automatically entered to generate a completed document. For example, if a template such as an "application for admission" is selected, the child's name and address are automatically entered. After reviewing and correcting this automatically generated document, the user can save the finalized document in PDF format or send it electronically to the school.

[0396] Specific examples

[0397] Enter basic information

[0398] 1. The user opens the application and enters basic information about their child. For example, they can enter information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0399] 2. The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate field.

[0400] 3. The server stores this information in a database and manages it in a secure environment.

[0401] Supported by an emotional engine

[0402] 1. The device analyzes the user's facial expressions and voice tone in real time while inputting. For example, facial expression recognition is performed using OpenCV and Python.

[0403] 2. The server analyzes the emotional data and generates feedback such as, "If you have difficulty inputting, please use voice input."

[0404] 3. The device displays this feedback to the user, encouraging smooth input.

[0405] Document preparation and confirmation

[0406] 1. The user selects "Application for Admission."

[0407] 2. The device displays the template and automatically fills in the pre-saved information, for example using Handlebars.js to power the template engine.

[0408] 3. The server generates the auto-filled data and sends it to the device as a confirmation document.

[0409] 4. The user inputs the corrections by voice and performs a final confirmation.

[0410] submission

[0411] 1. The user finalizes the document and selects electronic transmission.

[0412] 2. The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[0413] 3. The server stores the document data and manages it for future reference.

[0414] This invention significantly reduces the burden on parents when completing paperwork, reduces user stress through emotion analysis, and enables efficient and accurate document preparation and submission.

[0415] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0416] Step 1:

[0417] The user launches the application and enters basic information about their child.

[0418] How it works: A user accesses the application URL in a browser on their smartphone or PC.

[0419] Input: Enter basic information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form.

[0420] Output: The basic information entered is sent to the terminal.

[0421] Step 2:

[0422] The device receives the input information and converts the voice data into text.

[0423] How it works: Once text input is complete, if voice input is used, voice data is collected through the device's microphone and converted to text using the Google Cloud Speech-to-Text API.

[0424] Input: The user speaks, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0425] Output: The audio data is converted to text data and assigned to each field.

[0426] Step 3:

[0427] The server stores the information in a database.

[0428] How it works: Receives basic information sent from the device, encrypts it with AES, and stores it securely in a database.

[0429] Input: Basic information of the user sent from the device (name, date of birth, address, emergency contact, etc.)

[0430] Output: Encrypted basic information stored in the database.

[0431] Step 4:

[0432] The device analyzes the user's facial expressions and tone of voice.

[0433] How it works: It uses the device's camera and microphone to collect the user's facial expressions and voice tone in real time and analyzes them using OpenCV and Python.

[0434] Input: User's facial expression data and voice tone data collected by camera and microphone.

[0435] Output: Analyzed emotion data. For example, if the person is confused, it will be labeled as "confused."

[0436] Step 5:

[0437] The server analyzes the emotion data and generates feedback.

[0438] Behavior: Receives emotion data from the device and generates appropriate feedback, such as a suggestion like "If you have difficulty typing, please use voice input."

[0439] Input: Emotion data sent from the device.

[0440] Output: The generated feedback message.

[0441] Step 6:

[0442] The device displays feedback.

[0443] Behavior: Feedback received from the server is displayed on the screen and presented to the user.

[0444] Input: The feedback message sent by the server.

[0445] Output: Feedback is displayed to the user.

[0446] Step 7:

[0447] The user selects a document template.

[0448] Action: Select the desired document template (e.g., "Application for Admission") from the application menu.

[0449] Input: User selection.

[0450] Output: The selected template will be displayed on the screen.

[0451] Step 8:

[0452] The device automatically fills in basic information into the template.

[0453] What it does: Automatically fills in the appropriate fields of a selected template with pre-stored basic information. Uses a template engine such as Handlebars.js.

[0454] Input: Basic information retrieved from the database and the selected template.

[0455] Output: The completed auto-filled template.

[0456] Step 9:

[0457] The server generates a template and sends the data for verification.

[0458] Operation: A final template is generated based on the automatically entered template data sent from the terminal, and confirmation data is sent to the terminal.

[0459] Input: Auto-filled template data sent from the device.

[0460] Output: The final template data for review.

[0461] Step 10:

[0462] The user reviews and edits the document.

[0463] How it works: Review the auto-filled information and make any necessary corrections. You can also use voice input to make corrections.

[0464] Input: Auto-filled templates and user correction instructions (voice or text).

[0465] Output: The final modified template.

[0466] Step 11:

[0467] The device saves the modified data and saves and sends the file as needed.

[0468] Operation: The user receives the finalized document data and saves it as an electronic file or sends it electronically to the school.

[0469] Input: The final template data confirmed by the user.

[0470] Output: Saved electronic file or submission completion status.

[0471] Step 12:

[0472] The server stores and manages the final data.

[0473] Operation: The finalized document data is permanently stored in a database and managed so that it can be reused.

[0474] Input: Final document data confirmed by the user.

[0475] Output: Final data that has been saved and managed.

[0476] (Application example 2)

[0477] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0478] There is a need to reduce stress and fatigue and improve safety by improving the efficiency of the document preparation required by drivers of autonomous vehicles, and by properly recognizing their emotions while driving and providing appropriate feedback.The present invention aims to provide a system that allows drivers to easily prepare the necessary documents and provides appropriate support based on their emotions while driving.

[0479] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0480] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for analyzing the user's facial expressions and voice tone in real time to recognize emotions, and a means for providing feedback and guidance based on the recognized emotions.This makes it possible to streamline the document preparation required by drivers of autonomous vehicles and to provide appropriate support based on their emotions while driving.

[0481] The "means by which parents input basic information about their children" refers to an interface that allows users to input basic information about their children into a terminal, and includes keyboard input and voice input.

[0482] The "means for automatically inputting information into various application templates" has the function of automatically placing the necessary information into a pre-prepared application template based on the input basic information.

[0483] "Means for saving the entered information and enabling it to be modified or reused as needed" means a function that saves the information entered by the user in a database and allows the information to be modified or reused later.

[0484] "Means for analyzing a user's facial expressions and voice tone in real time and recognizing emotions" refers to a function that uses a camera or microphone to capture a user's facial expressions and voice tone, and analyzes them to infer the user's emotions.

[0485] The "means for providing feedback and guidance based on recognized emotions" has the function of presenting appropriate advice and support content to the user in real time based on the analyzed user emotions.

[0486] A system for implementing this invention provides support for drivers of autonomous vehicles by streamlining the creation of documents and using emotion recognition. The system's main components include a user interface (UI), an emotion recognition engine, a database (DB), a template engine, and an automatic document generation and management function.

[0487] Basic information input phase

[0488] The first thing a user does is enter basic information. They access the application, open a form, and enter basic driver information (such as name, vehicle ID, and contact details). A voice input function is also provided, allowing users to input information using their voice. Speech recognition technology converts the voice into text data.

[0489] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[0490] The server receives the information sent from the device and stores it in a database in a secure environment. The information is also encrypted when stored to prevent unauthorized access from outside.

[0491] Supported by an emotional engine

[0492] The system incorporates an emotion engine that recognizes the user's emotions.

[0493] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[0494] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and presents it to the user. For example, if the user is feeling frustrated, the server will suggest specific operating methods or ways to relax.

[0495] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[0496] Document preparation phase

[0497] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[0498] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if an accident report template is selected, the driver's name, vehicle ID, contact information, etc. will be automatically filled in.

[0499] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[0500] Document verification and submission phase

[0501] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[0502] The terminal receives the finalized document data and provides the option to save it as an electronic file or print it out as needed, or to send it electronically to the relevant authorities.

[0503] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for similar procedures.

[0504] Specific examples

[0505] 1. Enter basic information

[0506] A user opens the application and enters basic driver information. For example, they can enter information such as "Ichiro Sato, vehicle ID 1234-XYZ, 090-1234-5678" into a form, or they can say, "The driver's name is Ichiro Sato, and the vehicle ID is 1234-XYZ."

[0507] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0508] The server stores this information in a database and manages it in a secure environment.

[0509] 2. Support by Emotion Engine

[0510] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[0511] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[0512] The device displays suggestions to the user and prompts them to enter input according to the guide.

[0513] 3. Document preparation and confirmation

[0514] The user selects "Accident Report."

[0515] The device will display a template and automatically fill in the pre-stored information.

[0516] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0517] The user inputs the corrections by voice and performs final confirmation.

[0518] The device will update with the corrections and check again.

[0519] 4. Submission

[0520] The user finalizes the document and selects electronic transmission.

[0521] The terminal sends the confirmed data to the server, where it is stored as an electronic file or transmitted to the relevant institution.

[0522] The server stores the document data and manages it for future reference.

[0523] Example prompt sentence:

[0524] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[0525] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0526] Step 1: Enter basic information

[0527] The user accesses the application, opens a form, and enters the driver's basic information (such as name, vehicle ID, and contact details). Voice input is also available. The device receives this input, and if it is text input, it stores it as is. If it is voice input, it uses voice recognition technology to convert the voice data into text data, which is then assigned appropriately to the respective fields and saved. This saves the input data in text format to the database.

[0528] Step 2: Save to database

[0529] The device sends the entered information to the server. The server receives this information and stores it securely in a database. When stored, the information is encrypted to prevent unauthorized access. This ensures that basic information is stored safely.

[0530] Step 3: Real-time sentiment analysis

[0531] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time. The emotion engine analyzes this data and recognizes the user's emotions. Specifically, it detects facial feature points to classify facial expressions and analyzes the frequency components and tone of voice to evaluate the user's emotional state. This allows the device to understand the user's emotions in real time.

[0532] Step 4: Emotion-based feedback generation

[0533] The server generates appropriate feedback based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it generates specific advice such as "Relax" or "Take a deep breath." This feedback is sent to the device in text format.

[0534] Step 5: Displaying Emotional Feedback

[0535] The terminal receives the feedback sent from the server and displays it to the user. It provides feedback to the user through a display or voice guidance, and also assists the user in continuing the input process. This step helps reduce user stress and maintain a safe driving environment.

[0536] Step 6: Select a document template

[0537] The user accesses the application and selects the desired document template (e.g., accident report) from the menu. The terminal displays the selected template on the screen.

[0538] Step 7: Auto-filling the template

[0539] The device retrieves basic information stored in a database and automatically fills in the appropriate fields in the selected template, eliminating the need to manually enter information.

[0540] Step 8: Check and correct documents

[0541] The user can check the automatically entered document contents and make any necessary corrections. Corrections can also be made using voice input. The device receives the user's correction instructions and updates the document data, so that accurate information is reflected in the template.

[0542] Step 9: Finalize and submit documents

[0543] The user finalizes the document and selects electronic submission. The terminal sends the finalized data to the server, which saves it as an electronic file or sends it to the relevant authority. It also provides the option to print it out if necessary. The server saves the finalized document data and manages it for future reference. This step realizes efficient document preparation and submission.

[0544] Adding specific examples

[0545] Example prompt sentence:

[0546] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[0547] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0548] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0549] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0550] [Second embodiment]

[0551] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0552] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0553] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0554] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0555] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0556] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0557] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0558] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0559] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0560] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0561] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0562] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0563] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. The main components of the system include a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function.

[0564] Basic information input phase

[0565] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. At this time, voice recognition technology converts the voice into text data.

[0566] The device receives the information entered by the user, assigns it to the appropriate fields, stores it, and can also convert voice input to text if necessary.

[0567] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[0568] Document preparation phase

[0569] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[0570] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[0571] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[0572] Document verification and submission phase

[0573] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[0574] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[0575] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[0576] Specific examples

[0577] 1. Enter basic information

[0578] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0579] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0580] The server stores this information in a database and manages it in a secure environment.

[0581] 2. Document preparation and confirmation

[0582] The user selects "Application for Admission."

[0583] The device will display a template and automatically fill in the pre-stored information.

[0584] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0585] The user inputs the corrections by voice and performs final confirmation.

[0586] The device will update with the corrections and check again.

[0587] 3. Submission

[0588] The user finalizes the document and selects electronic transmission.

[0589] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[0590] The server stores the document data and manages it for future reference.

[0591] This will significantly reduce the burden on parents of creating documents and improve the efficiency of paper document management in educational settings. By introducing voice input, information can be entered even more efficiently, realizing consistent document management.

[0592] The processing flow will be explained below.

[0593] Step 1:

[0594] A user logs in to a dedicated web or mobile application.

[0595] Step 2:

[0596] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[0597] Step 3:

[0598] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[0599] Step 4:

[0600] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[0601] Step 5:

[0602] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[0603] Step 6:

[0604] The terminal transmits the verified basic information to the server.

[0605] Step 7:

[0606] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[0607] Step 8:

[0608] The server returns a status of successful saving to the terminal.

[0609] Step 9:

[0610] The device displays a message to the user confirming successful save.

[0611] Step 10:

[0612] The user selects document creation and chooses the desired document template (e.g., admission application).

[0613] Step 11:

[0614] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[0615] Step 12:

[0616] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[0617] Step 13:

[0618] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[0619] Step 14:

[0620] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[0621] Step 15:

[0622] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[0623] Step 16:

[0624] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[0625] Step 17:

[0626] The terminal displays a final confirmation screen to the user and provides a confirm button.

[0627] Step 18:

[0628] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[0629] Step 19:

[0630] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[0631] Step 20:

[0632] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[0633] Step 21:

[0634] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[0635] This will make processing across the entire system more efficient, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings.

[0636] Example 1

[0637] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0638] With conventional document creation systems, parents had to manually input the same information every time, which was a huge burden in terms of time and effort. Furthermore, since voice input was not possible, efficient input was not possible. Furthermore, it was not easy to edit created documents or reuse past information, making document management cumbersome.

[0639] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0640] In this invention, the server includes a means for parents to input basic information about their children, a means for selecting a specific document template and automatically inputting the pre-saved basic information into the template, a means for inputting the basic information using voice input and converting it into text data using voice recognition technology, and a means for saving or printing the confirmed document data as an electronic file depending on the input format, thereby significantly reducing the parent's workload and enabling efficient document creation and management.

[0641] The "basic information input means" is a means by which parents input information such as their child's name, date of birth, address, and emergency contact information.

[0642] "Speech recognition technology" is a technology that converts voice-input information into text data, accurately recognizing voice and converting it into text information.

[0643] An "application template" is a predefined form for a specific document format, into which information entered by a user can be automatically incorporated.

[0644] The "automatic input means" is a function that automatically inputs the saved basic information into the appropriate fields of the application template.

[0645] "Means for correction" refers to the means by which a user can check the automatically entered information and change or correct the information as necessary.

[0646] "Reuse means" is a function that allows saved information and created documents to be reused the next time an application is created.

[0647] "Electronic file storage means" refers to a means for storing confirmed document data as a digital file.

[0648] The "printing means" is a means for printing the determined document data onto physical paper.

[0649] "Document submission means" means the electronic transmission or physical submission of finalized documents.

[0650] "Server" means a computer system that receives input information, safely stores and manages it, and provides and transmits information as needed.

[0651] This invention is a system that streamlines the preparation of documents required by parents when their children enroll in kindergarten or school. The system includes a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function. Below, we will explain how each part of the system works.

[0652] Basic information input phase

[0653] User

[0654] Users access the application and proceed to the dashboard from the login screen, where they enter basic information about their child.

[0655] For example, enter information such as "Ichiro Tanaka, March 15, 2015, 1-1-1 Minami-Aoyama, Minato-ku, Tokyo, 080-1234-5678." When using voice input, say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[0656] Example prompt: "Please enter your child's information: name, date of birth, address, and emergency contact information, in that order."

[0657] Terminal

[0658] Receives and temporarily stores text data entered by the user. If voice input is used, converts the voice into text data using voice recognition technology, for example, using the Google Speech-to-Text API.

[0659] Assign each piece of information to the appropriate field.

[0660] server

[0661] The server receives the data sent from the device and stores it securely in a database, encrypting it using the AES-256 encryption algorithm.

[0662] Document preparation phase

[0663] User

[0664] Select the desired document template (e.g., application form) from the "Create Document" menu on your dashboard.

[0665] Example prompt: "Please complete your application form. Please review the required information and enter any corrections."

[0666] Terminal

[0667] The selected template is displayed on the screen, and the pre-saved basic information is automatically entered into the appropriate fields of the template.

[0668] server

[0669] A template with auto-filling completed is generated, and confirmation data is sent to the terminal, where it is displayed so that the user can check and correct it.

[0670] Document verification and submission phase

[0671] User

[0672] The user can check the automatically entered document contents and make corrections as necessary. Corrections can also be made by voice input.

[0673] Example of correction: Voice input "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0674] Once confirmed, the user selects the submission format: electronic file saving, printing, or electronic submission to the school.

[0675] Example prompt: "Would you like to finalize and submit your documents? Please answer yes or no."

[0676] Terminal

[0677] Receives the finalized document data and processes it based on the selected submission format, for example converting it to PDF format and saving it as an electronic file or sending it to a printer.

[0678] server

[0679] Securely store finalized document data and manage it for future use. Manage data so it can be reused for multiple years.

[0680] This system significantly reduces the amount of paperwork parents have to fill out when enrolling their children in kindergarten or school, enabling efficient document management. The introduction of a voice input function also allows for efficient information entry.

[0681] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0682] Step 1: Enter basic information

[0683] The user accesses the application and logs in. After accessing the dashboard, they enter their child's basic information (name, date of birth, address, emergency contact, etc.) into the form. If using voice input, they can say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[0684] Input: Your child's basic information, including name, date of birth, address, and emergency contact details.

[0685] Output: If voice is used, text data is generated by speech recognition and saved as text data.

[0686] What it does: When a user enters information into a form, it is automatically saved. If the user enters information by voice, the device converts the voice data into text using the Google Speech-to-Text API.

[0687] Step 2: Save your data

[0688] The device temporarily stores the entered text data, and if voice input is used, the converted text data as well.

[0689] Input: Text data entered by the user or data converted from speech.

[0690] Output: Well-formed text data.

[0691] Specific behavior: Assigns input data to appropriate fields. Formats it according to a specific format.

[0692] Step 3: Data transmission and encryption storage

[0693] The terminal transmits the well-formatted data to the server.

[0694] The server encrypts the received data using an encryption algorithm such as AES-256 and stores it securely in a database.

[0695] Input: Well-formed text data.

[0696] Output: The encrypted text data is stored in the database.

[0697] Specific operation: After the device sends data, the server immediately encrypts the received data and stores it in a secure database, and also performs data integrity checks.

[0698] Step 4: Select a document template

[0699] The user selects the "Document Creation" menu on the dashboard and chooses the desired document template (e.g., application for admission).

[0700] Input: User selection from a list of document templates.

[0701] Output: The selected template will be displayed on the screen.

[0702] Specific operation: Based on the user's selection, the terminal loads a template from the list and displays it on the screen.

[0703] Step 5: Autofill

[0704] The device automatically fills in the appropriate fields in a template with basic information stored in advance, such as a child's name, address, and emergency contact information, into a school application template.

[0705] Input: Pre-saved basic information.

[0706] Output: A template with basic information automatically filled in.

[0707] Specific action: Map and enter the appropriate basic information for each field in the template.

[0708] Step 6: Generate and send verification data

[0709] The server generates a template with the automatic input completed and sends the confirmation data to the terminal.

[0710] Input: Auto-filled template data.

[0711] Output: Verification data is sent to the terminal.

[0712] Specific operation: The server checks the template data and sends it to the terminal for the user to confirm.

[0713] Step 7: Check and correct the document contents

[0714] The user can check the automatically entered document contents on the screen and make corrections as necessary. Voice input is also possible. For example, a user can say, "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0715] Input: Document template for confirmation, correction details.

[0716] Output: Corrected final confirmation document.

[0717] Specific operation: The user's modifications are reflected and the confirmation screen is displayed again to the user.

[0718] Step 8: Finalize documents and select submission format

[0719] The user makes a final review of the documents and selects the submission format (electronic file saving, printout, or electronic submission to the school).

[0720] Input: Final confirmed document data, selection of submission format.

[0721] Output: Finalized document data.

[0722] Specific Actions: Starts processing based on the submission format selected by the user, for example converting to PDF and deciding whether to save as an electronic file or send to a printer.

[0723] Step 9: Save and send the document

[0724] The terminal transmits the determined document data to the server for processing based on the selected format.

[0725] The server securely stores the finalized document data and processes it appropriately based on the selected format (electronic file storage, print transmission).

[0726] Input: Confirmed document data, submission format.

[0727] Output: Saved document data.

[0728] What happens: The server stores the data and sends or saves the document in the format selected by the user.

[0729] (Application example 1)

[0730] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0731] Previously, when parents prepared the various application documents required for their children's school or kindergarten enrollment, it took a great deal of time and effort, and the process of inputting and checking information was extremely cumbersome. Furthermore, manual input of information made it prone to errors, creating a need for efficient document management. Furthermore, submissions to educational institutions were typically made on paper, with insufficient support for electronic data transmission. To solve these issues, a system was needed that allowed parents to easily and efficiently prepare and manage application documents and submit them electronically.

[0732] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0733] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for inputting information using voice recognition technology and converting voice data into text data, and a means for electronically transmitting the information to various devices. This allows parents to efficiently input, manage, and modify information without cumbersome manual work, and enables the entire process from document creation to submission to be done electronically.

[0734] The "means for parents to input basic information about their children" refers to a device or system that provides an interface for users to input basic information such as their children's names, birth dates, addresses, and emergency contact details.

[0735] "Means for automatically entering data into various application templates based on basic information" refers to a function that uses the entered basic information to automatically fill in the necessary data into pre-prepared application templates.

[0736] "Means for saving input information and enabling it to be modified or reused as necessary" refers to technical means for saving input information in a database or the like, and for later checking, modifying, or reusing the information.

[0737] "Means of using voice recognition technology to input information and convert voice data into text data" refers to a method that uses voice recognition technology to analyze data input by voice and convert it into text format.

[0738] "Means for electronic transmission to various devices" refers to a function for transmitting generated documents and data to various electronic devices such as mobile terminals and computers.

[0739] "Means for linking information about siblings" refers to technology that automatically links information about siblings based on stored information, allowing them to be mutually referenced.

[0740] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. This system can be implemented using the following hardware and software configuration.

[0741] Basic information input phase

[0742] The first thing a user does is enter basic information. Using a device such as a smartphone or tablet, users enter basic information about their child. Specifically, they enter information such as name, date of birth, address, and emergency contact information into a form. A voice input function is also available, allowing users to enter information using their voice. In this case, voice recognition technology (such as Google Cloud Speech-to-Text) converts the voice into text data. The device receives the information entered by the user and stores it by appropriately assigning it to each field. The server receives the information sent from the device and securely stores it in a database (such as MongoDB). The information is encrypted when stored to prevent unauthorized access from outside.

[0743] Document preparation phase

[0744] When a user wants to create a specific document, they access the application and select the desired document template from the menu. The device displays the selected template on the screen and automatically fills in the appropriate fields with pre-stored information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically filled in. The server generates the completed template and sends confirmation data to the device. The user can review the content and make corrections as necessary. They can also use voice input again to make corrections.

[0745] Document verification and submission phase

[0746] The user checks the automatically entered document contents and makes any necessary corrections. Once the corrections are complete, the user confirms the document. The terminal receives the confirmed document data and provides the option to save it as an electronic file or print it out as needed. It can also be sent electronically to the educational institution. The server stores the final confirmed document data and manages it for future use. For example, the information can be retained so that it can be reused in the next year's admissions process.

[0747] Specific examples

[0748] 1. Enter basic information

[0749] The user opens the application and enters basic information about their child. For example, they might say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, and his emergency contact number is 090-1234-5678."

[0750] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0751] The server stores this information in a database and manages it in a secure environment.

[0752] 2. Document preparation and confirmation

[0753] The user selects "Application for Admission."

[0754] The device will display a template and automatically fill in the pre-stored information.

[0755] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0756] The user inputs the corrections by voice and performs final confirmation.

[0757] The device will update with the corrections and check again.

[0758] 3. Submission

[0759] The user finalizes the document and selects electronic transmission.

[0760] The device sends the finalized data to a server, where it is stored as an electronic file or sent to the educational institution.

[0761] The server stores the document data and manages it for future reference.

[0762] Prompt Sentence Examples

[0763] "Please enter your child's basic information. Enter their name, date of birth, address, and emergency contact information in that order."

[0764] "The following template will be automatically filled in based on the information you entered. Please review the content and make any necessary corrections by voice or text input."

[0765] This system frees parents from the hassle of completing complicated paperwork and allows them to complete the application process efficiently and accurately.

[0766] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0767] Step 1:

[0768] The user enters basic information about their child using a device such as a smartphone or tablet. Input methods include text input and voice input. When using voice input, the device uses voice recognition technology to convert speech into text data. Specifically, the Google Cloud Speech-to-Text API is used to convert voice data into text in real time. The entered information (e.g., name, date of birth, address, emergency contact information, etc.) is temporarily stored in the device's memory.

[0769] Input: Child's basic information in voice or text format

[0770] Processing: Converts voice data into text data, stores the text data in memory

[0771] Output: Basic information data in text format

[0772] Step 2:

[0773] The device sends the entered basic information to the server. The server encrypts the received data and stores it in a database. This is done using a database system such as MongoDB to ensure secure management. The encryption process uses, for example, AES (Advanced Encryption Standard) technology.

[0774] Input: Basic information data in text format

[0775] Processing: Encrypting data and storing it in a database

[0776] Output: Encrypted basic information data stored in a database

[0777] Step 3:

[0778] When a user wants to create a particular document, they select the desired document template from the application's menu, which is then generated by a template engine (e.g., Handlebars.js) and displayed on the screen.

[0779] Input: User's template selection

[0780] Processing: Generate and display the template

[0781] Output: Screen display of the selected template

[0782] Step 4:

[0783] The server automatically fills in the appropriate fields in the template with the basic information stored in the form, such as the child's name, address, and emergency contact information, and generates the document automatically.

[0784] Input: Template, basic information data

[0785] Action: Auto-fill template

[0786] Output: Auto-filled document data

[0787] Step 5:

[0788] The user can review the automatically entered document contents and make corrections as necessary. Both text and voice input methods are available for corrections. In the case of voice input, voice recognition technology is again used to convert the voice into text data.

[0789] Input: Auto-filled document data, corrections (text or voice)

[0790] Processing: speech recognition and text conversion, data correction

[0791] Output: Corrected document data

[0792] Step 6:

[0793] The user validates the document. The device sends the validated document data to the server, which stores it in a database. Furthermore, electronic submission to the educational institution is possible, for example by email or through a dedicated online submission system.

[0794] Input: Confirmed document data

[0795] Processing: storage in database, electronic transmission to educational institution

[0796] Output: Saved final document data, electronic transmission confirmation

[0797] Step 7:

[0798] The server manages the finalized document data for future use. For example, it retains the information so that it can be reused for the next year's admissions process. This data management process also includes data backup and restore functions.

[0799] Input: Confirmed document data

[0800] Processing: Data management, backup, and restoration

[0801] Output: A reusable dataset

[0802] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0803] This invention is a system that streamlines the process of parents preparing the necessary documents for their children's kindergarten and school enrollment, and also has the ability to recognize the user's emotions and adjust the guide accordingly. The main components of the system include the following: a user interface for parents to enter their child's basic information, an emotion engine, a database, a template engine, and an automatic document generation and management function.

[0804] Basic information input phase

[0805] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. Speech recognition technology converts the voice into text data.

[0806] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[0807] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[0808] Supported by an emotional engine

[0809] The system incorporates an emotion engine that recognizes the user's emotions.

[0810] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[0811] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and displays it to the user. For example, if the user is feeling frustrated, the server will suggest ways to make input easier, such as copy and paste.

[0812] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[0813] Document preparation phase

[0814] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[0815] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[0816] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[0817] Document verification and submission phase

[0818] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[0819] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[0820] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[0821] Specific examples

[0822] 1. Enter basic information

[0823] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0824] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[0825] The server stores this information in a database and manages it in a secure environment.

[0826] 2. Support by Emotion Engine

[0827] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[0828] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[0829] The device displays suggestions to the user and prompts them to enter input according to the guide.

[0830] 3. Document preparation and confirmation

[0831] The user selects "Application for Admission."

[0832] The device will display a template and automatically fill in the pre-stored information.

[0833] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[0834] The user inputs the corrections by voice and performs final confirmation.

[0835] The device will update with the corrections and check again.

[0836] 4. Submission

[0837] The user finalizes the document and selects electronic transmission.

[0838] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[0839] The server stores the document data and manages it for future reference.

[0840] This not only significantly reduces the burden of paperwork for parents, but also reduces stress through user emotion analysis, providing an efficient communication environment. The introduction of an emotion engine improves the user experience, enabling smoother and more accurate input.

[0841] The processing flow will be explained below.

[0842] Step 1:

[0843] A user logs in to a dedicated web or mobile application.

[0844] Step 2:

[0845] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[0846] Step 3:

[0847] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[0848] Step 4:

[0849] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[0850] Step 5:

[0851] The device evaluates the user's emotions through an emotion engine that analyzes emotions in real time using facial images and voice tones.

[0852] Step 6:

[0853] The server determines the user's emotional state based on the emotional data sent from the emotion engine. For example, it analyzes whether the user is having trouble or is inputting information smoothly.

[0854] Step 7:

[0855] Based on the results of the assessment, the device will display input guidance or support messages as necessary. For example, if it determines that the user is having difficulty, it will display a message saying, "Using voice input will make input easier."

[0856] Step 8:

[0857] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[0858] Step 9:

[0859] The terminal transmits the verified basic information to the server.

[0860] Step 10:

[0861] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[0862] Step 11:

[0863] The server returns a status of successful saving to the terminal.

[0864] Step 12:

[0865] The device displays a message to the user confirming successful save.

[0866] Step 13:

[0867] The user selects document creation and chooses the desired document template (e.g., admission application).

[0868] Step 14:

[0869] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[0870] Step 15:

[0871] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[0872] Step 16:

[0873] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[0874] Step 17:

[0875] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[0876] Step 18:

[0877] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[0878] Step 19:

[0879] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[0880] Step 20:

[0881] The terminal displays a final confirmation screen to the user and provides a confirm button.

[0882] Step 21:

[0883] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[0884] Step 22:

[0885] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[0886] Step 23:

[0887] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[0888] Step 24:

[0889] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[0890] This will improve the efficiency of the system's overall processing, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings. The introduction of the emotion engine will improve the user experience and make input work even smoother.

[0891] Example 2

[0892] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0893] In the previous system, parents had to fill out a lot of paperwork when enrolling their children in kindergarten or school, which was time-consuming and made it difficult to complete the paperwork efficiently. The complicated input process often led to mistakes and stress. Furthermore, the system lacked the ability to recognize users' emotions and provide appropriate feedback, resulting in a poor user experience.

[0894] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0895] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for recognizing the user's emotions and generating appropriate feedback, and a means for displaying the generated feedback to the user. This reduces the burden on parents when completing documents, reduces input errors and stress, and enables an improved user experience through emotion recognition.

[0896] "Parent" means the legal guardian or guardian of a child.

[0897] "Child" refers to a minor who is planning to enroll in an educational institution.

[0898] "Basic information" refers to information that can be used to identify a specific individual, such as name, date of birth, address, and emergency contact information.

[0899] An "application template" refers to a standard document format for entering the necessary information for a specific purpose.

[0900] "Autofill" refers to the process of automatically filling in information into input fields using pre-stored data.

[0901] "Saving" refers to recording the input information in a storage device such as a database.

[0902] "Modification" refers to making changes to existing input data.

[0903] "Reuse" refers to the reuse of information that has been stored at a later time.

[0904] "Emotion recognition" refers to technology that analyzes a user's facial expressions and vocal tone to estimate their emotional state.

[0905] "Feedback" refers to suggestions and advice provided based on a user's behavior or state.

[0906] "User" refers to a person who uses this system to create documents.

[0907] "Terminal" refers to a device used by a user, such as a computer or smartphone.

[0908] "Server" refers to a remote computing system for processing and storing data.

[0909] This invention is a system that streamlines the process of parents filling out the necessary paperwork for their children's kindergarten and school enrollment, and also recognizes the user's emotions and provides appropriate guidance. The system consists of the following main components:

[0910] 1. User Interface (UI)

[0911] It provides a user interface (UI) that can be accessed on a smartphone or PC as a means for parents to enter basic information about their children. This UI is equipped with a voice input function in addition to keyboard input. Voice input uses the Google Cloud Speech-to-Text API to convert voice data into text data.

[0912] 2. Database

[0913] The basic information entered is securely stored in a database. The server applies AES encryption to the received data and stores it in a database in an environment protected from unauthorized access. The database is designed to permanently store and manage information for future use.

[0914] 3. Emotion Engine

[0915] The user interface uses a camera and microphone for real-time facial recognition and voice tone analysis to identify the user's emotions. Emotion recognition uses OpenCV and Python. For example, if the user expresses confusion or nervousness while typing, the system will detect this and generate appropriate feedback.

[0916] 4. Template Engine

[0917] A template engine is used to automatically generate documents. For example, by using Handlebars.js, pre-saved basic information can be automatically embedded into various application templates. Once a template is selected, the necessary information is automatically loaded.

[0918] 5. Automatic document generation and management function

[0919] When a user selects a specific document template, basic information is automatically entered to generate a completed document. For example, if a template such as an "application for admission" is selected, the child's name and address are automatically entered. After reviewing and correcting this automatically generated document, the user can save the finalized document in PDF format or send it electronically to the school.

[0920] Specific examples

[0921] Enter basic information

[0922] 1. The user opens the application and enters basic information about their child. For example, they can enter information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0923] 2. The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate field.

[0924] 3. The server stores this information in a database and manages it in a secure environment.

[0925] Supported by an emotional engine

[0926] 1. The device analyzes the user's facial expressions and voice tone in real time while inputting. For example, facial expression recognition is performed using OpenCV and Python.

[0927] 2. The server analyzes the emotional data and generates feedback such as, "If you have difficulty inputting, please use voice input."

[0928] 3. The device displays this feedback to the user, encouraging smooth input.

[0929] Document preparation and confirmation

[0930] 1. The user selects "Application for Admission."

[0931] 2. The device displays the template and automatically fills in the pre-saved information, for example using Handlebars.js to power the template engine.

[0932] 3. The server generates the auto-filled data and sends it to the device as a confirmation document.

[0933] 4. The user inputs the corrections by voice and performs a final confirmation.

[0934] submission

[0935] 1. The user finalizes the document and selects electronic transmission.

[0936] 2. The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[0937] 3. The server stores the document data and manages it for future reference.

[0938] This invention significantly reduces the burden on parents when completing paperwork, reduces user stress through emotion analysis, and enables efficient and accurate document preparation and submission.

[0939] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0940] Step 1:

[0941] The user launches the application and enters basic information about their child.

[0942] How it works: A user accesses the application URL in a browser on their smartphone or PC.

[0943] Input: Enter basic information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form.

[0944] Output: The basic information entered is sent to the terminal.

[0945] Step 2:

[0946] The device receives the input information and converts the voice data into text.

[0947] How it works: Once text input is complete, if voice input is used, voice data is collected through the device's microphone and converted to text using the Google Cloud Speech-to-Text API.

[0948] Input: The user speaks, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[0949] Output: The audio data is converted to text data and assigned to each field.

[0950] Step 3:

[0951] The server stores the information in a database.

[0952] How it works: Receives basic information sent from the device, encrypts it with AES, and stores it securely in a database.

[0953] Input: Basic information of the user sent from the device (name, date of birth, address, emergency contact, etc.)

[0954] Output: Encrypted basic information stored in the database.

[0955] Step 4:

[0956] The device analyzes the user's facial expressions and tone of voice.

[0957] How it works: It uses the device's camera and microphone to collect the user's facial expressions and voice tone in real time and analyzes them using OpenCV and Python.

[0958] Input: User's facial expression data and voice tone data collected by camera and microphone.

[0959] Output: Analyzed emotion data. For example, if the person is confused, it will be labeled as "confused."

[0960] Step 5:

[0961] The server analyzes the emotion data and generates feedback.

[0962] Behavior: Receives emotion data from the device and generates appropriate feedback, such as a suggestion like "If you have difficulty typing, please use voice input."

[0963] Input: Emotion data sent from the device.

[0964] Output: The generated feedback message.

[0965] Step 6:

[0966] The device displays feedback.

[0967] Behavior: Feedback received from the server is displayed on the screen and presented to the user.

[0968] Input: The feedback message sent by the server.

[0969] Output: Feedback is displayed to the user.

[0970] Step 7:

[0971] The user selects a document template.

[0972] Action: Select the desired document template (e.g., "Application for Admission") from the application menu.

[0973] Input: User selection.

[0974] Output: The selected template will be displayed on the screen.

[0975] Step 8:

[0976] The device automatically fills in basic information into the template.

[0977] What it does: Automatically fills in the appropriate fields of a selected template with pre-stored basic information. Uses a template engine such as Handlebars.js.

[0978] Input: Basic information retrieved from the database and the selected template.

[0979] Output: The completed auto-filled template.

[0980] Step 9:

[0981] The server generates a template and sends the data for verification.

[0982] Operation: A final template is generated based on the automatically entered template data sent from the terminal, and confirmation data is sent to the terminal.

[0983] Input: Auto-filled template data sent from the device.

[0984] Output: The final template data for review.

[0985] Step 10:

[0986] The user reviews and edits the document.

[0987] How it works: Review the auto-filled information and make any necessary corrections. You can also use voice input to make corrections.

[0988] Input: Auto-filled templates and user correction instructions (voice or text).

[0989] Output: The final modified template.

[0990] Step 11:

[0991] The device saves the modified data and saves and sends the file as needed.

[0992] Operation: The user receives the finalized document data and saves it as an electronic file or sends it electronically to the school.

[0993] Input: The final template data confirmed by the user.

[0994] Output: Saved electronic file or submission completion status.

[0995] Step 12:

[0996] The server stores and manages the final data.

[0997] Operation: The finalized document data is permanently stored in a database and managed so that it can be reused.

[0998] Input: Final document data confirmed by the user.

[0999] Output: Final data that has been saved and managed.

[1000] (Application example 2)

[1001] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1002] There is a need to reduce stress and fatigue and improve safety by improving the efficiency of the document preparation required by drivers of autonomous vehicles, and by properly recognizing their emotions while driving and providing appropriate feedback.The present invention aims to provide a system that allows drivers to easily prepare the necessary documents and provides appropriate support based on their emotions while driving.

[1003] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1004] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for analyzing the user's facial expressions and voice tone in real time to recognize emotions, and a means for providing feedback and guidance based on the recognized emotions.This makes it possible to streamline the document preparation required by drivers of autonomous vehicles and to provide appropriate support based on their emotions while driving.

[1005] The "means by which parents input basic information about their children" refers to an interface that allows users to input basic information about their children into a terminal, and includes keyboard input and voice input.

[1006] The "means for automatically inputting information into various application templates" has the function of automatically placing the necessary information into a pre-prepared application template based on the input basic information.

[1007] "Means for saving the entered information and enabling it to be modified or reused as needed" means a function that saves the information entered by the user in a database and allows the information to be modified or reused later.

[1008] "Means for analyzing a user's facial expressions and voice tone in real time and recognizing emotions" refers to a function that uses a camera or microphone to capture a user's facial expressions and voice tone, and analyzes them to infer the user's emotions.

[1009] The "means for providing feedback and guidance based on recognized emotions" has the function of presenting appropriate advice and support content to the user in real time based on the analyzed user emotions.

[1010] A system for implementing this invention provides support for drivers of autonomous vehicles by streamlining the creation of documents and using emotion recognition. The system's main components include a user interface (UI), an emotion recognition engine, a database (DB), a template engine, and an automatic document generation and management function.

[1011] Basic information input phase

[1012] The first thing a user does is enter basic information. They access the application, open a form, and enter basic driver information (such as name, vehicle ID, and contact details). A voice input function is also provided, allowing users to input information using their voice. Speech recognition technology converts the voice into text data.

[1013] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[1014] The server receives the information sent from the device and stores it in a database in a secure environment. The information is also encrypted when stored to prevent unauthorized access from outside.

[1015] Supported by an emotional engine

[1016] The system incorporates an emotion engine that recognizes the user's emotions.

[1017] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[1018] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and presents it to the user. For example, if the user is feeling frustrated, the server will suggest specific operating methods or ways to relax.

[1019] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[1020] Document preparation phase

[1021] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[1022] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if an accident report template is selected, the driver's name, vehicle ID, contact information, etc. will be automatically filled in.

[1023] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[1024] Document verification and submission phase

[1025] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[1026] The terminal receives the finalized document data and provides the option to save it as an electronic file or print it out as needed, or to send it electronically to the relevant authorities.

[1027] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for similar procedures.

[1028] Specific examples

[1029] 1. Enter basic information

[1030] A user opens the application and enters basic driver information. For example, they can enter information such as "Ichiro Sato, vehicle ID 1234-XYZ, 090-1234-5678" into a form, or they can say, "The driver's name is Ichiro Sato, and the vehicle ID is 1234-XYZ."

[1031] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1032] The server stores this information in a database and manages it in a secure environment.

[1033] 2. Support by Emotion Engine

[1034] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[1035] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[1036] The device displays suggestions to the user and prompts them to enter input according to the guide.

[1037] 3. Document preparation and confirmation

[1038] The user selects "Accident Report."

[1039] The device will display a template and automatically fill in the pre-stored information.

[1040] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1041] The user inputs the corrections by voice and performs final confirmation.

[1042] The device will update with the corrections and check again.

[1043] 4. Submission

[1044] The user finalizes the document and selects electronic transmission.

[1045] The terminal sends the confirmed data to the server, where it is stored as an electronic file or transmitted to the relevant institution.

[1046] The server stores the document data and manages it for future reference.

[1047] Example prompt sentence:

[1048] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[1049] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1050] Step 1: Enter basic information

[1051] The user accesses the application, opens a form, and enters the driver's basic information (such as name, vehicle ID, and contact details). Voice input is also available. The device receives this input, and if it is text input, it stores it as is. If it is voice input, it uses voice recognition technology to convert the voice data into text data, which is then assigned appropriately to the respective fields and saved. This saves the input data in text format to the database.

[1052] Step 2: Save to database

[1053] The device sends the entered information to the server. The server receives this information and stores it securely in a database. When stored, the information is encrypted to prevent unauthorized access. This ensures that basic information is stored safely.

[1054] Step 3: Real-time sentiment analysis

[1055] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time. The emotion engine analyzes this data and recognizes the user's emotions. Specifically, it detects facial feature points to classify facial expressions and analyzes the frequency components and tone of voice to evaluate the user's emotional state. This allows the device to understand the user's emotions in real time.

[1056] Step 4: Emotion-based feedback generation

[1057] The server generates appropriate feedback based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it generates specific advice such as "Relax" or "Take a deep breath." This feedback is sent to the device in text format.

[1058] Step 5: Displaying Emotional Feedback

[1059] The terminal receives the feedback sent from the server and displays it to the user. It provides feedback to the user through a display or voice guidance, and also assists the user in continuing the input process. This step helps reduce user stress and maintain a safe driving environment.

[1060] Step 6: Select a document template

[1061] The user accesses the application and selects the desired document template (e.g., accident report) from the menu. The terminal displays the selected template on the screen.

[1062] Step 7: Auto-filling the template

[1063] The device retrieves basic information stored in a database and automatically fills in the appropriate fields in the selected template, eliminating the need to manually enter information.

[1064] Step 8: Check and correct documents

[1065] The user can check the automatically entered document contents and make any necessary corrections. Corrections can also be made using voice input. The device receives the user's correction instructions and updates the document data, so that accurate information is reflected in the template.

[1066] Step 9: Finalize and submit documents

[1067] The user finalizes the document and selects electronic submission. The terminal sends the finalized data to the server, which saves it as an electronic file or sends it to the relevant authority. It also provides the option to print it out if necessary. The server saves the finalized document data and manages it for future reference. This step realizes efficient document preparation and submission.

[1068] Adding specific examples

[1069] Example prompt sentence:

[1070] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[1071] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1072] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1073] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1074] [Third embodiment]

[1075] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1076] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1077] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1078] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1079] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1080] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1081] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1082] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1083] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1084] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1085] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1086] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1087] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. The main components of the system include a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function.

[1088] Basic information input phase

[1089] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. At this time, voice recognition technology converts the voice into text data.

[1090] The device receives the information entered by the user, assigns it to the appropriate fields, stores it, and can also convert voice input to text if necessary.

[1091] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[1092] Document preparation phase

[1093] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[1094] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[1095] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[1096] Document verification and submission phase

[1097] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[1098] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[1099] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[1100] Specific examples

[1101] 1. Enter basic information

[1102] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1103] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1104] The server stores this information in a database and manages it in a secure environment.

[1105] 2. Document preparation and confirmation

[1106] The user selects "Application for Admission."

[1107] The device will display a template and automatically fill in the pre-stored information.

[1108] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1109] The user inputs the corrections by voice and performs final confirmation.

[1110] The device will update with the corrections and check again.

[1111] 3. Submission

[1112] The user finalizes the document and selects electronic transmission.

[1113] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[1114] The server stores the document data and manages it for future reference.

[1115] This will significantly reduce the burden on parents of creating documents and improve the efficiency of paper document management in educational settings. By introducing voice input, information can be entered even more efficiently, realizing consistent document management.

[1116] The processing flow will be explained below.

[1117] Step 1:

[1118] A user logs in to a dedicated web or mobile application.

[1119] Step 2:

[1120] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[1121] Step 3:

[1122] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[1123] Step 4:

[1124] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[1125] Step 5:

[1126] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[1127] Step 6:

[1128] The terminal transmits the verified basic information to the server.

[1129] Step 7:

[1130] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[1131] Step 8:

[1132] The server returns a status of successful saving to the terminal.

[1133] Step 9:

[1134] The device displays a message to the user confirming successful save.

[1135] Step 10:

[1136] The user selects document creation and chooses the desired document template (e.g., admission application).

[1137] Step 11:

[1138] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[1139] Step 12:

[1140] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[1141] Step 13:

[1142] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[1143] Step 14:

[1144] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[1145] Step 15:

[1146] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[1147] Step 16:

[1148] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[1149] Step 17:

[1150] The terminal displays a final confirmation screen to the user and provides a confirm button.

[1151] Step 18:

[1152] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[1153] Step 19:

[1154] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[1155] Step 20:

[1156] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[1157] Step 21:

[1158] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[1159] This will make processing across the entire system more efficient, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings.

[1160] Example 1

[1161] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1162] With conventional document creation systems, parents had to manually input the same information every time, which was a huge burden in terms of time and effort. Furthermore, since voice input was not possible, efficient input was not possible. Furthermore, it was not easy to edit created documents or reuse past information, making document management cumbersome.

[1163] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1164] In this invention, the server includes a means for parents to input basic information about their children, a means for selecting a specific document template and automatically inputting the pre-saved basic information into the template, a means for inputting the basic information using voice input and converting it into text data using voice recognition technology, and a means for saving or printing the confirmed document data as an electronic file depending on the input format, thereby significantly reducing the parent's workload and enabling efficient document creation and management.

[1165] The "basic information input means" is a means by which parents input information such as their child's name, date of birth, address, and emergency contact information.

[1166] "Speech recognition technology" is a technology that converts voice-input information into text data, accurately recognizing voice and converting it into text information.

[1167] An "application template" is a predefined form for a specific document format, into which information entered by a user can be automatically incorporated.

[1168] The "automatic input means" is a function that automatically inputs the saved basic information into the appropriate fields of the application template.

[1169] "Means for correction" refers to the means by which a user can check the automatically entered information and change or correct the information as necessary.

[1170] "Reuse means" is a function that allows saved information and created documents to be reused the next time an application is created.

[1171] "Electronic file storage means" refers to a means for storing confirmed document data as a digital file.

[1172] The "printing means" is a means for printing the determined document data onto physical paper.

[1173] "Document submission means" means the electronic transmission or physical submission of finalized documents.

[1174] "Server" means a computer system that receives input information, safely stores and manages it, and provides and transmits information as needed.

[1175] This invention is a system that streamlines the preparation of documents required by parents when their children enroll in kindergarten or school. The system includes a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function. Below, we will explain how each part of the system works.

[1176] Basic information input phase

[1177] User

[1178] Users access the application and proceed to the dashboard from the login screen, where they enter basic information about their child.

[1179] For example, enter information such as "Ichiro Tanaka, March 15, 2015, 1-1-1 Minami-Aoyama, Minato-ku, Tokyo, 080-1234-5678." When using voice input, say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[1180] Example prompt: "Please enter your child's information: name, date of birth, address, and emergency contact information, in that order."

[1181] Terminal

[1182] Receives and temporarily stores text data entered by the user. If voice input is used, converts the voice into text data using voice recognition technology, for example, using the Google Speech-to-Text API.

[1183] Assign each piece of information to the appropriate field.

[1184] server

[1185] The server receives the data sent from the device and stores it securely in a database, encrypting it using the AES-256 encryption algorithm.

[1186] Document preparation phase

[1187] User

[1188] Select the desired document template (e.g., application form) from the "Create Document" menu on your dashboard.

[1189] Example prompt: "Please complete your application form. Please review the required information and enter any corrections."

[1190] Terminal

[1191] The selected template is displayed on the screen, and the pre-saved basic information is automatically entered into the appropriate fields of the template.

[1192] server

[1193] A template with auto-filling completed is generated, and confirmation data is sent to the terminal, where it is displayed so that the user can check and correct it.

[1194] Document verification and submission phase

[1195] User

[1196] The user can check the automatically entered document contents and make corrections as necessary. Corrections can also be made by voice input.

[1197] Example of correction: Voice input "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1198] Once confirmed, the user selects the submission format: electronic file saving, printing, or electronic submission to the school.

[1199] Example prompt: "Would you like to finalize and submit your documents? Please answer yes or no."

[1200] Terminal

[1201] Receives the finalized document data and processes it based on the selected submission format, for example converting it to PDF format and saving it as an electronic file or sending it to a printer.

[1202] server

[1203] Securely store finalized document data and manage it for future use. Manage data so it can be reused for multiple years.

[1204] This system significantly reduces the amount of paperwork parents have to fill out when enrolling their children in kindergarten or school, enabling efficient document management. The introduction of a voice input function also allows for efficient information entry.

[1205] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1206] Step 1: Enter basic information

[1207] The user accesses the application and logs in. After accessing the dashboard, they enter their child's basic information (name, date of birth, address, emergency contact, etc.) into the form. If using voice input, they can say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[1208] Input: Your child's basic information, including name, date of birth, address, and emergency contact details.

[1209] Output: If voice is used, text data is generated by speech recognition and saved as text data.

[1210] What it does: When a user enters information into a form, it is automatically saved. If the user enters information by voice, the device converts the voice data into text using the Google Speech-to-Text API.

[1211] Step 2: Save your data

[1212] The device temporarily stores the entered text data, and if voice input is used, the converted text data as well.

[1213] Input: Text data entered by the user or data converted from speech.

[1214] Output: Well-formed text data.

[1215] Specific behavior: Assigns input data to appropriate fields. Formats it according to a specific format.

[1216] Step 3: Data transmission and encryption storage

[1217] The terminal transmits the well-formatted data to the server.

[1218] The server encrypts the received data using an encryption algorithm such as AES-256 and stores it securely in a database.

[1219] Input: Well-formed text data.

[1220] Output: The encrypted text data is stored in the database.

[1221] Specific operation: After the device sends data, the server immediately encrypts the received data and stores it in a secure database, and also performs data integrity checks.

[1222] Step 4: Select a document template

[1223] The user selects the "Document Creation" menu on the dashboard and chooses the desired document template (e.g., application for admission).

[1224] Input: User selection from a list of document templates.

[1225] Output: The selected template will be displayed on the screen.

[1226] Specific operation: Based on the user's selection, the terminal loads a template from the list and displays it on the screen.

[1227] Step 5: Autofill

[1228] The device automatically fills in the appropriate fields in a template with basic information stored in advance, such as a child's name, address, and emergency contact information, into a school application template.

[1229] Input: Pre-saved basic information.

[1230] Output: A template with basic information automatically filled in.

[1231] Specific action: Map and enter the appropriate basic information for each field in the template.

[1232] Step 6: Generate and send verification data

[1233] The server generates a template with the automatic input completed and sends the confirmation data to the terminal.

[1234] Input: Auto-filled template data.

[1235] Output: Verification data is sent to the terminal.

[1236] Specific operation: The server checks the template data and sends it to the terminal for the user to confirm.

[1237] Step 7: Check and correct the document contents

[1238] The user can check the automatically entered document contents on the screen and make corrections as necessary. Voice input is also possible. For example, a user can say, "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1239] Input: Document template for confirmation, correction details.

[1240] Output: Corrected final confirmation document.

[1241] Specific operation: The user's modifications are reflected and the confirmation screen is displayed again to the user.

[1242] Step 8: Finalize documents and select submission format

[1243] The user makes a final review of the documents and selects the submission format (electronic file saving, printout, or electronic submission to the school).

[1244] Input: Final confirmed document data, selection of submission format.

[1245] Output: Finalized document data.

[1246] Specific Actions: Starts processing based on the submission format selected by the user, for example converting to PDF and deciding whether to save as an electronic file or send to a printer.

[1247] Step 9: Save and send the document

[1248] The terminal transmits the determined document data to the server for processing based on the selected format.

[1249] The server securely stores the finalized document data and processes it appropriately based on the selected format (electronic file storage, print transmission).

[1250] Input: Confirmed document data, submission format.

[1251] Output: Saved document data.

[1252] What happens: The server stores the data and sends or saves the document in the format selected by the user.

[1253] (Application example 1)

[1254] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1255] Previously, when parents prepared the various application documents required for their children's school or kindergarten enrollment, it took a great deal of time and effort, and the process of inputting and checking information was extremely cumbersome. Furthermore, manual input of information made it prone to errors, creating a need for efficient document management. Furthermore, submissions to educational institutions were typically made on paper, with insufficient support for electronic data transmission. To solve these issues, a system was needed that allowed parents to easily and efficiently prepare and manage application documents and submit them electronically.

[1256] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1257] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for inputting information using voice recognition technology and converting voice data into text data, and a means for electronically transmitting the information to various devices. This allows parents to efficiently input, manage, and modify information without cumbersome manual work, and enables the entire process from document creation to submission to be done electronically.

[1258] The "means for parents to input basic information about their children" refers to a device or system that provides an interface for users to input basic information such as their children's names, birth dates, addresses, and emergency contact details.

[1259] "Means for automatically entering data into various application templates based on basic information" refers to a function that uses the entered basic information to automatically fill in the necessary data into pre-prepared application templates.

[1260] "Means for saving input information and enabling it to be modified or reused as necessary" refers to technical means for saving input information in a database or the like, and for later checking, modifying, or reusing the information.

[1261] "Means of using voice recognition technology to input information and convert voice data into text data" refers to a method that uses voice recognition technology to analyze data input by voice and convert it into text format.

[1262] "Means for electronic transmission to various devices" refers to a function for transmitting generated documents and data to various electronic devices such as mobile terminals and computers.

[1263] "Means for linking information about siblings" refers to technology that automatically links information about siblings based on stored information, allowing them to be mutually referenced.

[1264] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. This system can be implemented using the following hardware and software configuration.

[1265] Basic information input phase

[1266] The first thing a user does is enter basic information. Using a device such as a smartphone or tablet, users enter basic information about their child. Specifically, they enter information such as name, date of birth, address, and emergency contact information into a form. A voice input function is also available, allowing users to enter information using their voice. In this case, voice recognition technology (such as Google Cloud Speech-to-Text) converts the voice into text data. The device receives the information entered by the user and stores it by appropriately assigning it to each field. The server receives the information sent from the device and securely stores it in a database (such as MongoDB). The information is encrypted when stored to prevent unauthorized access from outside.

[1267] Document preparation phase

[1268] When a user wants to create a specific document, they access the application and select the desired document template from the menu. The device displays the selected template on the screen and automatically fills in the appropriate fields with pre-stored information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically filled in. The server generates the completed template and sends confirmation data to the device. The user can review the content and make corrections as necessary. They can also use voice input again to make corrections.

[1269] Document verification and submission phase

[1270] The user checks the automatically entered document contents and makes any necessary corrections. Once the corrections are complete, the user confirms the document. The terminal receives the confirmed document data and provides the option to save it as an electronic file or print it out as needed. It can also be sent electronically to the educational institution. The server stores the final confirmed document data and manages it for future use. For example, the information can be retained so that it can be reused in the next year's admissions process.

[1271] Specific examples

[1272] 1. Enter basic information

[1273] The user opens the application and enters basic information about their child. For example, they might say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, and his emergency contact number is 090-1234-5678."

[1274] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1275] The server stores this information in a database and manages it in a secure environment.

[1276] 2. Document preparation and confirmation

[1277] The user selects "Application for Admission."

[1278] The device will display a template and automatically fill in the pre-stored information.

[1279] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1280] The user inputs the corrections by voice and performs final confirmation.

[1281] The device will update with the corrections and check again.

[1282] 3. Submission

[1283] The user finalizes the document and selects electronic transmission.

[1284] The device sends the finalized data to a server, where it is stored as an electronic file or sent to the educational institution.

[1285] The server stores the document data and manages it for future reference.

[1286] Prompt Sentence Examples

[1287] "Please enter your child's basic information. Enter their name, date of birth, address, and emergency contact information in that order."

[1288] "The following template will be automatically filled in based on the information you entered. Please review the content and make any necessary corrections by voice or text input."

[1289] This system frees parents from the hassle of completing complicated paperwork and allows them to complete the application process efficiently and accurately.

[1290] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1291] Step 1:

[1292] The user enters basic information about their child using a device such as a smartphone or tablet. Input methods include text input and voice input. When using voice input, the device uses voice recognition technology to convert speech into text data. Specifically, the Google Cloud Speech-to-Text API is used to convert voice data into text in real time. The entered information (e.g., name, date of birth, address, emergency contact information, etc.) is temporarily stored in the device's memory.

[1293] Input: Child's basic information in voice or text format

[1294] Processing: Converts voice data into text data, stores the text data in memory

[1295] Output: Basic information data in text format

[1296] Step 2:

[1297] The device sends the entered basic information to the server. The server encrypts the received data and stores it in a database. This is done using a database system such as MongoDB to ensure secure management. The encryption process uses, for example, AES (Advanced Encryption Standard) technology.

[1298] Input: Basic information data in text format

[1299] Processing: Encrypting data and storing it in a database

[1300] Output: Encrypted basic information data stored in a database

[1301] Step 3:

[1302] When a user wants to create a particular document, they select the desired document template from the application's menu, which is then generated by a template engine (e.g., Handlebars.js) and displayed on the screen.

[1303] Input: User's template selection

[1304] Processing: Generate and display the template

[1305] Output: Screen display of the selected template

[1306] Step 4:

[1307] The server automatically fills in the appropriate fields in the template with the basic information stored in the form, such as the child's name, address, and emergency contact information, and generates the document automatically.

[1308] Input: Template, basic information data

[1309] Action: Auto-fill template

[1310] Output: Auto-filled document data

[1311] Step 5:

[1312] The user can review the automatically entered document contents and make corrections as necessary. Both text and voice input methods are available for corrections. In the case of voice input, voice recognition technology is again used to convert the voice into text data.

[1313] Input: Auto-filled document data, corrections (text or voice)

[1314] Processing: speech recognition and text conversion, data correction

[1315] Output: Corrected document data

[1316] Step 6:

[1317] The user validates the document. The device sends the validated document data to the server, which stores it in a database. Furthermore, electronic submission to the educational institution is possible, for example by email or through a dedicated online submission system.

[1318] Input: Confirmed document data

[1319] Processing: storage in database, electronic transmission to educational institution

[1320] Output: Saved final document data, electronic transmission confirmation

[1321] Step 7:

[1322] The server manages the finalized document data for future use. For example, it retains the information so that it can be reused for the next year's admissions process. This data management process also includes data backup and restore functions.

[1323] Input: Confirmed document data

[1324] Processing: Data management, backup, and restoration

[1325] Output: A reusable dataset

[1326] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1327] This invention is a system that streamlines the process of parents preparing the necessary documents for their children's kindergarten and school enrollment, and also has the ability to recognize the user's emotions and adjust the guide accordingly. The main components of the system include the following: a user interface for parents to enter their child's basic information, an emotion engine, a database, a template engine, and an automatic document generation and management function.

[1328] Basic information input phase

[1329] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. Speech recognition technology converts the voice into text data.

[1330] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[1331] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[1332] Supported by an emotional engine

[1333] The system incorporates an emotion engine that recognizes the user's emotions.

[1334] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[1335] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and displays it to the user. For example, if the user is feeling frustrated, the server will suggest ways to make input easier, such as copy and paste.

[1336] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[1337] Document preparation phase

[1338] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[1339] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[1340] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[1341] Document verification and submission phase

[1342] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[1343] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[1344] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[1345] Specific examples

[1346] 1. Enter basic information

[1347] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1348] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1349] The server stores this information in a database and manages it in a secure environment.

[1350] 2. Support by Emotion Engine

[1351] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[1352] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[1353] The device displays suggestions to the user and prompts them to enter input according to the guide.

[1354] 3. Document preparation and confirmation

[1355] The user selects "Application for Admission."

[1356] The device will display a template and automatically fill in the pre-stored information.

[1357] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1358] The user inputs the corrections by voice and performs final confirmation.

[1359] The device will update with the corrections and check again.

[1360] 4. Submission

[1361] The user finalizes the document and selects electronic transmission.

[1362] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[1363] The server stores the document data and manages it for future reference.

[1364] This not only significantly reduces the burden of paperwork for parents, but also reduces stress through user emotion analysis, providing an efficient communication environment. The introduction of an emotion engine improves the user experience, enabling smoother and more accurate input.

[1365] The processing flow will be explained below.

[1366] Step 1:

[1367] A user logs in to a dedicated web or mobile application.

[1368] Step 2:

[1369] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[1370] Step 3:

[1371] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[1372] Step 4:

[1373] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[1374] Step 5:

[1375] The device evaluates the user's emotions through an emotion engine that analyzes emotions in real time using facial images and voice tones.

[1376] Step 6:

[1377] The server determines the user's emotional state based on the emotional data sent from the emotion engine. For example, it analyzes whether the user is having trouble or is inputting information smoothly.

[1378] Step 7:

[1379] Based on the results of the assessment, the device will display input guidance or support messages as necessary. For example, if it determines that the user is having difficulty, it will display a message saying, "Using voice input will make input easier."

[1380] Step 8:

[1381] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[1382] Step 9:

[1383] The terminal transmits the verified basic information to the server.

[1384] Step 10:

[1385] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[1386] Step 11:

[1387] The server returns a status of successful saving to the terminal.

[1388] Step 12:

[1389] The device displays a message to the user confirming successful save.

[1390] Step 13:

[1391] The user selects document creation and chooses the desired document template (e.g., admission application).

[1392] Step 14:

[1393] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[1394] Step 15:

[1395] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[1396] Step 16:

[1397] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[1398] Step 17:

[1399] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[1400] Step 18:

[1401] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[1402] Step 19:

[1403] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[1404] Step 20:

[1405] The terminal displays a final confirmation screen to the user and provides a confirm button.

[1406] Step 21:

[1407] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[1408] Step 22:

[1409] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[1410] Step 23:

[1411] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[1412] Step 24:

[1413] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[1414] This will improve the efficiency of the system's overall processing, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings. The introduction of the emotion engine will improve the user experience and make input work even smoother.

[1415] Example 2

[1416] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1417] In the previous system, parents had to fill out a lot of paperwork when enrolling their children in kindergarten or school, which was time-consuming and made it difficult to complete the paperwork efficiently. The complicated input process often led to mistakes and stress. Furthermore, the system lacked the ability to recognize users' emotions and provide appropriate feedback, resulting in a poor user experience.

[1418] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1419] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for recognizing the user's emotions and generating appropriate feedback, and a means for displaying the generated feedback to the user. This reduces the burden on parents when completing documents, reduces input errors and stress, and enables an improved user experience through emotion recognition.

[1420] "Parent" means the legal guardian or guardian of a child.

[1421] "Child" refers to a minor who is planning to enroll in an educational institution.

[1422] "Basic information" refers to information that can be used to identify a specific individual, such as name, date of birth, address, and emergency contact information.

[1423] An "application template" refers to a standard document format for entering the necessary information for a specific purpose.

[1424] "Autofill" refers to the process of automatically filling in information into input fields using pre-stored data.

[1425] "Saving" refers to recording the input information in a storage device such as a database.

[1426] "Modification" refers to making changes to existing input data.

[1427] "Reuse" refers to the reuse of information that has been stored at a later time.

[1428] "Emotion recognition" refers to technology that analyzes a user's facial expressions and vocal tone to estimate their emotional state.

[1429] "Feedback" refers to suggestions and advice provided based on a user's behavior or state.

[1430] "User" refers to a person who uses this system to create documents.

[1431] "Terminal" refers to a device used by a user, such as a computer or smartphone.

[1432] "Server" refers to a remote computing system for processing and storing data.

[1433] This invention is a system that streamlines the process of parents filling out the necessary paperwork for their children's kindergarten and school enrollment, and also recognizes the user's emotions and provides appropriate guidance. The system consists of the following main components:

[1434] 1. User Interface (UI)

[1435] It provides a user interface (UI) that can be accessed on a smartphone or PC as a means for parents to enter basic information about their children. This UI is equipped with a voice input function in addition to keyboard input. Voice input uses the Google Cloud Speech-to-Text API to convert voice data into text data.

[1436] 2. Database

[1437] The basic information entered is securely stored in a database. The server applies AES encryption to the received data and stores it in a database in an environment protected from unauthorized access. The database is designed to permanently store and manage information for future use.

[1438] 3. Emotion Engine

[1439] The user interface uses a camera and microphone for real-time facial recognition and voice tone analysis to identify the user's emotions. Emotion recognition uses OpenCV and Python. For example, if the user expresses confusion or nervousness while typing, the system will detect this and generate appropriate feedback.

[1440] 4. Template Engine

[1441] A template engine is used to automatically generate documents. For example, by using Handlebars.js, pre-saved basic information can be automatically embedded into various application templates. Once a template is selected, the necessary information is automatically loaded.

[1442] 5. Automatic document generation and management function

[1443] When a user selects a specific document template, basic information is automatically entered to generate a completed document. For example, if a template such as an "application for admission" is selected, the child's name and address are automatically entered. After reviewing and correcting this automatically generated document, the user can save the finalized document in PDF format or send it electronically to the school.

[1444] Specific examples

[1445] Enter basic information

[1446] 1. The user opens the application and enters basic information about their child. For example, they can enter information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1447] 2. The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate field.

[1448] 3. The server stores this information in a database and manages it in a secure environment.

[1449] Supported by an emotional engine

[1450] 1. The device analyzes the user's facial expressions and voice tone in real time while inputting. For example, facial expression recognition is performed using OpenCV and Python.

[1451] 2. The server analyzes the emotional data and generates feedback such as, "If you have difficulty inputting, please use voice input."

[1452] 3. The device displays this feedback to the user, encouraging smooth input.

[1453] Document preparation and confirmation

[1454] 1. The user selects "Application for Admission."

[1455] 2. The device displays the template and automatically fills in the pre-saved information, for example using Handlebars.js to power the template engine.

[1456] 3. The server generates the auto-filled data and sends it to the device as a confirmation document.

[1457] 4. The user inputs the corrections by voice and performs a final confirmation.

[1458] submission

[1459] 1. The user finalizes the document and selects electronic transmission.

[1460] 2. The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[1461] 3. The server stores the document data and manages it for future reference.

[1462] This invention significantly reduces the burden on parents when completing paperwork, reduces user stress through emotion analysis, and enables efficient and accurate document preparation and submission.

[1463] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1464] Step 1:

[1465] The user launches the application and enters basic information about their child.

[1466] How it works: A user accesses the application URL in a browser on their smartphone or PC.

[1467] Input: Enter basic information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form.

[1468] Output: The basic information entered is sent to the terminal.

[1469] Step 2:

[1470] The device receives the input information and converts the voice data into text.

[1471] How it works: Once text input is complete, if voice input is used, voice data is collected through the device's microphone and converted to text using the Google Cloud Speech-to-Text API.

[1472] Input: The user speaks, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1473] Output: The audio data is converted to text data and assigned to each field.

[1474] Step 3:

[1475] The server stores the information in a database.

[1476] How it works: Receives basic information sent from the device, encrypts it with AES, and stores it securely in a database.

[1477] Input: Basic information of the user sent from the device (name, date of birth, address, emergency contact, etc.)

[1478] Output: Encrypted basic information stored in the database.

[1479] Step 4:

[1480] The device analyzes the user's facial expressions and tone of voice.

[1481] How it works: It uses the device's camera and microphone to collect the user's facial expressions and voice tone in real time and analyzes them using OpenCV and Python.

[1482] Input: User's facial expression data and voice tone data collected by camera and microphone.

[1483] Output: Analyzed emotion data. For example, if the person is confused, it will be labeled as "confused."

[1484] Step 5:

[1485] The server analyzes the emotion data and generates feedback.

[1486] Behavior: Receives emotion data from the device and generates appropriate feedback, such as a suggestion like "If you have difficulty typing, please use voice input."

[1487] Input: Emotion data sent from the device.

[1488] Output: The generated feedback message.

[1489] Step 6:

[1490] The device displays feedback.

[1491] Behavior: Feedback received from the server is displayed on the screen and presented to the user.

[1492] Input: The feedback message sent by the server.

[1493] Output: Feedback is displayed to the user.

[1494] Step 7:

[1495] The user selects a document template.

[1496] Action: Select the desired document template (e.g., "Application for Admission") from the application menu.

[1497] Input: User selection.

[1498] Output: The selected template will be displayed on the screen.

[1499] Step 8:

[1500] The device automatically fills in basic information into the template.

[1501] What it does: Automatically fills in the appropriate fields of a selected template with pre-stored basic information. Uses a template engine such as Handlebars.js.

[1502] Input: Basic information retrieved from the database and the selected template.

[1503] Output: The completed auto-filled template.

[1504] Step 9:

[1505] The server generates a template and sends the data for verification.

[1506] Operation: A final template is generated based on the automatically entered template data sent from the terminal, and confirmation data is sent to the terminal.

[1507] Input: Auto-filled template data sent from the device.

[1508] Output: The final template data for review.

[1509] Step 10:

[1510] The user reviews and edits the document.

[1511] How it works: Review the auto-filled information and make any necessary corrections. You can also use voice input to make corrections.

[1512] Input: Auto-filled templates and user correction instructions (voice or text).

[1513] Output: The final modified template.

[1514] Step 11:

[1515] The device saves the modified data and saves and sends the file as needed.

[1516] Operation: The user receives the finalized document data and saves it as an electronic file or sends it electronically to the school.

[1517] Input: The final template data confirmed by the user.

[1518] Output: Saved electronic file or submission completion status.

[1519] Step 12:

[1520] The server stores and manages the final data.

[1521] Operation: The finalized document data is permanently stored in a database and managed so that it can be reused.

[1522] Input: Final document data confirmed by the user.

[1523] Output: Final data that has been saved and managed.

[1524] (Application example 2)

[1525] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1526] There is a need to reduce stress and fatigue and improve safety by improving the efficiency of the document preparation required by drivers of autonomous vehicles, and by properly recognizing their emotions while driving and providing appropriate feedback.The present invention aims to provide a system that allows drivers to easily prepare the necessary documents and provides appropriate support based on their emotions while driving.

[1527] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1528] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for analyzing the user's facial expressions and voice tone in real time to recognize emotions, and a means for providing feedback and guidance based on the recognized emotions.This makes it possible to streamline the document preparation required by drivers of autonomous vehicles and to provide appropriate support based on their emotions while driving.

[1529] The "means by which parents input basic information about their children" refers to an interface that allows users to input basic information about their children into a terminal, and includes keyboard input and voice input.

[1530] The "means for automatically inputting information into various application templates" has the function of automatically placing the necessary information into a pre-prepared application template based on the input basic information.

[1531] "Means for saving the entered information and enabling it to be modified or reused as needed" means a function that saves the information entered by the user in a database and allows the information to be modified or reused later.

[1532] "Means for analyzing a user's facial expressions and voice tone in real time and recognizing emotions" refers to a function that uses a camera or microphone to capture a user's facial expressions and voice tone, and analyzes them to infer the user's emotions.

[1533] The "means for providing feedback and guidance based on recognized emotions" has the function of presenting appropriate advice and support content to the user in real time based on the analyzed user emotions.

[1534] A system for implementing this invention provides support for drivers of autonomous vehicles by streamlining the creation of documents and using emotion recognition. The system's main components include a user interface (UI), an emotion recognition engine, a database (DB), a template engine, and an automatic document generation and management function.

[1535] Basic information input phase

[1536] The first thing a user does is enter basic information. They access the application, open a form, and enter basic driver information (such as name, vehicle ID, and contact details). A voice input function is also provided, allowing users to input information using their voice. Speech recognition technology converts the voice into text data.

[1537] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[1538] The server receives the information sent from the device and stores it in a database in a secure environment. The information is also encrypted when stored to prevent unauthorized access from outside.

[1539] Supported by an emotional engine

[1540] The system incorporates an emotion engine that recognizes the user's emotions.

[1541] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[1542] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and presents it to the user. For example, if the user is feeling frustrated, the server will suggest specific operating methods or ways to relax.

[1543] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[1544] Document preparation phase

[1545] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[1546] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if an accident report template is selected, the driver's name, vehicle ID, contact information, etc. will be automatically filled in.

[1547] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[1548] Document verification and submission phase

[1549] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[1550] The terminal receives the finalized document data and provides the option to save it as an electronic file or print it out as needed, or to send it electronically to the relevant authorities.

[1551] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for similar procedures.

[1552] Specific examples

[1553] 1. Enter basic information

[1554] A user opens the application and enters basic driver information. For example, they can enter information such as "Ichiro Sato, vehicle ID 1234-XYZ, 090-1234-5678" into a form, or they can say, "The driver's name is Ichiro Sato, and the vehicle ID is 1234-XYZ."

[1555] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1556] The server stores this information in a database and manages it in a secure environment.

[1557] 2. Support by Emotion Engine

[1558] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[1559] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[1560] The device displays suggestions to the user and prompts them to enter input according to the guide.

[1561] 3. Document preparation and confirmation

[1562] The user selects "Accident Report."

[1563] The device will display a template and automatically fill in the pre-stored information.

[1564] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1565] The user inputs the corrections by voice and performs final confirmation.

[1566] The device will update with the corrections and check again.

[1567] 4. Submission

[1568] The user finalizes the document and selects electronic transmission.

[1569] The terminal sends the confirmed data to the server, where it is stored as an electronic file or transmitted to the relevant institution.

[1570] The server stores the document data and manages it for future reference.

[1571] Example prompt sentence:

[1572] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[1573] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1574] Step 1: Enter basic information

[1575] The user accesses the application, opens a form, and enters the driver's basic information (such as name, vehicle ID, and contact details). Voice input is also available. The device receives this input, and if it is text input, it stores it as is. If it is voice input, it uses voice recognition technology to convert the voice data into text data, which is then assigned appropriately to the respective fields and saved. This saves the input data in text format to the database.

[1576] Step 2: Save to database

[1577] The device sends the entered information to the server. The server receives this information and stores it securely in a database. When stored, the information is encrypted to prevent unauthorized access. This ensures that basic information is stored safely.

[1578] Step 3: Real-time sentiment analysis

[1579] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time. The emotion engine analyzes this data and recognizes the user's emotions. Specifically, it detects facial feature points to classify facial expressions and analyzes the frequency components and tone of voice to evaluate the user's emotional state. This allows the device to understand the user's emotions in real time.

[1580] Step 4: Emotion-based feedback generation

[1581] The server generates appropriate feedback based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it generates specific advice such as "Relax" or "Take a deep breath." This feedback is sent to the device in text format.

[1582] Step 5: Displaying Emotional Feedback

[1583] The terminal receives the feedback sent from the server and displays it to the user. It provides feedback to the user through a display or voice guidance, and also assists the user in continuing the input process. This step helps reduce user stress and maintain a safe driving environment.

[1584] Step 6: Select a document template

[1585] The user accesses the application and selects the desired document template (e.g., accident report) from the menu. The terminal displays the selected template on the screen.

[1586] Step 7: Auto-filling the template

[1587] The device retrieves basic information stored in a database and automatically fills in the appropriate fields in the selected template, eliminating the need to manually enter information.

[1588] Step 8: Check and correct documents

[1589] The user can check the automatically entered document contents and make any necessary corrections. Corrections can also be made using voice input. The device receives the user's correction instructions and updates the document data, so that accurate information is reflected in the template.

[1590] Step 9: Finalize and submit documents

[1591] The user finalizes the document and selects electronic submission. The terminal sends the finalized data to the server, which saves it as an electronic file or sends it to the relevant authority. It also provides the option to print it out if necessary. The server saves the finalized document data and manages it for future reference. This step realizes efficient document preparation and submission.

[1592] Adding specific examples

[1593] Example prompt sentence:

[1594] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[1595] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1596] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1597] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1598] [Fourth embodiment]

[1599] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1600] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1601] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1602] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1603] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1604] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1605] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1606] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1607] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1608] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1609] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1610] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1611] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1612] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. The main components of the system include a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function.

[1613] Basic information input phase

[1614] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. At this time, voice recognition technology converts the voice into text data.

[1615] The device receives the information entered by the user, assigns it to the appropriate fields, stores it, and can also convert voice input to text if necessary.

[1616] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[1617] Document preparation phase

[1618] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[1619] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[1620] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[1621] Document verification and submission phase

[1622] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[1623] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[1624] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[1625] Specific examples

[1626] 1. Enter basic information

[1627] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1628] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1629] The server stores this information in a database and manages it in a secure environment.

[1630] 2. Document preparation and confirmation

[1631] The user selects "Application for Admission."

[1632] The device will display a template and automatically fill in the pre-stored information.

[1633] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1634] The user inputs the corrections by voice and performs final confirmation.

[1635] The device will update with the corrections and check again.

[1636] 3. Submission

[1637] The user finalizes the document and selects electronic transmission.

[1638] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[1639] The server stores the document data and manages it for future reference.

[1640] This will significantly reduce the burden on parents of creating documents and improve the efficiency of paper document management in educational settings. By introducing voice input, information can be entered even more efficiently, realizing consistent document management.

[1641] The processing flow will be explained below.

[1642] Step 1:

[1643] A user logs in to a dedicated web or mobile application.

[1644] Step 2:

[1645] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[1646] Step 3:

[1647] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[1648] Step 4:

[1649] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[1650] Step 5:

[1651] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[1652] Step 6:

[1653] The terminal transmits the verified basic information to the server.

[1654] Step 7:

[1655] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[1656] Step 8:

[1657] The server returns a status of successful saving to the terminal.

[1658] Step 9:

[1659] The device displays a message to the user confirming successful save.

[1660] Step 10:

[1661] The user selects document creation and chooses the desired document template (e.g., admission application).

[1662] Step 11:

[1663] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[1664] Step 12:

[1665] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[1666] Step 13:

[1667] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[1668] Step 14:

[1669] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[1670] Step 15:

[1671] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[1672] Step 16:

[1673] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[1674] Step 17:

[1675] The terminal displays a final confirmation screen to the user and provides a confirm button.

[1676] Step 18:

[1677] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[1678] Step 19:

[1679] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[1680] Step 20:

[1681] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[1682] Step 21:

[1683] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[1684] This will make processing across the entire system more efficient, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings.

[1685] Example 1

[1686] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1687] With conventional document creation systems, parents had to manually input the same information every time, which was a huge burden in terms of time and effort. Furthermore, since voice input was not possible, efficient input was not possible. Furthermore, it was not easy to edit created documents or reuse past information, making document management cumbersome.

[1688] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1689] In this invention, the server includes a means for parents to input basic information about their children, a means for selecting a specific document template and automatically inputting the pre-saved basic information into the template, a means for inputting the basic information using voice input and converting it into text data using voice recognition technology, and a means for saving or printing the confirmed document data as an electronic file depending on the input format, thereby significantly reducing the parent's workload and enabling efficient document creation and management.

[1690] The "basic information input means" is a means by which parents input information such as their child's name, date of birth, address, and emergency contact information.

[1691] "Speech recognition technology" is a technology that converts voice-input information into text data, accurately recognizing voice and converting it into text information.

[1692] An "application template" is a predefined form for a specific document format, into which information entered by a user can be automatically incorporated.

[1693] The "automatic input means" is a function that automatically inputs the saved basic information into the appropriate fields of the application template.

[1694] "Means for correction" refers to the means by which a user can check the automatically entered information and change or correct the information as necessary.

[1695] "Reuse means" is a function that allows saved information and created documents to be reused the next time an application is created.

[1696] "Electronic file storage means" refers to a means for storing confirmed document data as a digital file.

[1697] The "printing means" is a means for printing the determined document data onto physical paper.

[1698] "Document submission means" means the electronic transmission or physical submission of finalized documents.

[1699] "Server" means a computer system that receives input information, safely stores and manages it, and provides and transmits information as needed.

[1700] This invention is a system that streamlines the preparation of documents required by parents when their children enroll in kindergarten or school. The system includes a user interface for parents to enter basic information about their children, a database, a template engine, and an automatic document generation and management function. Below, we will explain how each part of the system works.

[1701] Basic information input phase

[1702] User

[1703] Users access the application and proceed to the dashboard from the login screen, where they enter basic information about their child.

[1704] For example, enter information such as "Ichiro Tanaka, March 15, 2015, 1-1-1 Minami-Aoyama, Minato-ku, Tokyo, 080-1234-5678." When using voice input, say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[1705] Example prompt: "Please enter your child's information: name, date of birth, address, and emergency contact information, in that order."

[1706] Terminal

[1707] Receives and temporarily stores text data entered by the user. If voice input is used, converts the voice into text data using voice recognition technology, for example, using the Google Speech-to-Text API.

[1708] Assign each piece of information to the appropriate field.

[1709] server

[1710] The server receives the data sent from the device and stores it securely in a database, encrypting it using the AES-256 encryption algorithm.

[1711] Document preparation phase

[1712] User

[1713] Select the desired document template (e.g., application form) from the "Create Document" menu on your dashboard.

[1714] Example prompt: "Please complete your application form. Please review the required information and enter any corrections."

[1715] Terminal

[1716] The selected template is displayed on the screen, and the pre-saved basic information is automatically entered into the appropriate fields of the template.

[1717] server

[1718] A template with auto-filling completed is generated, and confirmation data is sent to the terminal, where it is displayed so that the user can check and correct it.

[1719] Document verification and submission phase

[1720] User

[1721] The user can check the automatically entered document contents and make corrections as necessary. Corrections can also be made by voice input.

[1722] Example of correction: Voice input "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1723] Once confirmed, the user selects the submission format: electronic file saving, printing, or electronic submission to the school.

[1724] Example prompt: "Would you like to finalize and submit your documents? Please answer yes or no."

[1725] Terminal

[1726] Receives the finalized document data and processes it based on the selected submission format, for example converting it to PDF format and saving it as an electronic file or sending it to a printer.

[1727] server

[1728] Securely store finalized document data and manage it for future use. Manage data so it can be reused for multiple years.

[1729] This system significantly reduces the amount of paperwork parents have to fill out when enrolling their children in kindergarten or school, enabling efficient document management. The introduction of a voice input function also allows for efficient information entry.

[1730] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1731] Step 1: Enter basic information

[1732] The user accesses the application and logs in. After accessing the dashboard, they enter their child's basic information (name, date of birth, address, emergency contact, etc.) into the form. If using voice input, they can say, "My child's name is Ichiro Tanaka, his date of birth is March 15, 2015, and his address is 1-1-1 Minami-Aoyama, Minato-ku, Tokyo."

[1733] Input: Your child's basic information, including name, date of birth, address, and emergency contact details.

[1734] Output: If voice is used, text data is generated by speech recognition and saved as text data.

[1735] What it does: When a user enters information into a form, it is automatically saved. If the user enters information by voice, the device converts the voice data into text using the Google Speech-to-Text API.

[1736] Step 2: Save your data

[1737] The device temporarily stores the entered text data, and if voice input is used, the converted text data as well.

[1738] Input: Text data entered by the user or data converted from speech.

[1739] Output: Well-formed text data.

[1740] Specific behavior: Assigns input data to appropriate fields. Formats it according to a specific format.

[1741] Step 3: Data transmission and encryption storage

[1742] The terminal transmits the well-formatted data to the server.

[1743] The server encrypts the received data using an encryption algorithm such as AES-256 and stores it securely in a database.

[1744] Input: Well-formed text data.

[1745] Output: The encrypted text data is stored in the database.

[1746] Specific operation: After the device sends data, the server immediately encrypts the received data and stores it in a secure database, and also performs data integrity checks.

[1747] Step 4: Select a document template

[1748] The user selects the "Document Creation" menu on the dashboard and chooses the desired document template (e.g., application for admission).

[1749] Input: User selection from a list of document templates.

[1750] Output: The selected template will be displayed on the screen.

[1751] Specific operation: Based on the user's selection, the terminal loads a template from the list and displays it on the screen.

[1752] Step 5: Autofill

[1753] The device automatically fills in the appropriate fields in a template with basic information stored in advance, such as a child's name, address, and emergency contact information, into a school application template.

[1754] Input: Pre-saved basic information.

[1755] Output: A template with basic information automatically filled in.

[1756] Specific action: Map and enter the appropriate basic information for each field in the template.

[1757] Step 6: Generate and send verification data

[1758] The server generates a template with the automatic input completed and sends the confirmation data to the terminal.

[1759] Input: Auto-filled template data.

[1760] Output: Verification data is sent to the terminal.

[1761] Specific operation: The server checks the template data and sends it to the terminal for the user to confirm.

[1762] Step 7: Check and correct the document contents

[1763] The user can check the automatically entered document contents on the screen and make corrections as necessary. Voice input is also possible. For example, a user can say, "Change address to 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1764] Input: Document template for confirmation, correction details.

[1765] Output: Corrected final confirmation document.

[1766] Specific operation: The user's modifications are reflected and the confirmation screen is displayed again to the user.

[1767] Step 8: Finalize documents and select submission format

[1768] The user makes a final review of the documents and selects the submission format (electronic file saving, printout, or electronic submission to the school).

[1769] Input: Final confirmed document data, selection of submission format.

[1770] Output: Finalized document data.

[1771] Specific Actions: Starts processing based on the submission format selected by the user, for example converting to PDF and deciding whether to save as an electronic file or send to a printer.

[1772] Step 9: Save and send the document

[1773] The terminal transmits the determined document data to the server for processing based on the selected format.

[1774] The server securely stores the finalized document data and processes it appropriately based on the selected format (electronic file storage, print transmission).

[1775] Input: Confirmed document data, submission format.

[1776] Output: Saved document data.

[1777] What happens: The server stores the data and sends or saves the document in the format selected by the user.

[1778] (Application example 1)

[1779] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1780] Previously, when parents prepared the various application documents required for their children's school or kindergarten enrollment, it took a great deal of time and effort, and the process of inputting and checking information was extremely cumbersome. Furthermore, manual input of information made it prone to errors, creating a need for efficient document management. Furthermore, submissions to educational institutions were typically made on paper, with insufficient support for electronic data transmission. To solve these issues, a system was needed that allowed parents to easily and efficiently prepare and manage application documents and submit them electronically.

[1781] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1782] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for inputting information using voice recognition technology and converting voice data into text data, and a means for electronically transmitting the information to various devices. This allows parents to efficiently input, manage, and modify information without cumbersome manual work, and enables the entire process from document creation to submission to be done electronically.

[1783] The "means for parents to input basic information about their children" refers to a device or system that provides an interface for users to input basic information such as their children's names, birth dates, addresses, and emergency contact details.

[1784] "Means for automatically entering data into various application templates based on basic information" refers to a function that uses the entered basic information to automatically fill in the necessary data into pre-prepared application templates.

[1785] "Means for saving input information and enabling it to be modified or reused as necessary" refers to technical means for saving input information in a database or the like, and for later checking, modifying, or reusing the information.

[1786] "Means of using voice recognition technology to input information and convert voice data into text data" refers to a method that uses voice recognition technology to analyze data input by voice and convert it into text format.

[1787] "Means for electronic transmission to various devices" refers to a function for transmitting generated documents and data to various electronic devices such as mobile terminals and computers.

[1788] "Means for linking information about siblings" refers to technology that automatically links information about siblings based on stored information, allowing them to be mutually referenced.

[1789] This invention is a system for streamlining the preparation of documents required by parents when their children enroll in kindergarten or school. This system can be implemented using the following hardware and software configuration.

[1790] Basic information input phase

[1791] The first thing a user does is enter basic information. Using a device such as a smartphone or tablet, users enter basic information about their child. Specifically, they enter information such as name, date of birth, address, and emergency contact information into a form. A voice input function is also available, allowing users to enter information using their voice. In this case, voice recognition technology (such as Google Cloud Speech-to-Text) converts the voice into text data. The device receives the information entered by the user and stores it by appropriately assigning it to each field. The server receives the information sent from the device and securely stores it in a database (such as MongoDB). The information is encrypted when stored to prevent unauthorized access from outside.

[1792] Document preparation phase

[1793] When a user wants to create a specific document, they access the application and select the desired document template from the menu. The device displays the selected template on the screen and automatically fills in the appropriate fields with pre-stored information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically filled in. The server generates the completed template and sends confirmation data to the device. The user can review the content and make corrections as necessary. They can also use voice input again to make corrections.

[1794] Document verification and submission phase

[1795] The user checks the automatically entered document contents and makes any necessary corrections. Once the corrections are complete, the user confirms the document. The terminal receives the confirmed document data and provides the option to save it as an electronic file or print it out as needed. It can also be sent electronically to the educational institution. The server stores the final confirmed document data and manages it for future use. For example, the information can be retained so that it can be reused in the next year's admissions process.

[1796] Specific examples

[1797] 1. Enter basic information

[1798] The user opens the application and enters basic information about their child. For example, they might say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, and his emergency contact number is 090-1234-5678."

[1799] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1800] The server stores this information in a database and manages it in a secure environment.

[1801] 2. Document preparation and confirmation

[1802] The user selects "Application for Admission."

[1803] The device will display a template and automatically fill in the pre-stored information.

[1804] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1805] The user inputs the corrections by voice and performs final confirmation.

[1806] The device will update with the corrections and check again.

[1807] 3. Submission

[1808] The user finalizes the document and selects electronic transmission.

[1809] The device sends the finalized data to a server, where it is stored as an electronic file or sent to the educational institution.

[1810] The server stores the document data and manages it for future reference.

[1811] Prompt Sentence Examples

[1812] "Please enter your child's basic information. Enter their name, date of birth, address, and emergency contact information in that order."

[1813] "The following template will be automatically filled in based on the information you entered. Please review the content and make any necessary corrections by voice or text input."

[1814] This system frees parents from the hassle of completing complicated paperwork and allows them to complete the application process efficiently and accurately.

[1815] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1816] Step 1:

[1817] The user enters basic information about their child using a device such as a smartphone or tablet. Input methods include text input and voice input. When using voice input, the device uses voice recognition technology to convert speech into text data. Specifically, the Google Cloud Speech-to-Text API is used to convert voice data into text in real time. The entered information (e.g., name, date of birth, address, emergency contact information, etc.) is temporarily stored in the device's memory.

[1818] Input: Child's basic information in voice or text format

[1819] Processing: Converts voice data into text data, stores the text data in memory

[1820] Output: Basic information data in text format

[1821] Step 2:

[1822] The device sends the entered basic information to the server. The server encrypts the received data and stores it in a database. This is done using a database system such as MongoDB to ensure secure management. The encryption process uses, for example, AES (Advanced Encryption Standard) technology.

[1823] Input: Basic information data in text format

[1824] Processing: Encrypting data and storing it in a database

[1825] Output: Encrypted basic information data stored in a database

[1826] Step 3:

[1827] When a user wants to create a particular document, they select the desired document template from the application's menu, which is then generated by a template engine (e.g., Handlebars.js) and displayed on the screen.

[1828] Input: User's template selection

[1829] Processing: Generate and display the template

[1830] Output: Screen display of the selected template

[1831] Step 4:

[1832] The server automatically fills in the appropriate fields in the template with the basic information stored in the form, such as the child's name, address, and emergency contact information, and generates the document automatically.

[1833] Input: Template, basic information data

[1834] Action: Auto-fill template

[1835] Output: Auto-filled document data

[1836] Step 5:

[1837] The user can review the automatically entered document contents and make corrections as necessary. Both text and voice input methods are available for corrections. In the case of voice input, voice recognition technology is again used to convert the voice into text data.

[1838] Input: Auto-filled document data, corrections (text or voice)

[1839] Processing: speech recognition and text conversion, data correction

[1840] Output: Corrected document data

[1841] Step 6:

[1842] The user validates the document. The device sends the validated document data to the server, which stores it in a database. Furthermore, electronic submission to the educational institution is possible, for example by email or through a dedicated online submission system.

[1843] Input: Confirmed document data

[1844] Processing: storage in database, electronic transmission to educational institution

[1845] Output: Saved final document data, electronic transmission confirmation

[1846] Step 7:

[1847] The server manages the finalized document data for future use. For example, it retains the information so that it can be reused for the next year's admissions process. This data management process also includes data backup and restore functions.

[1848] Input: Confirmed document data

[1849] Processing: Data management, backup, and restoration

[1850] Output: A reusable dataset

[1851] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1852] This invention is a system that streamlines the process of parents preparing the necessary documents for their children's kindergarten and school enrollment, and also has the ability to recognize the user's emotions and adjust the guide accordingly. The main components of the system include the following: a user interface for parents to enter their child's basic information, an emotion engine, a database, a template engine, and an automatic document generation and management function.

[1853] Basic information input phase

[1854] The first thing a user does is enter basic information. They access the application, open a form, and enter their child's basic information (name, date of birth, address, emergency contact, etc.). A voice input function is also provided, allowing users to enter information using their voice. Speech recognition technology converts the voice into text data.

[1855] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[1856] The server receives the information sent from the device and stores it securely in a database. The information is also encrypted when stored to prevent unauthorized access from outside.

[1857] Supported by an emotional engine

[1858] The system incorporates an emotion engine that recognizes the user's emotions.

[1859] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[1860] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and displays it to the user. For example, if the user is feeling frustrated, the server will suggest ways to make input easier, such as copy and paste.

[1861] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[1862] Document preparation phase

[1863] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[1864] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if a school application template is selected, the child's name, address, emergency contact information, etc. will be automatically entered.

[1865] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[1866] Document verification and submission phase

[1867] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[1868] The terminal receives the finalized document data and provides the option to save it as an electronic file, print it out if necessary, or send it electronically to the school or kindergarten.

[1869] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for the next year's admissions procedures.

[1870] Specific examples

[1871] 1. Enter basic information

[1872] The user opens the application and enters basic information about their child. For example, they can type information like "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1873] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[1874] The server stores this information in a database and manages it in a secure environment.

[1875] 2. Support by Emotion Engine

[1876] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[1877] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[1878] The device displays suggestions to the user and prompts them to enter input according to the guide.

[1879] 3. Document preparation and confirmation

[1880] The user selects "Application for Admission."

[1881] The device will display a template and automatically fill in the pre-stored information.

[1882] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[1883] The user inputs the corrections by voice and performs final confirmation.

[1884] The device will update with the corrections and check again.

[1885] 4. Submission

[1886] The user finalizes the document and selects electronic transmission.

[1887] The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[1888] The server stores the document data and manages it for future reference.

[1889] This not only significantly reduces the burden of paperwork for parents, but also reduces stress through user emotion analysis, providing an efficient communication environment. The introduction of an emotion engine improves the user experience, enabling smoother and more accurate input.

[1890] The processing flow will be explained below.

[1891] Step 1:

[1892] A user logs in to a dedicated web or mobile application.

[1893] Step 2:

[1894] The terminal checks the login information and performs user authentication. If authentication is successful, a basic information input form is displayed to the user.

[1895] Step 3:

[1896] The user enters basic information about the child (such as name, date of birth, address, and emergency contact information) into an input form. Alternatively, the user can enter this information verbally using voice input.

[1897] Step 4:

[1898] When voice input is selected, the device will convert the voice data into text data and automatically enter it into the respective fields, using voice recognition technology for accurate conversion.

[1899] Step 5:

[1900] The device evaluates the user's emotions through an emotion engine that analyzes emotions in real time using facial images and voice tones.

[1901] Step 6:

[1902] The server determines the user's emotional state based on the emotional data sent from the emotion engine. For example, it analyzes whether the user is having trouble or is inputting information smoothly.

[1903] Step 7:

[1904] Based on the results of the assessment, the device will display input guidance or support messages as necessary. For example, if it determines that the user is having difficulty, it will display a message saying, "Using voice input will make input easier."

[1905] Step 8:

[1906] The terminal checks the entered information and performs a simple verification to check for omissions or errors, prompting the user to make corrections if necessary.

[1907] Step 9:

[1908] The terminal transmits the verified basic information to the server.

[1909] Step 10:

[1910] The server safely stores the received information in a database. When storing the information, it is encrypted to prevent unauthorized access from outside.

[1911] Step 11:

[1912] The server returns a status of successful saving to the terminal.

[1913] Step 12:

[1914] The device displays a message to the user confirming successful save.

[1915] Step 13:

[1916] The user selects document creation and chooses the desired document template (e.g., admission application).

[1917] Step 14:

[1918] The device will display the selected template and automatically fill in the relevant fields based on the basic information stored on the server.

[1919] Step 15:

[1920] The server generates a template with the auto-fill completed and sends the confirmation data to the terminal.

[1921] Step 16:

[1922] The terminal displays the generated template to the user and provides input fields if any modifications are required.

[1923] Step 17:

[1924] The user can review the auto-filled information and make corrections if necessary, including using voice input.

[1925] Step 18:

[1926] The terminal sends the corrected information back to the server, and the corrected information is reflected in the template.

[1927] Step 19:

[1928] The server stores the corrected information in the database again and returns the corrected data to the terminal.

[1929] Step 20:

[1930] The terminal displays a final confirmation screen to the user and provides a confirm button.

[1931] Step 21:

[1932] The user finalizes the document and selects the submission method (e.g., electronic submission, PDF download, print).

[1933] Step 22:

[1934] The terminal converts the document into the appropriate format and performs the operation based on the selected submission method.

[1935] Step 23:

[1936] The server stores the confirmed document data and, if necessary, sends the document to a designated email address or the educational institution's online system.

[1937] Step 24:

[1938] The terminal displays a confirmation message to the user that the transmission or storage was successful.

[1939] This will improve the efficiency of the system's overall processing, significantly reducing the burden on parents and improving the efficiency of paper document management in educational settings. The introduction of the emotion engine will improve the user experience and make input work even smoother.

[1940] Example 2

[1941] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1942] In the previous system, parents had to fill out a lot of paperwork when enrolling their children in kindergarten or school, which was time-consuming and made it difficult to complete the paperwork efficiently. The complicated input process often led to mistakes and stress. Furthermore, the system lacked the ability to recognize users' emotions and provide appropriate feedback, resulting in a poor user experience.

[1943] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1944] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for recognizing the user's emotions and generating appropriate feedback, and a means for displaying the generated feedback to the user. This reduces the burden on parents when completing documents, reduces input errors and stress, and enables an improved user experience through emotion recognition.

[1945] "Parent" means the legal guardian or guardian of a child.

[1946] "Child" refers to a minor who is planning to enroll in an educational institution.

[1947] "Basic information" refers to information that can be used to identify a specific individual, such as name, date of birth, address, and emergency contact information.

[1948] An "application template" refers to a standard document format for entering the necessary information for a specific purpose.

[1949] "Autofill" refers to the process of automatically filling in information into input fields using pre-stored data.

[1950] "Saving" refers to recording the input information in a storage device such as a database.

[1951] "Modification" refers to making changes to existing input data.

[1952] "Reuse" refers to the reuse of information that has been stored at a later time.

[1953] "Emotion recognition" refers to technology that analyzes a user's facial expressions and vocal tone to estimate their emotional state.

[1954] "Feedback" refers to suggestions and advice provided based on a user's behavior or state.

[1955] "User" refers to a person who uses this system to create documents.

[1956] "Terminal" refers to a device used by a user, such as a computer or smartphone.

[1957] "Server" refers to a remote computing system for processing and storing data.

[1958] This invention is a system that streamlines the process of parents filling out the necessary paperwork for their children's kindergarten and school enrollment, and also recognizes the user's emotions and provides appropriate guidance. The system consists of the following main components:

[1959] 1. User Interface (UI)

[1960] It provides a user interface (UI) that can be accessed on a smartphone or PC as a means for parents to enter basic information about their children. This UI is equipped with a voice input function in addition to keyboard input. Voice input uses the Google Cloud Speech-to-Text API to convert voice data into text data.

[1961] 2. Database

[1962] The basic information entered is securely stored in a database. The server applies AES encryption to the received data and stores it in a database in an environment protected from unauthorized access. The database is designed to permanently store and manage information for future use.

[1963] 3. Emotion Engine

[1964] The user interface uses a camera and microphone for real-time facial recognition and voice tone analysis to identify the user's emotions. Emotion recognition uses OpenCV and Python. For example, if the user expresses confusion or nervousness while typing, the system will detect this and generate appropriate feedback.

[1965] 4. Template Engine

[1966] A template engine is used to automatically generate documents. For example, by using Handlebars.js, pre-saved basic information can be automatically embedded into various application templates. Once a template is selected, the necessary information is automatically loaded.

[1967] 5. Automatic document generation and management function

[1968] When a user selects a specific document template, basic information is automatically entered to generate a completed document. For example, if a template such as an "application for admission" is selected, the child's name and address are automatically entered. After reviewing and correcting this automatically generated document, the user can save the finalized document in PDF format or send it electronically to the school.

[1969] Specific examples

[1970] Enter basic information

[1971] 1. The user opens the application and enters basic information about their child. For example, they can enter information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form, or they can say, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1972] 2. The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate field.

[1973] 3. The server stores this information in a database and manages it in a secure environment.

[1974] Supported by an emotional engine

[1975] 1. The device analyzes the user's facial expressions and voice tone in real time while inputting. For example, facial expression recognition is performed using OpenCV and Python.

[1976] 2. The server analyzes the emotional data and generates feedback such as, "If you have difficulty inputting, please use voice input."

[1977] 3. The device displays this feedback to the user, encouraging smooth input.

[1978] Document preparation and confirmation

[1979] 1. The user selects "Application for Admission."

[1980] 2. The device displays the template and automatically fills in the pre-saved information, for example using Handlebars.js to power the template engine.

[1981] 3. The server generates the auto-filled data and sends it to the device as a confirmation document.

[1982] 4. The user inputs the corrections by voice and performs a final confirmation.

[1983] submission

[1984] 1. The user finalizes the document and selects electronic transmission.

[1985] 2. The device sends the finalized data to the server, where it is saved as an electronic file or sent to the school.

[1986] 3. The server stores the document data and manages it for future reference.

[1987] This invention significantly reduces the burden on parents when completing paperwork, reduces user stress through emotion analysis, and enables efficient and accurate document preparation and submission.

[1988] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1989] Step 1:

[1990] The user launches the application and enters basic information about their child.

[1991] How it works: A user accesses the application URL in a browser on their smartphone or PC.

[1992] Input: Enter basic information such as "Yamada Taro, April 1, 2015, 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo, 090-1234-5678" into the form.

[1993] Output: The basic information entered is sent to the terminal.

[1994] Step 2:

[1995] The device receives the input information and converts the voice data into text.

[1996] How it works: Once text input is complete, if voice input is used, voice data is collected through the device's microphone and converted to text using the Google Cloud Speech-to-Text API.

[1997] Input: The user speaks, "My child's name is Yamada Taro, his date of birth is April 1, 2015, and his address is 1-2-3 Nishi-Shinjuku, Shinjuku-ku, Tokyo."

[1998] Output: The audio data is converted to text data and assigned to each field.

[1999] Step 3:

[2000] The server stores the information in a database.

[2001] How it works: Receives basic information sent from the device, encrypts it with AES, and stores it securely in a database.

[2002] Input: Basic information of the user sent from the device (name, date of birth, address, emergency contact, etc.)

[2003] Output: Encrypted basic information stored in the database.

[2004] Step 4:

[2005] The device analyzes the user's facial expressions and tone of voice.

[2006] How it works: It uses the device's camera and microphone to collect the user's facial expressions and voice tone in real time and analyzes them using OpenCV and Python.

[2007] Input: User's facial expression data and voice tone data collected by camera and microphone.

[2008] Output: Analyzed emotion data. For example, if the person is confused, it will be labeled as "confused."

[2009] Step 5:

[2010] The server analyzes the emotion data and generates feedback.

[2011] Behavior: Receives emotion data from the device and generates appropriate feedback, such as a suggestion like "If you have difficulty typing, please use voice input."

[2012] Input: Emotion data sent from the device.

[2013] Output: The generated feedback message.

[2014] Step 6:

[2015] The device displays feedback.

[2016] Behavior: Feedback received from the server is displayed on the screen and presented to the user.

[2017] Input: The feedback message sent by the server.

[2018] Output: Feedback is displayed to the user.

[2019] Step 7:

[2020] The user selects a document template.

[2021] Action: Select the desired document template (e.g., "Application for Admission") from the application menu.

[2022] Input: User selection.

[2023] Output: The selected template will be displayed on the screen.

[2024] Step 8:

[2025] The device automatically fills in basic information into the template.

[2026] What it does: Automatically fills in the appropriate fields of a selected template with pre-stored basic information. Uses a template engine such as Handlebars.js.

[2027] Input: Basic information retrieved from the database and the selected template.

[2028] Output: The completed auto-filled template.

[2029] Step 9:

[2030] The server generates a template and sends the data for verification.

[2031] Operation: A final template is generated based on the automatically entered template data sent from the terminal, and confirmation data is sent to the terminal.

[2032] Input: Auto-filled template data sent from the device.

[2033] Output: The final template data for review.

[2034] Step 10:

[2035] The user reviews and edits the document.

[2036] How it works: Review the auto-filled information and make any necessary corrections. You can also use voice input to make corrections.

[2037] Input: Auto-filled templates and user correction instructions (voice or text).

[2038] Output: The final modified template.

[2039] Step 11:

[2040] The device saves the modified data and saves and sends the file as needed.

[2041] Operation: The user receives the finalized document data and saves it as an electronic file or sends it electronically to the school.

[2042] Input: The final template data confirmed by the user.

[2043] Output: Saved electronic file or submission completion status.

[2044] Step 12:

[2045] The server stores and manages the final data.

[2046] Operation: The finalized document data is permanently stored in a database and managed so that it can be reused.

[2047] Input: Final document data confirmed by the user.

[2048] Output: Final data that has been saved and managed.

[2049] (Application example 2)

[2050] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2051] There is a need to reduce stress and fatigue and improve safety by improving the efficiency of the document preparation required by drivers of autonomous vehicles, and by properly recognizing their emotions while driving and providing appropriate feedback.The present invention aims to provide a system that allows drivers to easily prepare the necessary documents and provides appropriate support based on their emotions while driving.

[2052] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2053] In this invention, the server includes a means for parents to input basic information about their children, a means for automatically inputting the information into various application form templates based on the basic information, a means for saving the input information and enabling it to be modified or reused as needed, a means for analyzing the user's facial expressions and voice tone in real time to recognize emotions, and a means for providing feedback and guidance based on the recognized emotions.This makes it possible to streamline the document preparation required by drivers of autonomous vehicles and to provide appropriate support based on their emotions while driving.

[2054] The "means by which parents input basic information about their children" refers to an interface that allows users to input basic information about their children into a terminal, and includes keyboard input and voice input.

[2055] The "means for automatically inputting information into various application templates" has the function of automatically placing the necessary information into a pre-prepared application template based on the input basic information.

[2056] "Means for saving the entered information and enabling it to be modified or reused as needed" means a function that saves the information entered by the user in a database and allows the information to be modified or reused later.

[2057] "Means for analyzing a user's facial expressions and voice tone in real time and recognizing emotions" refers to a function that uses a camera or microphone to capture a user's facial expressions and voice tone, and analyzes them to infer the user's emotions.

[2058] The "means for providing feedback and guidance based on recognized emotions" has the function of presenting appropriate advice and support content to the user in real time based on the analyzed user emotions.

[2059] A system for implementing this invention provides support for drivers of autonomous vehicles by streamlining the creation of documents and using emotion recognition. The system's main components include a user interface (UI), an emotion recognition engine, a database (DB), a template engine, and an automatic document generation and management function.

[2060] Basic information input phase

[2061] The first thing a user does is enter basic information. They access the application, open a form, and enter basic driver information (such as name, vehicle ID, and contact details). A voice input function is also provided, allowing users to input information using their voice. Speech recognition technology converts the voice into text data.

[2062] The terminal receives the information entered by the user, assigns it to each field appropriately, and saves it. If voice input is selected, it can also process the voice data into text data.

[2063] The server receives the information sent from the device and stores it in a database in a secure environment. The information is also encrypted when stored to prevent unauthorized access from outside.

[2064] Supported by an emotional engine

[2065] The system incorporates an emotion engine that recognizes the user's emotions.

[2066] The device analyzes the user's facial expressions and voice tone in real time and uses an emotion engine to evaluate the emotions the user is feeling while typing. For example, it can detect when the user has a troubled expression or a tense tone of voice.

[2067] The server generates appropriate feedback based on the emotional data analyzed by the emotion engine and presents it to the user. For example, if the user is feeling frustrated, the server will suggest specific operating methods or ways to relax.

[2068] The device provides users with emotion-based feedback and guidance to facilitate the input process, reducing user stress and reducing errors.

[2069] Document preparation phase

[2070] When a user wants to create a particular document, they access the application and select the desired document template from a menu.

[2071] The device will display the selected template on the screen and automatically fill in the appropriate fields with pre-stored basic information. For example, if an accident report template is selected, the driver's name, vehicle ID, contact information, etc. will be automatically filled in.

[2072] The server generates a template with the auto-fill completed and sends the data for confirmation to the terminal, where it is displayed so that the user can check and correct it.

[2073] Document verification and submission phase

[2074] The user can review the automatically filled-in document and make any necessary corrections, including voice input. Once the corrections are complete, the user confirms the document.

[2075] The terminal receives the finalized document data and provides the option to save it as an electronic file or print it out as needed, or to send it electronically to the relevant authorities.

[2076] The server stores the finalized document data and manages it for future use. For example, the information can be retained so that it can be reused for similar procedures.

[2077] Specific examples

[2078] 1. Enter basic information

[2079] A user opens the application and enters basic driver information. For example, they can enter information such as "Ichiro Sato, vehicle ID 1234-XYZ, 090-1234-5678" into a form, or they can say, "The driver's name is Ichiro Sato, and the vehicle ID is 1234-XYZ."

[2080] The device receives this information, converts the voice data into text data, and automatically assigns it to the appropriate fields.

[2081] The server stores this information in a database and manages it in a secure environment.

[2082] 2. Support by Emotion Engine

[2083] The device analyzes the user's facial expressions and voice tone in real time while they are entering basic information, recognizing their emotions.

[2084] The server generates appropriate suggestions based on the emotion data when the user is experiencing difficulty or stress, such as "If you are having difficulty typing, please use voice input."

[2085] The device displays suggestions to the user and prompts them to enter input according to the guide.

[2086] 3. Document preparation and confirmation

[2087] The user selects "Accident Report."

[2088] The device will display a template and automatically fill in the pre-stored information.

[2089] The server generates the auto-filled data and sends it to the terminal as a confirmation document.

[2090] The user inputs the corrections by voice and performs final confirmation.

[2091] The device will update with the corrections and check again.

[2092] 4. Submission

[2093] The user finalizes the document and selects electronic transmission.

[2094] The terminal sends the confirmed data to the server, where it is stored as an electronic file or transmitted to the relevant institution.

[2095] The server stores the document data and manages it for future reference.

[2096] Example prompt sentence:

[2097] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[2098] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2099] Step 1: Enter basic information

[2100] The user accesses the application, opens a form, and enters the driver's basic information (such as name, vehicle ID, and contact details). Voice input is also available. The device receives this input, and if it is text input, it stores it as is. If it is voice input, it uses voice recognition technology to convert the voice data into text data, which is then assigned appropriately to the respective fields and saved. This saves the input data in text format to the database.

[2101] Step 2: Save to database

[2102] The device sends the entered information to the server. The server receives this information and stores it securely in a database. When stored, the information is encrypted to prevent unauthorized access. This ensures that basic information is stored safely.

[2103] Step 3: Real-time sentiment analysis

[2104] The device uses a camera and microphone to capture the user's facial expressions and voice tone in real time. The emotion engine analyzes this data and recognizes the user's emotions. Specifically, it detects facial feature points to classify facial expressions and analyzes the frequency components and tone of voice to evaluate the user's emotional state. This allows the device to understand the user's emotions in real time.

[2105] Step 4: Emotion-based feedback generation

[2106] The server generates appropriate feedback based on the emotional data sent from the emotion engine. For example, if the user is feeling stressed, it generates specific advice such as "Relax" or "Take a deep breath." This feedback is sent to the device in text format.

[2107] Step 5: Displaying Emotional Feedback

[2108] The terminal receives the feedback sent from the server and displays it to the user. It provides feedback to the user through a display or voice guidance, and also assists the user in continuing the input process. This step helps reduce user stress and maintain a safe driving environment.

[2109] Step 6: Select a document template

[2110] The user accesses the application and selects the desired document template (e.g., accident report) from the menu. The terminal displays the selected template on the screen.

[2111] Step 7: Auto-filling the template

[2112] The device retrieves basic information stored in a database and automatically fills in the appropriate fields in the selected template, eliminating the need to manually enter information.

[2113] Step 8: Check and correct documents

[2114] The user can check the automatically entered document contents and make any necessary corrections. Corrections can also be made using voice input. The device receives the user's correction instructions and updates the document data, so that accurate information is reflected in the template.

[2115] Step 9: Finalize and submit documents

[2116] The user finalizes the document and selects electronic submission. The terminal sends the finalized data to the server, which saves it as an electronic file or sends it to the relevant authority. It also provides the option to print it out if necessary. The server saves the finalized document data and manages it for future reference. This step realizes efficient document preparation and submission.

[2117] Adding specific examples

[2118] Example prompt sentence:

[2119] "I'm a driver of an autonomous vehicle. I'd like to develop an application that provides appropriate feedback when the driver feels stressed. Can you please give me an example of a program that can provide feedback by analyzing facial expressions and voice tone in real time? I'd also like it to include a function to input basic driver information and store it in a database."

[2120] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2121] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2122] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2123] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), whi...

Claims

1. A means for parents to enter basic information about their children; A means to automatically input the basic information into various application templates, A means to store the entered information and allow it to be modified and reused as needed; A system including:

2. 10. The system of claim 1, wherein the basic information is input using voice input and converted into text data.

3. The system according to claim 1, wherein information on siblings is linked based on the stored information.

Images