system

Abstract

We provide the system. [Solution] A means of receiving data entered by the user, Information analysis means for analyzing the input data and transcribing it into multiple different documents, A means for generating and outputting data that has been transcribed into multiple documents, A management system to streamline in-store procedures such as registration and reservations, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In application procedures related to weddings, funerals, and other ceremonies, users have to repeatedly enter the same personal information in multiple documents, which is a significant burden. In particular, when a large number of documents have to be created in a short period of time, misentries and delays in procedures are likely to occur. Elimination of such duplicate work and improvement in the efficiency of the entire application procedure are required.

Means for Solving the Problems

[0005] This invention provides a system having data analysis means that receives information entered by a user, analyzes that information, and transcribes it into multiple different application forms. Furthermore, this system includes means for electronically generating and outputting the transcribed information into each of the multiple application forms and attaching an electronic signature as necessary. This reduces the effort of duplicate information entry and allows procedures to proceed quickly and accurately.

[0006] "User" refers to an individual or organization that uses the system to complete the application process.

[0007] "Information entered" refers to the total amount of data, including personal information, that users provide to the system for the application process.

[0008] "Data analysis means" refers to an internal system function or module that processes input information and allocates the necessary information to specific application documents.

[0009] "Application documents" refer to official documents that must be submitted to government offices or other relevant institutions in order to carry out procedures related to weddings, funerals, and other ceremonial occasions.

[0010] "Transcribing" refers to the process or task of writing data from one document to another in a digital format.

[0011] "Output" refers to the act or process of displaying or providing information processed by a system to an external party.

[0012] An "electronic signature" is authentication information attached to digital data and is used as a means of indicating legal approval or consent. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the language used in the following description will be explained.

[0016] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0019] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] This invention provides a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. This system consists of a terminal, a server, and user operations.

[0035] The user first logs into the system using a terminal. After successful login, the terminal displays a list of available application forms. The user can then select the documents that best suit their needs.

[0036] Based on the selected documents, the terminal provides an interface for the user to enter the necessary personal information. Once the user enters the required information, the terminal sends that data to the server.

[0037] The server is equipped with data analysis capabilities to analyze the received data. This allows the server to identify the necessary information for each application document and distribute the data to streamline the process. This analysis reduces the need for redundant data entry.

[0038] After analysis and sorting are complete, the server generates information in a format suitable for multiple application documents and outputs it to the terminal. The user can review the generated application documents on the terminal and make corrections as needed. The corrected data is sent back to the server for a final verification process.

[0039] Next, the user affixes an electronic signature to the application documents via the terminal. This electronic signature officially authenticates the documents. Finally, the server submits the signed documents to the relevant government office's system. The user uses the terminal to schedule an appointment with the government office, ensuring the entire process proceeds smoothly.

[0040] This system allows users to avoid the hassle of repeatedly entering the same information during the application process, enabling them to complete the process quickly and accurately.

[0041] The following describes the processing flow.

[0042] Step 1:

[0043] The user logs into the system using a terminal. The terminal displays a login screen to the user and prompts them to enter their ID and password. Once the user enters the information, the terminal sends that information to the server to attempt authentication.

[0044] Step 2:

[0045] The server compares the received authentication information with the registered information in the database. If authentication is successful, the server retrieves the user's account information and sends an authentication success message to the terminal.

[0046] Step 3:

[0047] The terminal displays a list of available application forms to the user. The user selects the necessary documents from the list according to their purpose.

[0048] Step 4:

[0049] When the user selects an application document, the terminal sends that information to the server. The server generates a list of required information fields for the selected document.

[0050] Step 5:

[0051] The terminal displays an interface for the user to enter the necessary personal information for the selected document. The user enters the required information into the terminal.

[0052] Step 6:

[0053] The terminal sends the entered user data to the server. The server receives the data using data analysis tools and distributes the necessary information to the appropriate fields in each application form.

[0054] Step 7:

[0055] Based on the analysis results, the server generates application forms containing the necessary information for various application documents, sends them to the terminal, and displays a preview.

[0056] Step 8:

[0057] The user reviews the application form preview on their device and makes corrections if necessary. The corrected information is then resent from the device to the server.

[0058] Step 9:

[0059] The user applies an electronic signature to the application document using their device. The device then sends the signed data to the server.

[0060] Step 10:

[0061] The server submits the final application documents to the relevant government office's system. The user then uses their terminal to schedule an appointment to visit the office and complete the process.

[0062] (Example 1)

[0063] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0064] Traditional application procedures required users to repeatedly enter the same information into multiple documents, which was not only time-consuming but also prone to input errors. Furthermore, the process of formally authenticating the submitted documents was complex, reducing the overall efficiency of the process.

[0065] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0066] In this invention, the server includes means for receiving information entered by a user, data analysis means for analyzing the entered information and checking for duplicates or omissions, means for sorting the data for transcription into multiple different types of documents, and means for automatically generating and outputting multiple documents based on the sorted information. This significantly reduces the time and effort required for the user's procedures, enabling the application process to be completed quickly and accurately.

[0067] "User" refers to a person who operates the system, inputs information, and submits an application.

[0068] "Means of receiving information" refers to the mechanism by which a system receives and stores input from users.

[0069] "Data analysis means" refers to techniques that analyze the content of received information and detect duplication or omissions in that information.

[0070] "Methods for distributing data" refers to methods of distributing data in formats suitable for different documents based on analysis results.

[0071] "Methods for automatically generating documents" refers to the process by which a system automatically creates documents based on sorted information.

[0072] An "electronic signature" is a means of authenticating digital information and refers to a technology used to guarantee the authenticity of documents.

[0073] "Means of providing an interface" refers to the technology that provides the user interface for inputting information or checking and modifying documents.

[0074] This invention is a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and user operations.

[0075] The user first logs into the system using a terminal. A standard personal computer or tablet device is suitable as the terminal. Upon successful login, the terminal displays a list of available application forms to the user. These include wedding invitations and funeral arrangements.

[0076] When a user selects a document, the terminal provides an interface for entering the necessary personal information. This interface is designed to allow users to easily enter information and enables intuitive operation through the user interface.

[0077] Once information is entered, the terminal sends it to the server. The server uses high-performance data analysis software to analyze the information received from the user. This process eliminates duplicate information and identifies any missing information. The server then sorts the data based on the analysis results. This sorting process automatically organizes the information into multiple different types of application forms.

[0078] Next, the server automatically generates the necessary documents and sends their contents to the terminal. The user reviews the generated documents via the terminal and makes corrections as needed. This corrected information is sent back to the server, which then digitally signs the documents. The digital signature officially authenticates the document's legitimacy.

[0079] Ultimately, the server submits the signed documents online to the relevant department's information system. Users can also use the terminal to schedule visits to the relevant departments. Furthermore, it is possible to automatically input data and generate prompts using a generated AI model based on user actions.

[0080] As a concrete example of a prompt message, you could enter something like, "Please tell me how to create a wedding invitation using the system for streamlining wedding and funeral procedures."

[0081] This system allows users to complete the application process easily and quickly, ensuring the entire process runs smoothly.

[0082] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0083] Step 1:

[0084] The user logs into the system using a terminal. Authentication is performed by entering a username and password into the login interface, and if authentication is successful, the system proceeds to the next step. Login information (input) is received, and the authentication result (output) is obtained.

[0085] Step 2:

[0086] Upon successful login, the terminal displays a list of available application forms to the user. The user then selects the document that best suits their purpose. Based on the selected document (input), the corresponding document's information (output) is displayed.

[0087] Step 3:

[0088] When a user selects a document, the terminal provides an interface for entering the personal information required for that document. Here, the user enters necessary information such as their name and address. Based on the entered personal information (input), a dataset (output) is generated.

[0089] Step 4:

[0090] The terminal sends the personal information entered by the user to the server. The server uses data analysis tools to analyze the received data. Duplicate or missing data is detected, and necessary corrections are listed. Analysis results (output) are obtained from the personal information data (input).

[0091] Step 5:

[0092] The server sorts the data for each document based on the analysis results. This ensures that the necessary information is transferred to each application form. Data sets (output) are created for each document sorted from the analysis results (input).

[0093] Step 6:

[0094] The server uses a generation AI model to automatically generate documents based on the sorted information. The generated documents (output) are quickly sent to the terminal. The completed application documents (output) are obtained from the sorted data (input).

[0095] Step 7:

[0096] The terminal displays the generated application document to the user, who can review the content and make corrections as needed. The corrected document (output) is then sent back to the server. Based on the user's feedback (input), the corrected data (output) is generated.

[0097] Step 8:

[0098] The server affixes an electronic signature to the final application document reflecting the revisions. The document is officially authenticated by the electronic signature (output). An electronically authenticated document (output) is obtained from the revised document (input).

[0099] Step 9:

[0100] The server submits the signed documents to the relevant institution's system. After confirmation of submission completion (output), the user makes a reservation to visit the relevant institution via the terminal. The process goes from preparation for submission (input) to the generation of a completion notification (output).

[0101] This system allows users to complete a series of procedures efficiently.

[0102] (Application Example 1)

[0103] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0104] In store procedures and reservations, it is necessary to prevent duplication of information entered by users and streamline the process. However, traditional systems involve a lot of manual work, which is time-consuming and labor-intensive, so there is a need to improve operational efficiency.

[0105] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0106] In this invention, the server includes means for receiving data entered by a user, means for analyzing the entered data and transcribing it into multiple different documents, means for generating and outputting the data transcribed into the multiple documents, and means for managing the registration and reservation of in-store procedures. This makes it possible to streamline information registration and reservation procedures at stores and to reuse the entered information.

[0107] "User" refers to an individual or group that operates the system and enters data.

[0108] "Data" refers to information entered by users, and includes various forms of information that are subject to analysis and transcription.

[0109] "Information analysis means" refers to technical methods and devices for processing input data and transcribing it into necessary documents.

[0110] "Document" refers to digital or physical documents generated by information analysis tools and used for user procedures and reservations.

[0111] "Management means" refers to the software and processes within a system that enable efficient procedures.

[0112] A "store" refers to a place where goods or services are actually provided, and there is a need to streamline the procedures.

[0113] This invention is implemented as a system for efficiently handling procedures and reservations within a store. The hardware used includes smartphones and tablets as user terminals and servers for data processing. For software, Python is used for data analysis, and DocuSign or Adobe Sign are used as document management systems for information transfer and document management.

[0114] Users log in to the system using a terminal and select procedures or reservations. Based on the selected procedure, they can input the necessary data. The terminal sends the entered data to the server. The server receives the data and uses information analysis tools to sort it into the necessary documents. This enables efficient data transfer to multiple documents.

[0115] As a concrete example, this system can be used for member registration at a cafe, allowing new members to smoothly complete the registration process using their smartphones. The prompt used to input into the generating AI model would be something like this: "Please give me your ideas for a system to streamline member registration at a cafe. I'm looking for a way to simplify the traditional application process and minimize the amount of input required from the user."

[0116] In this way, we can streamline in-store procedures and reservations, providing a less burdensome environment for users.

[0117] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0118] Step 1:

[0119] The terminal provides the functionality to log in to the system. It receives a username and password as input and sends the login information to the server. The server compares the input information with the authentication database, determines whether the login was successful, and returns the result to the user.

[0120] Step 2:

[0121] The user selects a procedure or reservation on the application. The terminal displays a list of information items related to the selected procedure. Upon receiving user input, the terminal sends that information to the server. Here, the user's selection is input, and the necessary data items are output.

[0122] Step 3:

[0123] The server analyzes the received data and transcribes the necessary information into the appropriate document format using analytical tools. Based on the received data, it maps the data to a document template and fills in the variables to generate the document. In this process, the input data is converted into data in the document format, and each document layout is arranged before output.

[0124] Step 4:

[0125] For the generated document, the server sends the document data to the user's terminal for review. The user reviews the document on the terminal and makes corrections as needed. The corrected data is sent back to the server, and the document is updated without any discrepancies and a final check is performed.

[0126] Step 5:

[0127] The user performs an electronic signature via a terminal. The server manages the signing process and adds the electronic signature to the document. At this time, the input from the signing device is output as signature data.

[0128] Step 6:

[0129] The server submits the signed document to the relevant institution's system. The server securely transmits the document through the document management system and confirms the response from the institution's system. In this step, the signed document is the input, and the institution's receipt is the output.

[0130] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0131] This invention is a system that combines an emotion engine to recognize user emotions and aims to efficiently support application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and a user, and provides users with an excellent experience.

[0132] The user accesses the system and logs in using a terminal. After logging in, the terminal displays a list of available application forms, and the user selects the documents they need. At this time, the emotion engine is activated and analyzes the user's facial expressions and tone of voice in real time to understand their emotions.

[0133] The terminal provides an input interface based on the selected application form, and the user enters their personal information. The emotion engine monitors whether the user is experiencing stress during the input process and provides interactive support as needed. For example, if the user shows signs of anxiety, it will display explanations of the procedure on the screen or play an audio guide to help the user.

[0134] The input information is sent from the terminal to the server, which analyzes the information using data analysis tools and automatically transfers the data to each application form. The server generates the necessary application forms and sends them to the terminal to provide the user with a preview.

[0135] The user reviews the application form generated on their device and makes any necessary corrections. After further review, they formally approve it using an electronic signature. The signed documents are collected by the server and appropriately transmitted to the relevant authorities.

[0136] Throughout this entire process, the emotion engine continuously provides proactive, emotion-based support to ensure user satisfaction and a smooth procedure. This system allows users to complete the application process quickly and efficiently while reducing emotional burden.

[0137] The following describes the processing flow.

[0138] Step 1:

[0139] The user logs into the device. The device displays a login screen, and the user enters their ID and password. This information is sent from the device to the server for authentication.

[0140] Step 2:

[0141] The server checks the user's authentication information in the database, and if authentication is successful, sends a login success notification to the terminal. The terminal then displays a list of available application forms to the user.

[0142] Step 3:

[0143] The user selects the necessary application documents. The terminal sends the selections to the server. At this point, the emotion engine activates and begins monitoring the user's emotional state.

[0144] Step 4:

[0145] The terminal displays an interface for the user to enter the necessary information into the selected document. Once the user begins inputting, the emotion engine analyzes emotional data from facial expressions and tone of voice.

[0146] Step 5:

[0147] The emotion engine immediately notifies the device if it detects user stress or anxiety. The device then supports the user by displaying a support message on the screen or playing an audio guide.

[0148] Step 6:

[0149] Once the user has finished entering their information, the terminal sends the information to the server. The server analyzes the information using data analysis tools and automatically transfers the necessary data to each application form.

[0150] Step 7:

[0151] The server generates application documents using the analyzed data and sends them to the terminal. The terminal then displays a preview of the generated documents to the user and asks for confirmation.

[0152] Step 8:

[0153] The user previews the document on their device and instructs the system to correct any errors. The correction information is then sent to the server via the device.

[0154] Step 9:

[0155] The user electronically signs the application documents via their device. The device then sends the signed documents to the server.

[0156] Step 10:

[0157] The server submits the signed documents to the relevant government system. The emotion engine continues to support the user's emotions until the entire process is completed smoothly.

[0158] (Example 2)

[0159] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0160] Traditional application systems often fail to alleviate the psychological burden on users, potentially compromising the overall efficiency of the process. In particular, complex procedures performed under stressful conditions can lead to input errors and misunderstandings, ultimately resulting in delays. This problem needs to be addressed.

[0161] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0162] In this invention, the server includes a device for receiving information entered by a user, a data processing device for analyzing the entered information and transcribing it into multiple different record documents, a device for generating and outputting the transcribed information into the multiple documents, a device for acquiring and analyzing emotions, and a device for providing interactive support based on the user's emotions. This makes it possible to provide flexible support according to the user's emotional state and to complete procedures quickly and efficiently.

[0163] A "user" is a person who uses the system to input information and perform procedures.

[0164] "Information entered" refers to personal information and other data provided by users through the system.

[0165] A "data processing device" is a device that analyzes input information and converts or transcribes the data according to its purpose.

[0166] "Record documents" refer to documents or forms generated by data processing equipment.

[0167] A "device for acquiring and analyzing emotions" is a device that collects data on a user's psychological state from their facial expressions, tone of voice, etc., and then analyzes that data.

[0168] An "interactive support device" is a device that provides guidance and support based on the user's emotional state, through screen displays, audio guides, and other means.

[0169] This invention is a system that recognizes user emotions and efficiently creates and manages record documents. This system mainly consists of a server, terminals, and users, each operating according to its respective role.

[0170] The server plays a central role in data processing, receiving information input from users and performing analysis using data processing devices. It can accurately transcribe and generate necessary information for multiple record documents. This analysis employs data processing techniques using specific algorithms.

[0171] The terminal serves as an interface with the user. Users can access the system and input information using the terminal. The terminal is equipped with a camera and microphone, and it is possible to capture emotions through these input devices. The emotion-capturing device analyzes the user's facial expressions and tone of voice in real time to identify their emotional state.

[0172] Users select various record documents and input the necessary information through the provided interface. During this process, an interactive support system operates, providing guidance tailored to the user's emotional state. For example, if the user shows anxiety, a guide may be displayed on the screen or audio guidance may be provided.

[0173] As a concrete example, consider a user who is going through the application process related to a wedding. The user selects the marriage registration form through the terminal and enters the necessary personal information. If the emotion-gathering device detects the user's anxiety, the terminal displays an illustrated procedural guide to support the process.

[0174] An example of a prompt would be, "Explain how sentiment analysis technology can be integrated to make the application process more user-friendly." The AI ​​model generated based on this prompt will help design more efficient and user-friendly systems, and contribute to improving services based on emotions.

[0175] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0176] Step 1:

[0177] The user accesses the system and logs in using a terminal. The terminal receives authentication information (user ID and password) entered by the user and sends it to the server. The server compares the received information with the database and performs authentication. If authentication is successful, a login completion notification is displayed on the terminal.

[0178] Step 2:

[0179] The terminal retrieves the latest list of application documents from the server and displays it in the user interface. The user selects the required documents on the terminal. This selection information is sent from the terminal to the server, which then prepares for the next processing step. As output, the terminal displays the interface of the selected documents.

[0180] Step 3:

[0181] The device activates an emotion acquisition device and collects the user's facial expressions and voice data in real time. This data is analyzed using an emotion analysis algorithm, and the results are output to the device. The user's emotional state (e.g., tension, anxiety, joy) is identified, and an interaction based on this is applied.

[0182] Step 4:

[0183] The user enters personal information according to the terminal's instructions. The terminal temporarily stores the entered information and verifies the data's integrity and format. If errors exist, the terminal displays a message prompting the user to correct them. The entered data is then sent to the server in its correct format.

[0184] Step 5:

[0185] The server analyzes the received personal information using a data processing device and performs necessary data transformations and verifications. Specifically, format conversion and duplicate data removal are carried out. After analysis, multiple record documents are automatically generated and sent to the terminal.

[0186] Step 6:

[0187] The terminal displays a preview of the new record document received from the server on the user interface. The user can review the displayed document and make changes if necessary. The changes are submitted to the server as an update via the terminal.

[0188] Step 7:

[0189] The user electronically signs the document through their device, completing the final approval process. The device then sends the signed document to a server, which distributes it to the appropriate authorities.

[0190] Step 8:

[0191] The emotion acquisition device continuously monitors the user's emotions throughout the entire process. If the emotion analysis algorithm determines that the user is experiencing stress, the device will promptly provide additional guidance or take support actions based on prompts.

[0192] (Application Example 2)

[0193] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0194] The present invention aims to provide a system that reduces the stress and anxiety users feel when performing cumbersome paperwork, and enables them to efficiently carry out the entire process. Furthermore, it intends to solve the problem of improving the user experience by recognizing emotions and providing interactive support tailored to the user.

[0195] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0196] In this invention, the server includes means for receiving information entered by the user, data analysis means for analyzing the entered information and transcribing it into multiple different application forms, means for generating and outputting the transcribed information into each of the multiple application forms, and emotion analysis means for recognizing emotions and providing guidance according to the user's state. This makes it possible for the user to complete the procedure quickly without feeling emotional burden.

[0197] "User" refers to an individual or group that uses the system or service.

[0198] "Inputted information" refers to data and facts provided to the system by the user.

[0199] "Data analysis means" refers to a technology or method for analyzing input information and processing it based on a specific purpose or format.

[0200] "Application documents" refer to official documents or papers required to complete a specific procedure.

[0201] "Transcribing" is the act of moving information from one format or document to another format or document and re-recording it.

[0202] "Output means" refers to a method or device for displaying or providing analyzed data or generated information in a form that is understandable to the user.

[0203] "Emotional analysis means" refers to a technology or method that analyzes facial expressions, voice, etc., in order to identify the emotional state of a user.

[0204] "Providing guidance" means showing users information and instructions, and prompting them to take procedures or actions.

[0205] This invention implements a system in which a consumer robot supports users with paperwork procedures. The user uses the robot as an interface with a terminal and performs real-time emotion analysis.

[0206] The server receives information entered by the user. The received information is analyzed by data analysis tools and transcribed into multiple different application forms. The robot is operated as a terminal and uses emotion analysis tools to analyze the user's facial expressions and tone of voice. This analysis uses a camera and microphone as hardware, and for emotion analysis, it uses software such as OpenCV or TENSORFLOW®. Based on the analysis results, appropriate guidance is provided to the user.

[0207] Furthermore, if the user shows signs of stress or anxiety, the robot will provide voice guidance to lead them through each step of the procedure. This is done by playing voice guidance through a speaker and displaying the procedure's progress and input fields on a screen.

[0208] As a concrete example, consider a scenario where a user wants to obtain a resident registration certificate. The robot would guide the user by saying, "Next, please enter your name correctly. If you think you might make a mistake, please relax and check again." Furthermore, if the user is feeling anxious, calming music would be played to help them relax.

[0209] An example of a prompt using a generative AI model is: "I need help filling out this form, but I'm a little unsure. Could you please explain the procedure?"

[0210] In this way, users can complete paperwork efficiently while reducing their emotional burden through the robot's emotion recognition and guidance functions.

[0211] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0212] Step 1:

[0213] The user accesses the system through their device and logs in. The information entered is the user's ID and password, and the device uses this authentication information to recognize the user. If authentication is successful, the user's profile data is retrieved from the server.

[0214] Step 2:

[0215] The terminal displays a list of available application documents to the user based on data retrieved from the server. The input here is the user's profile information, and the output is a list of the corresponding application documents. The user then selects the necessary application documents.

[0216] Step 3:

[0217] When the user selects an application form, the terminal provides an input interface. At this stage, the emotion analysis system is activated, analyzing the user's facial expressions with the camera and their voice tone with the microphone in real time. The input consists of the user's facial expression data and voice data, and the output is an indicator of the user's emotional state.

[0218] Step 4:

[0219] The server receives the entered personal information. The information entered is personal information entered by the user through the interface. The server analyzes this information and converts it into a data format for transfer to multiple application forms using data analysis tools.

[0220] Step 5:

[0221] Based on the emotion analysis results, the device provides interactive support when the user's emotional state indicates stress or anxiety. For example, it may display detailed explanations on the screen for each step of a procedure, or play audio guidance through the speaker. The output is presented in a way that is easy for the user to understand.

[0222] Step 6:

[0223] The server automatically generates the necessary application documents based on the analyzed information and sends them to the terminal. Input consists of the user's personal information and selected application documents, while output is the completed application documents. This allows the user to preview the document contents.

[0224] Step 7:

[0225] The user reviews the application form generated on the terminal and makes corrections as needed. Once verification is complete, the user formally approves it using an electronic signature. The input is the revised application information and electronic signature, and the output is the signed, formal application form.

[0226] Step 8:

[0227] The server collects the signed documents and sends them appropriately to the relevant authorities. The output serves as proof that the formal procedures have been completed. This completes the user's process, which is carried out quickly and with reduced emotional burden.

[0228] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0229] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0230] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0231] [Second Embodiment]

[0232] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0233] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0234] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0235] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0236] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0237] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0238] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0239] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0240] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0241] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0242] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0243] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0244] This invention provides a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. This system consists of a terminal, a server, and user operations.

[0245] The user first logs into the system using a terminal. After successful login, the terminal displays a list of available application forms. The user can then select the documents that best suit their needs.

[0246] Based on the selected documents, the terminal provides an interface for the user to enter the necessary personal information. Once the user enters the required information, the terminal sends that data to the server.

[0247] The server is equipped with data analysis capabilities to analyze the received data. This allows the server to identify the necessary information for each application document and distribute the data to streamline the process. This analysis reduces the need for redundant data entry.

[0248] After analysis and sorting are complete, the server generates information in a format suitable for multiple application documents and outputs it to the terminal. The user can review the generated application documents on the terminal and make corrections as needed. The corrected data is sent back to the server for a final verification process.

[0249] Next, the user affixes an electronic signature to the application documents via the terminal. This electronic signature officially authenticates the documents. Finally, the server submits the signed documents to the relevant government office's system. The user uses the terminal to schedule an appointment with the government office, ensuring the entire process proceeds smoothly.

[0250] This system allows users to avoid the hassle of repeatedly entering the same information during the application process, enabling them to complete the process quickly and accurately.

[0251] The following describes the processing flow.

[0252] Step 1:

[0253] The user logs into the system using a terminal. The terminal displays a login screen to the user and prompts them to enter their ID and password. Once the user enters the information, the terminal sends that information to the server to attempt authentication.

[0254] Step 2:

[0255] The server compares the received authentication information with the registered information in the database. If authentication is successful, the server retrieves the user's account information and sends an authentication success message to the terminal.

[0256] Step 3:

[0257] The terminal displays a list of available application forms to the user. The user selects the necessary documents from the list according to their purpose.

[0258] Step 4:

[0259] When the user selects an application document, the terminal sends that information to the server. The server generates a list of required information fields for the selected document.

[0260] Step 5:

[0261] The terminal displays an interface for the user to enter the necessary personal information for the selected document. The user enters the required information into the terminal.

[0262] Step 6:

[0263] The terminal sends the entered user data to the server. The server receives the data using data analysis tools and distributes the necessary information to the appropriate fields in each application form.

[0264] Step 7:

[0265] Based on the analysis results, the server generates application forms containing the necessary information for various application documents, sends them to the terminal, and displays a preview.

[0266] Step 8:

[0267] The user reviews the application form preview on their device and makes corrections if necessary. The corrected information is then resent from the device to the server.

[0268] Step 9:

[0269] The user applies an electronic signature to the application document using their device. The device then sends the signed data to the server.

[0270] Step 10:

[0271] The server submits the final application documents to the relevant government office's system. The user then uses their terminal to schedule an appointment to visit the office and complete the process.

[0272] (Example 1)

[0273] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0274] Traditional application procedures required users to repeatedly enter the same information into multiple documents, which was not only time-consuming but also prone to input errors. Furthermore, the process of formally authenticating the submitted documents was complex, reducing the overall efficiency of the process.

[0275] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0276] In this invention, the server includes means for receiving information entered by a user, data analysis means for analyzing the entered information and checking for duplicates or omissions, means for sorting the data for transcription into multiple different types of documents, and means for automatically generating and outputting multiple documents based on the sorted information. This significantly reduces the time and effort required for the user's procedures, enabling the application process to be completed quickly and accurately.

[0277] "User" refers to a person who operates the system, inputs information, and submits an application.

[0278] "The means for receiving information" refers to the mechanism for the system to receive and store the input from the user.

[0279] "Data analysis means" refers to the technology for analyzing the content of the received information and detecting duplication or deficiency of information.

[0280] "The means for distributing data" refers to the method of distributing data in a format suitable for different documents based on the analysis results.

[0281] "The means for automatically generating documents" refers to the process by which the system automatically creates documents based on the distributed information.

[0282] "Electronic signature" is a means of authenticating digital information and refers to the technology for guaranteeing the validity of documents.

[0283] "The means for providing an interface" refers to the technology of the operation screen when the user inputs information or checks and modifies documents.

[0284] This invention is a system for efficiently conducting application procedures related to weddings, funerals, and other ceremonies. This system is composed of a terminal, a server, and user operations.

[0285] The user first logs in to the system using the terminal. Standard personal computers or tablet devices are suitable for the terminal. When the login is successful, the terminal displays a list of available application documents to the user. This includes wedding invitations and funeral arrangement documents.

[0286] When the user selects a document, the terminal provides an interface for inputting the necessary personal information. This interface is designed so that the user can easily input information, and intuitive operations are possible through the user interface.

[0287] Once information is entered, the terminal sends it to the server. The server uses high-performance data analysis software to analyze the information received from the user. This process eliminates duplicate information and identifies any missing information. The server then sorts the data based on the analysis results. This sorting process automatically organizes the information into multiple different types of application forms.

[0288] Next, the server automatically generates the necessary documents and sends their contents to the terminal. The user reviews the generated documents via the terminal and makes corrections as needed. This corrected information is sent back to the server, which then digitally signs the documents. The digital signature officially authenticates the document's legitimacy.

[0289] Ultimately, the server submits the signed documents online to the relevant department's information system. Users can also use the terminal to schedule visits to the relevant departments. Furthermore, it is possible to automatically input data and generate prompts using a generated AI model based on user actions.

[0290] As a concrete example of a prompt message, you could enter something like, "Please tell me how to create a wedding invitation using the system for streamlining wedding and funeral procedures."

[0291] This system allows users to complete the application process easily and quickly, ensuring the entire process runs smoothly.

[0292] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0293] Step 1:

[0294] The user logs into the system using a terminal. Authentication is performed by entering a username and password into the login interface, and if authentication is successful, the system proceeds to the next step. Login information (input) is received, and the authentication result (output) is obtained.

[0295] Step 2:

[0296] Upon successful login, the terminal displays a list of available application forms to the user. The user then selects the document that best suits their purpose. Based on the selected document (input), the corresponding document's information (output) is displayed.

[0297] Step 3:

[0298] When a user selects a document, the terminal provides an interface for entering the personal information required for that document. Here, the user enters necessary information such as their name and address. Based on the entered personal information (input), a dataset (output) is generated.

[0299] Step 4:

[0300] The terminal sends the personal information entered by the user to the server. The server uses data analysis tools to analyze the received data. Duplicate or missing data is detected, and necessary corrections are listed. Analysis results (output) are obtained from the personal information data (input).

[0301] Step 5:

[0302] The server sorts the data for each document based on the analysis results. This ensures that the necessary information is transferred to each application form. Data sets (output) are created for each document sorted from the analysis results (input).

[0303] Step 6:

[0304] The server uses a generation AI model to automatically generate documents based on the sorted information. The generated documents (output) are quickly sent to the terminal. The completed application documents (output) are obtained from the sorted data (input).

[0305] Step 7:

[0306] The terminal displays the generated application documents to the user. After the user checks the content, the user can make corrections as needed. The corrected documents (output) are sent to the server again. Based on the user's feedback (input), the corrected data (output) is generated.

[0307] Step 8:

[0308] The server assigns an electronic signature to the final application documents reflecting the corrections. The document is officially authenticated by the electronic signature (output). The electronically authenticated document (output) is obtained from the corrected document (input).

[0309] Step 9:

[0310] The server submits the signed document to the system of the relevant institution. After confirmation of submission completion (output), the user makes an appointment to visit the relevant institution via the terminal. A completion notice (output) is generated from the submission preparation (input).

[0311] With this system, the user can efficiently complete a series of procedures.

[0312] (Application Example 1)

[0313] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0314] In procedures and reservations within a store, it is necessary to prevent duplication of information input by users and streamline the procedures. However, in conventional systems, there is a lot of manual work, which requires time and labor, so there is a demand for improving the efficiency of operations.

[0315] [[ID=http: / / www.example.com / ]] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0316] In this invention, the server includes means for receiving data entered by a user, means for analyzing the entered data and transcribing it into multiple different documents, means for generating and outputting the data transcribed into the multiple documents, and means for managing the registration and reservation of in-store procedures. This makes it possible to streamline information registration and reservation procedures at stores and to reuse the entered information.

[0317] "User" refers to an individual or group that operates the system and enters data.

[0318] "Data" refers to information entered by users, and includes various forms of information that are subject to analysis and transcription.

[0319] "Information analysis means" refers to technical methods and devices for processing input data and transcribing it into necessary documents.

[0320] "Document" refers to digital or physical documents generated by information analysis tools and used for user procedures and reservations.

[0321] "Management means" refers to the software and processes within a system that enable efficient procedures.

[0322] A "store" refers to a place where goods or services are actually provided, and there is a need to streamline the procedures.

[0323] This invention is implemented as a system for efficiently handling procedures and reservations within a store. The hardware used includes smartphones and tablets as user terminals and servers for data processing. For software, Python is used for data analysis, and DocuSign or Adobe Sign are used as document management systems for information transfer and document management.

[0324] Users log in to the system using a terminal and select procedures or reservations. Based on the selected procedure, they can input the necessary data. The terminal sends the entered data to the server. The server receives the data and uses information analysis tools to sort it into the necessary documents. This enables efficient data transfer to multiple documents.

[0325] As a concrete example, this system can be used for member registration at a cafe, allowing new members to smoothly complete the registration process using their smartphones. The prompt used to input into the generating AI model would be something like this: "Please give me your ideas for a system to streamline member registration at a cafe. I'm looking for a way to simplify the traditional application process and minimize the amount of input required from the user."

[0326] In this way, we can streamline in-store procedures and reservations, providing a less burdensome environment for users.

[0327] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0328] Step 1:

[0329] The terminal provides the functionality to log in to the system. It receives a username and password as input and sends the login information to the server. The server compares the input information with the authentication database, determines whether the login was successful, and returns the result to the user.

[0330] Step 2:

[0331] The user selects a procedure or reservation on the application. The terminal displays a list of information items related to the selected procedure. Upon receiving user input, the terminal sends that information to the server. Here, the user's selection is input, and the necessary data items are output.

[0332] Step 3:

[0333] The server analyzes the received data and transcribes the necessary information into the appropriate document format using analytical tools. Based on the received data, it maps the data to a document template and fills in the variables to generate the document. In this process, the input data is converted into data in the document format, and each document layout is arranged before output.

[0334] Step 4:

[0335] For the generated document, the server sends the document data to the user's terminal for review. The user reviews the document on the terminal and makes corrections as needed. The corrected data is sent back to the server, and the document is updated without any discrepancies and a final check is performed.

[0336] Step 5:

[0337] The user performs an electronic signature via a terminal. The server manages the signing process and adds the electronic signature to the document. At this time, the input from the signing device is output as signature data.

[0338] Step 6:

[0339] The server submits the signed document to the relevant institution's system. The server securely transmits the document through the document management system and confirms the response from the institution's system. In this step, the signed document is the input, and the institution's receipt is the output.

[0340] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0341] This invention is a system that combines an emotion engine to recognize user emotions and aims to efficiently support application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and a user, and provides users with an excellent experience.

[0342] The user accesses the system and logs in using a terminal. After logging in, the terminal displays a list of available application forms, and the user selects the documents they need. At this time, the emotion engine is activated and analyzes the user's facial expressions and tone of voice in real time to understand their emotions.

[0343] The terminal provides an input interface based on the selected application form, and the user enters their personal information. The emotion engine monitors whether the user is experiencing stress during the input process and provides interactive support as needed. For example, if the user shows signs of anxiety, it will display explanations of the procedure on the screen or play an audio guide to help the user.

[0344] The input information is sent from the terminal to the server, which analyzes the information using data analysis tools and automatically transfers the data to each application form. The server generates the necessary application forms and sends them to the terminal to provide the user with a preview.

[0345] The user reviews the application form generated on their device and makes any necessary corrections. After further review, they formally approve it using an electronic signature. The signed documents are collected by the server and appropriately transmitted to the relevant authorities.

[0346] Throughout this entire process, the emotion engine continuously provides proactive, emotion-based support to ensure user satisfaction and a smooth procedure. This system allows users to complete the application process quickly and efficiently while reducing emotional burden.

[0347] The following describes the processing flow.

[0348] Step 1:

[0349] The user logs into the device. The device displays a login screen, and the user enters their ID and password. This information is sent from the device to the server for authentication.

[0350] Step 2:

[0351] The server checks the user's authentication information in the database, and if authentication is successful, sends a login success notification to the terminal. The terminal then displays a list of available application forms to the user.

[0352] Step 3:

[0353] The user selects the necessary application documents. The terminal sends the selections to the server. At this point, the emotion engine activates and begins monitoring the user's emotional state.

[0354] Step 4:

[0355] The terminal displays an interface for the user to enter the necessary information into the selected document. Once the user begins inputting, the emotion engine analyzes emotional data from facial expressions and tone of voice.

[0356] Step 5:

[0357] The emotion engine immediately notifies the device if it detects user stress or anxiety. The device then supports the user by displaying a support message on the screen or playing an audio guide.

[0358] Step 6:

[0359] Once the user has finished entering their information, the terminal sends the information to the server. The server analyzes the information using data analysis tools and automatically transfers the necessary data to each application form.

[0360] Step 7:

[0361] The server generates application documents using the analyzed data and sends them to the terminal. The terminal then displays a preview of the generated documents to the user and asks for confirmation.

[0362] Step 8:

[0363] The user previews the document on their device and instructs the system to correct any errors. The correction information is then sent to the server via the device.

[0364] Step 9:

[0365] The user electronically signs the application documents via their device. The device then sends the signed documents to the server.

[0366] Step 10:

[0367] The server submits the signed documents to the relevant government system. The emotion engine continues to support the user's emotions until the entire process is completed smoothly.

[0368] (Example 2)

[0369] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0370] Traditional application systems often fail to alleviate the psychological burden on users, potentially compromising the overall efficiency of the process. In particular, complex procedures performed under stressful conditions can lead to input errors and misunderstandings, ultimately resulting in delays. This problem needs to be addressed.

[0371] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0372] In this invention, the server includes a device for receiving information entered by a user, a data processing device for analyzing the entered information and transcribing it into multiple different record documents, a device for generating and outputting the transcribed information into the multiple documents, a device for acquiring and analyzing emotions, and a device for providing interactive support based on the user's emotions. This makes it possible to provide flexible support according to the user's emotional state and to complete procedures quickly and efficiently.

[0373] A "user" is a person who uses the system to input information and perform procedures.

[0374] "Information entered" refers to personal information and other data provided by users through the system.

[0375] A "data processing device" is a device that analyzes input information and converts or transcribes the data according to its purpose.

[0376] "Record documents" refer to documents or forms generated by data processing equipment.

[0377] A "device for acquiring and analyzing emotions" is a device that collects data on a user's psychological state from their facial expressions, tone of voice, etc., and then analyzes that data.

[0378] An "interactive support device" is a device that provides guidance and support based on the user's emotional state, through screen displays, audio guides, and other means.

[0379] This invention is a system that recognizes user emotions and efficiently creates and manages record documents. This system mainly consists of a server, terminals, and users, each operating according to its respective role.

[0380] The server plays a central role in data processing, receiving information input from users and performing analysis using data processing devices. It can accurately transcribe and generate necessary information for multiple record documents. This analysis employs data processing techniques using specific algorithms.

[0381] The terminal serves as an interface with the user. Users can access the system and input information using the terminal. The terminal is equipped with a camera and microphone, and it is possible to capture emotions through these input devices. The emotion-capturing device analyzes the user's facial expressions and tone of voice in real time to identify their emotional state.

[0382] Users select various record documents and input the necessary information through the provided interface. During this process, an interactive support system operates, providing guidance tailored to the user's emotional state. For example, if the user shows anxiety, a guide may be displayed on the screen or audio guidance may be provided.

[0383] As a concrete example, consider a user who is going through the application process related to a wedding. The user selects the marriage registration form through the terminal and enters the necessary personal information. If the emotion-gathering device detects the user's anxiety, the terminal displays an illustrated procedural guide to support the process.

[0384] An example of a prompt would be, "Explain how sentiment analysis technology can be integrated to make the application process more user-friendly." The AI ​​model generated based on this prompt will help design more efficient and user-friendly systems, and contribute to improving services based on emotions.

[0385] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0386] Step 1:

[0387] The user accesses the system and logs in using a terminal. The terminal receives authentication information (user ID and password) entered by the user and sends it to the server. The server compares the received information with the database and performs authentication. If authentication is successful, a login completion notification is displayed on the terminal.

[0388] Step 2:

[0389] The terminal retrieves the latest list of application documents from the server and displays it in the user interface. The user selects the required documents on the terminal. This selection information is sent from the terminal to the server, which then prepares for the next processing step. As output, the terminal displays the interface of the selected documents.

[0390] Step 3:

[0391] The device activates an emotion acquisition device and collects the user's facial expressions and voice data in real time. This data is analyzed using an emotion analysis algorithm, and the results are output to the device. The user's emotional state (e.g., tension, anxiety, joy) is identified, and an interaction based on this is applied.

[0392] Step 4:

[0393] The user enters personal information according to the terminal's instructions. The terminal temporarily stores the entered information and verifies the data's integrity and format. If errors exist, the terminal displays a message prompting the user to correct them. The entered data is then sent to the server in its correct format.

[0394] Step 5:

[0395] The server analyzes the received personal information using a data processing device and performs necessary data transformations and verifications. Specifically, format conversion and duplicate data removal are carried out. After analysis, multiple record documents are automatically generated and sent to the terminal.

[0396] Step 6:

[0397] The terminal displays a preview of the new record document received from the server on the user interface. The user can review the displayed document and make changes if necessary. The changes are submitted to the server as an update via the terminal.

[0398] Step 7:

[0399] The user electronically signs the document through their device, completing the final approval process. The device then sends the signed document to a server, which distributes it to the appropriate authorities.

[0400] Step 8:

[0401] The emotion acquisition device continuously monitors the user's emotions throughout the entire process. If the emotion analysis algorithm determines that the user is experiencing stress, the device will promptly provide additional guidance or take support actions based on prompts.

[0402] (Application Example 2)

[0403] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0404] The present invention aims to provide a system that reduces the stress and anxiety users feel when performing cumbersome paperwork, and enables them to efficiently carry out the entire process. Furthermore, it intends to solve the problem of improving the user experience by recognizing emotions and providing interactive support tailored to the user.

[0405] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0406] In this invention, the server includes means for receiving information entered by the user, data analysis means for analyzing the entered information and transcribing it into multiple different application forms, means for generating and outputting the transcribed information into each of the multiple application forms, and emotion analysis means for recognizing emotions and providing guidance according to the user's state. This makes it possible for the user to complete the procedure quickly without feeling emotional burden.

[0407] "User" refers to an individual or group that uses the system or service.

[0408] "Inputted information" refers to data and facts provided to the system by the user.

[0409] "Data analysis means" refers to a technology or method for analyzing input information and processing it based on a specific purpose or format.

[0410] "Application documents" refer to official documents or papers required to complete a specific procedure.

[0411] "Transcribing" is the act of moving information from one format or document to another format or document and re-recording it.

[0412] "Output means" refers to a method or device for displaying or providing analyzed data or generated information in a form that is understandable to the user.

[0413] "Emotional analysis means" refers to a technology or method that analyzes facial expressions, voice, etc., in order to identify the emotional state of a user.

[0414] "Providing guidance" means showing users information and instructions, and prompting them to take procedures or actions.

[0415] This invention implements a system in which a consumer robot supports users with paperwork procedures. The user uses the robot as an interface with a terminal and performs real-time emotion analysis.

[0416] The server receives information entered by the user. The received information is analyzed by data analysis tools and transcribed into multiple different application forms. The robot is operated as a terminal and analyzes the user's facial expressions and voice tone using emotion analysis tools. This analysis uses a camera and microphone as hardware, and software such as OpenCV or TensorFlow for emotion analysis. Based on the analysis results, appropriate guidance is provided to the user.

[0417] Furthermore, if the user shows signs of stress or anxiety, the robot will provide voice guidance to lead them through each step of the procedure. This is done by playing voice guidance through a speaker and displaying the procedure's progress and input fields on a screen.

[0418] As a concrete example, consider a scenario where a user wants to obtain a resident registration certificate. The robot would guide the user by saying, "Next, please enter your name correctly. If you think you might make a mistake, please relax and check again." Furthermore, if the user is feeling anxious, calming music would be played to help them relax.

[0419] An example of a prompt using a generative AI model is: "I need help filling out this form, but I'm a little unsure. Could you please explain the procedure?"

[0420] In this way, users can complete paperwork efficiently while reducing their emotional burden through the robot's emotion recognition and guidance functions.

[0421] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0422] Step 1:

[0423] The user accesses the system through their device and logs in. The information entered is the user's ID and password, and the device uses this authentication information to recognize the user. If authentication is successful, the user's profile data is retrieved from the server.

[0424] Step 2:

[0425] The terminal displays a list of available application documents to the user based on data retrieved from the server. The input here is the user's profile information, and the output is a list of the corresponding application documents. The user then selects the necessary application documents.

[0426] Step 3:

[0427] When the user selects an application form, the terminal provides an input interface. At this stage, the emotion analysis system is activated, analyzing the user's facial expressions with the camera and their voice tone with the microphone in real time. The input consists of the user's facial expression data and voice data, and the output is an indicator of the user's emotional state.

[0428] Step 4:

[0429] The server receives the entered personal information. The information entered is personal information entered by the user through the interface. The server analyzes this information and converts it into a data format for transfer to multiple application forms using data analysis tools.

[0430] Step 5:

[0431] Based on the emotion analysis results, the device provides interactive support when the user's emotional state indicates stress or anxiety. For example, it may display detailed explanations on the screen for each step of a procedure, or play audio guidance through the speaker. The output is presented in a way that is easy for the user to understand.

[0432] Step 6:

[0433] The server automatically generates the necessary application documents based on the analyzed information and sends them to the terminal. Input consists of the user's personal information and selected application documents, while output is the completed application documents. This allows the user to preview the document contents.

[0434] Step 7:

[0435] The user reviews the application form generated on the terminal and makes corrections as needed. Once verification is complete, the user formally approves it using an electronic signature. The input is the revised application information and electronic signature, and the output is the signed, formal application form.

[0436] Step 8:

[0437] The server collects the signed documents and sends them appropriately to the relevant authorities. The output serves as proof that the formal procedures have been completed. This completes the user's process, which is carried out quickly and with reduced emotional burden.

[0438] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0439] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0440] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0441] [Third Embodiment]

[0442] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0443] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0444] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0445] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0446] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0447] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0448] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0449] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0450] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0451] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0452] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0453] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0454] This invention provides a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. This system consists of a terminal, a server, and user operations.

[0455] The user first logs into the system using a terminal. After successful login, the terminal displays a list of available application forms. The user can then select the documents that best suit their needs.

[0456] Based on the selected documents, the terminal provides an interface for the user to enter the necessary personal information. Once the user enters the required information, the terminal sends that data to the server.

[0457] The server is equipped with data analysis capabilities to analyze the received data. This allows the server to identify the necessary information for each application document and distribute the data to streamline the process. This analysis reduces the need for redundant data entry.

[0458] After analysis and sorting are complete, the server generates information in a format suitable for multiple application documents and outputs it to the terminal. The user can review the generated application documents on the terminal and make corrections as needed. The corrected data is sent back to the server for a final verification process.

[0459] Next, the user affixes an electronic signature to the application documents via the terminal. This electronic signature officially authenticates the documents. Finally, the server submits the signed documents to the relevant government office's system. The user uses the terminal to schedule an appointment with the government office, ensuring the entire process proceeds smoothly.

[0460] This system allows users to avoid the hassle of repeatedly entering the same information during the application process, enabling them to complete the process quickly and accurately.

[0461] The following describes the processing flow.

[0462] Step 1:

[0463] The user logs into the system using a terminal. The terminal displays a login screen to the user and prompts them to enter their ID and password. Once the user enters the information, the terminal sends that information to the server to attempt authentication.

[0464] Step 2:

[0465] The server compares the received authentication information with the registered information in the database. If authentication is successful, the server retrieves the user's account information and sends an authentication success message to the terminal.

[0466] Step 3:

[0467] The terminal displays a list of available application forms to the user. The user selects the necessary documents from the list according to their purpose.

[0468] Step 4:

[0469] When the user selects an application document, the terminal sends that information to the server. The server generates a list of required information fields for the selected document.

[0470] Step 5:

[0471] The terminal displays an interface for the user to enter the necessary personal information for the selected document. The user enters the required information into the terminal.

[0472] Step 6:

[0473] The terminal sends the entered user data to the server. The server receives the data using data analysis tools and distributes the necessary information to the appropriate fields in each application form.

[0474] Step 7:

[0475] Based on the analysis results, the server generates application forms containing the necessary information for various application documents, sends them to the terminal, and displays a preview.

[0476] Step 8:

[0477] The user reviews the application form preview on their device and makes corrections if necessary. The corrected information is then resent from the device to the server.

[0478] Step 9:

[0479] The user applies an electronic signature to the application document using their device. The device then sends the signed data to the server.

[0480] Step 10:

[0481] The server submits the final application documents to the relevant government office's system. The user then uses their terminal to schedule an appointment to visit the office and complete the process.

[0482] (Example 1)

[0483] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0484] Traditional application procedures required users to repeatedly enter the same information into multiple documents, which was not only time-consuming but also prone to input errors. Furthermore, the process of formally authenticating the submitted documents was complex, reducing the overall efficiency of the process.

[0485] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0486] In this invention, the server includes means for receiving information entered by a user, data analysis means for analyzing the entered information and checking for duplicates or omissions, means for sorting the data for transcription into multiple different types of documents, and means for automatically generating and outputting multiple documents based on the sorted information. This significantly reduces the time and effort required for the user's procedures, enabling the application process to be completed quickly and accurately.

[0487] "User" refers to a person who operates the system, inputs information, and submits an application.

[0488] "Means of receiving information" refers to the mechanism by which a system receives and stores input from users.

[0489] "Data analysis means" refers to techniques that analyze the content of received information and detect duplication or omissions in that information.

[0490] "Methods for distributing data" refers to methods of distributing data in formats suitable for different documents based on analysis results.

[0491] "Methods for automatically generating documents" refers to the process by which a system automatically creates documents based on sorted information.

[0492] An "electronic signature" is a means of authenticating digital information and refers to a technology used to guarantee the authenticity of documents.

[0493] "Means of providing an interface" refers to the technology that provides the user interface for inputting information or checking and modifying documents.

[0494] This invention is a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and user operations.

[0495] The user first logs into the system using a terminal. A standard personal computer or tablet device is suitable as the terminal. Upon successful login, the terminal displays a list of available application forms to the user. These include wedding invitations and funeral arrangements.

[0496] When a user selects a document, the terminal provides an interface for entering the necessary personal information. This interface is designed to allow users to easily enter information and enables intuitive operation through the user interface.

[0497] Once information is entered, the terminal sends it to the server. The server uses high-performance data analysis software to analyze the information received from the user. This process eliminates duplicate information and identifies any missing information. The server then sorts the data based on the analysis results. This sorting process automatically organizes the information into multiple different types of application forms.

[0498] Next, the server automatically generates the necessary documents and sends their contents to the terminal. The user reviews the generated documents via the terminal and makes corrections as needed. This corrected information is sent back to the server, which then digitally signs the documents. The digital signature officially authenticates the document's legitimacy.

[0499] Ultimately, the server submits the signed documents online to the relevant department's information system. Users can also use the terminal to schedule visits to the relevant departments. Furthermore, it is possible to automatically input data and generate prompts using a generated AI model based on user actions.

[0500] As a concrete example of a prompt message, you could enter something like, "Please tell me how to create a wedding invitation using the system for streamlining wedding and funeral procedures."

[0501] This system allows users to complete the application process easily and quickly, ensuring the entire process runs smoothly.

[0502] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0503] Step 1:

[0504] The user logs into the system using a terminal. Authentication is performed by entering a username and password into the login interface, and if authentication is successful, the system proceeds to the next step. Login information (input) is received, and the authentication result (output) is obtained.

[0505] Step 2:

[0506] Upon successful login, the terminal displays a list of available application forms to the user. The user then selects the document that best suits their purpose. Based on the selected document (input), the corresponding document's information (output) is displayed.

[0507] Step 3:

[0508] When a user selects a document, the terminal provides an interface for entering the personal information required for that document. Here, the user enters necessary information such as their name and address. Based on the entered personal information (input), a dataset (output) is generated.

[0509] Step 4:

[0510] The terminal sends the personal information entered by the user to the server. The server uses data analysis tools to analyze the received data. Duplicate or missing data is detected, and necessary corrections are listed. Analysis results (output) are obtained from the personal information data (input).

[0511] Step 5:

[0512] The server sorts the data for each document based on the analysis results. This ensures that the necessary information is transferred to each application form. Data sets (output) are created for each document sorted from the analysis results (input).

[0513] Step 6:

[0514] The server uses a generation AI model to automatically generate documents based on the sorted information. The generated documents (output) are quickly sent to the terminal. The completed application documents (output) are obtained from the sorted data (input).

[0515] Step 7:

[0516] The terminal displays the generated application document to the user, who can review the content and make corrections as needed. The corrected document (output) is then sent back to the server. Based on the user's feedback (input), the corrected data (output) is generated.

[0517] Step 8:

[0518] The server affixes an electronic signature to the final application document reflecting the revisions. The document is officially authenticated by the electronic signature (output). An electronically authenticated document (output) is obtained from the revised document (input).

[0519] Step 9:

[0520] The server submits the signed documents to the relevant institution's system. After confirmation of submission completion (output), the user makes a reservation to visit the relevant institution via the terminal. The process goes from preparation for submission (input) to the generation of a completion notification (output).

[0521] This system allows users to complete a series of procedures efficiently.

[0522] (Application Example 1)

[0523] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0524] In store procedures and reservations, it is necessary to prevent duplication of information entered by users and streamline the process. However, traditional systems involve a lot of manual work, which is time-consuming and labor-intensive, so there is a need to improve operational efficiency.

[0525] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0526] In this invention, the server includes means for receiving data entered by a user, means for analyzing the entered data and transcribing it into multiple different documents, means for generating and outputting the data transcribed into the multiple documents, and means for managing the registration and reservation of in-store procedures. This makes it possible to streamline information registration and reservation procedures at stores and to reuse the entered information.

[0527] "User" refers to an individual or group that operates the system and enters data.

[0528] "Data" refers to information entered by users, and includes various forms of information that are subject to analysis and transcription.

[0529] "Information analysis means" refers to technical methods and devices for processing input data and transcribing it into necessary documents.

[0530] "Document" refers to digital or physical documents generated by information analysis tools and used for user procedures and reservations.

[0531] "Management means" refers to the software and processes within a system that enable efficient procedures.

[0532] A "store" refers to a place where goods or services are actually provided, and there is a need to streamline the procedures.

[0533] This invention is implemented as a system for efficiently handling procedures and reservations within a store. The hardware used includes smartphones and tablets as user terminals and servers for data processing. For software, Python is used for data analysis, and DocuSign or Adobe Sign are used as document management systems for information transfer and document management.

[0534] Users log in to the system using a terminal and select procedures or reservations. Based on the selected procedure, they can input the necessary data. The terminal sends the entered data to the server. The server receives the data and uses information analysis tools to sort it into the necessary documents. This enables efficient data transfer to multiple documents.

[0535] As a concrete example, this system can be used for member registration at a cafe, allowing new members to smoothly complete the registration process using their smartphones. The prompt used to input into the generating AI model would be something like this: "Please give me your ideas for a system to streamline member registration at a cafe. I'm looking for a way to simplify the traditional application process and minimize the amount of input required from the user."

[0536] In this way, we can streamline in-store procedures and reservations, providing a less burdensome environment for users.

[0537] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0538] Step 1:

[0539] The terminal provides the functionality to log in to the system. It receives a username and password as input and sends the login information to the server. The server compares the input information with the authentication database, determines whether the login was successful, and returns the result to the user.

[0540] Step 2:

[0541] The user selects a procedure or reservation on the application. The terminal displays a list of information items related to the selected procedure. Upon receiving user input, the terminal sends that information to the server. Here, the user's selection is input, and the necessary data items are output.

[0542] Step 3:

[0543] The server analyzes the received data and transcribes the necessary information into the appropriate document format using analytical tools. Based on the received data, it maps the data to a document template and fills in the variables to generate the document. In this process, the input data is converted into data in the document format, and each document layout is arranged before output.

[0544] Step 4:

[0545] For the generated document, the server sends the document data to the user's terminal for review. The user reviews the document on the terminal and makes corrections as needed. The corrected data is sent back to the server, and the document is updated without any discrepancies and a final check is performed.

[0546] Step 5:

[0547] The user performs an electronic signature via a terminal. The server manages the signing process and adds the electronic signature to the document. At this time, the input from the signing device is output as signature data.

[0548] Step 6:

[0549] The server submits the signed document to the relevant institution's system. The server securely transmits the document through the document management system and confirms the response from the institution's system. In this step, the signed document is the input, and the institution's receipt is the output.

[0550] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0551] This invention is a system that combines an emotion engine to recognize user emotions and aims to efficiently support application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and a user, and provides users with an excellent experience.

[0552] The user accesses the system and logs in using a terminal. After logging in, the terminal displays a list of available application forms, and the user selects the documents they need. At this time, the emotion engine is activated and analyzes the user's facial expressions and tone of voice in real time to understand their emotions.

[0553] The terminal provides an input interface based on the selected application form, and the user enters their personal information. The emotion engine monitors whether the user is experiencing stress during the input process and provides interactive support as needed. For example, if the user shows signs of anxiety, it will display explanations of the procedure on the screen or play an audio guide to help the user.

[0554] The input information is sent from the terminal to the server, which analyzes the information using data analysis tools and automatically transfers the data to each application form. The server generates the necessary application forms and sends them to the terminal to provide the user with a preview.

[0555] The user reviews the application form generated on their device and makes any necessary corrections. After further review, they formally approve it using an electronic signature. The signed documents are collected by the server and appropriately transmitted to the relevant authorities.

[0556] Throughout this entire process, the emotion engine continuously provides proactive, emotion-based support to ensure user satisfaction and a smooth procedure. This system allows users to complete the application process quickly and efficiently while reducing emotional burden.

[0557] The following describes the processing flow.

[0558] Step 1:

[0559] The user logs into the device. The device displays a login screen, and the user enters their ID and password. This information is sent from the device to the server for authentication.

[0560] Step 2:

[0561] The server checks the user's authentication information in the database, and if authentication is successful, sends a login success notification to the terminal. The terminal then displays a list of available application forms to the user.

[0562] Step 3:

[0563] The user selects the necessary application documents. The terminal sends the selections to the server. At this point, the emotion engine activates and begins monitoring the user's emotional state.

[0564] Step 4:

[0565] The terminal displays an interface for the user to enter the necessary information into the selected document. Once the user begins inputting, the emotion engine analyzes emotional data from facial expressions and tone of voice.

[0566] Step 5:

[0567] The emotion engine immediately notifies the device if it detects user stress or anxiety. The device then supports the user by displaying a support message on the screen or playing an audio guide.

[0568] Step 6:

[0569] Once the user has finished entering their information, the terminal sends the information to the server. The server analyzes the information using data analysis tools and automatically transfers the necessary data to each application form.

[0570] Step 7:

[0571] The server generates application documents using the analyzed data and sends them to the terminal. The terminal then displays a preview of the generated documents to the user and asks for confirmation.

[0572] Step 8:

[0573] The user previews the document on their device and instructs the system to correct any errors. The correction information is then sent to the server via the device.

[0574] Step 9:

[0575] The user electronically signs the application documents via their device. The device then sends the signed documents to the server.

[0576] Step 10:

[0577] The server submits the signed documents to the relevant government system. The emotion engine continues to support the user's emotions until the entire process is completed smoothly.

[0578] (Example 2)

[0579] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0580] Traditional application systems often fail to alleviate the psychological burden on users, potentially compromising the overall efficiency of the process. In particular, complex procedures performed under stressful conditions can lead to input errors and misunderstandings, ultimately resulting in delays. This problem needs to be addressed.

[0581] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0582] In this invention, the server includes a device for receiving information entered by a user, a data processing device for analyzing the entered information and transcribing it into multiple different record documents, a device for generating and outputting the transcribed information into the multiple documents, a device for acquiring and analyzing emotions, and a device for providing interactive support based on the user's emotions. This makes it possible to provide flexible support according to the user's emotional state and to complete procedures quickly and efficiently.

[0583] A "user" is a person who uses the system to input information and perform procedures.

[0584] "Information entered" refers to personal information and other data provided by users through the system.

[0585] A "data processing device" is a device that analyzes input information and converts or transcribes the data according to its purpose.

[0586] "Record documents" refer to documents or forms generated by data processing equipment.

[0587] A "device for acquiring and analyzing emotions" is a device that collects data on a user's psychological state from their facial expressions, tone of voice, etc., and then analyzes that data.

[0588] An "interactive support device" is a device that provides guidance and support based on the user's emotional state, through screen displays, audio guides, and other means.

[0589] This invention is a system that recognizes user emotions and efficiently creates and manages record documents. This system mainly consists of a server, terminals, and users, each operating according to its respective role.

[0590] The server plays a central role in data processing, receiving information input from users and performing analysis using data processing devices. It can accurately transcribe and generate necessary information for multiple record documents. This analysis employs data processing techniques using specific algorithms.

[0591] The terminal serves as an interface with the user. Users can access the system and input information using the terminal. The terminal is equipped with a camera and microphone, and it is possible to capture emotions through these input devices. The emotion-capturing device analyzes the user's facial expressions and tone of voice in real time to identify their emotional state.

[0592] Users select various record documents and input the necessary information through the provided interface. During this process, an interactive support system operates, providing guidance tailored to the user's emotional state. For example, if the user shows anxiety, a guide may be displayed on the screen or audio guidance may be provided.

[0593] As a concrete example, consider a user who is going through the application process related to a wedding. The user selects the marriage registration form through the terminal and enters the necessary personal information. If the emotion-gathering device detects the user's anxiety, the terminal displays an illustrated procedural guide to support the process.

[0594] An example of a prompt would be, "Explain how sentiment analysis technology can be integrated to make the application process more user-friendly." The AI ​​model generated based on this prompt will help design more efficient and user-friendly systems, and contribute to improving services based on emotions.

[0595] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0596] Step 1:

[0597] The user accesses the system and logs in using a terminal. The terminal receives authentication information (user ID and password) entered by the user and sends it to the server. The server compares the received information with the database and performs authentication. If authentication is successful, a login completion notification is displayed on the terminal.

[0598] Step 2:

[0599] The terminal retrieves the latest list of application documents from the server and displays it in the user interface. The user selects the required documents on the terminal. This selection information is sent from the terminal to the server, which then prepares for the next processing step. As output, the terminal displays the interface of the selected documents.

[0600] Step 3:

[0601] The device activates an emotion acquisition device and collects the user's facial expressions and voice data in real time. This data is analyzed using an emotion analysis algorithm, and the results are output to the device. The user's emotional state (e.g., tension, anxiety, joy) is identified, and an interaction based on this is applied.

[0602] Step 4:

[0603] The user enters personal information according to the terminal's instructions. The terminal temporarily stores the entered information and verifies the data's integrity and format. If errors exist, the terminal displays a message prompting the user to correct them. The entered data is then sent to the server in its correct format.

[0604] Step 5:

[0605] The server analyzes the received personal information using a data processing device and performs necessary data transformations and verifications. Specifically, format conversion and duplicate data removal are carried out. After analysis, multiple record documents are automatically generated and sent to the terminal.

[0606] Step 6:

[0607] The terminal displays a preview of the new record document received from the server on the user interface. The user can review the displayed document and make changes if necessary. The changes are submitted to the server as an update via the terminal.

[0608] Step 7:

[0609] The user electronically signs the document through their device, completing the final approval process. The device then sends the signed document to a server, which distributes it to the appropriate authorities.

[0610] Step 8:

[0611] The emotion acquisition device continuously monitors the user's emotions throughout the entire process. If the emotion analysis algorithm determines that the user is experiencing stress, the device will promptly provide additional guidance or take support actions based on prompts.

[0612] (Application Example 2)

[0613] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0614] The present invention aims to provide a system that reduces the stress and anxiety users feel when performing cumbersome paperwork, and enables them to efficiently carry out the entire process. Furthermore, it intends to solve the problem of improving the user experience by recognizing emotions and providing interactive support tailored to the user.

[0615] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0616] In this invention, the server includes means for receiving information entered by the user, data analysis means for analyzing the entered information and transcribing it into multiple different application forms, means for generating and outputting the transcribed information into each of the multiple application forms, and emotion analysis means for recognizing emotions and providing guidance according to the user's state. This makes it possible for the user to complete the procedure quickly without feeling emotional burden.

[0617] "User" refers to an individual or group that uses the system or service.

[0618] "Inputted information" refers to data and facts provided to the system by the user.

[0619] "Data analysis means" refers to a technology or method for analyzing input information and processing it based on a specific purpose or format.

[0620] "Application documents" refer to official documents or papers required to complete a specific procedure.

[0621] "Transcribing" is the act of moving information from one format or document to another format or document and re-recording it.

[0622] "Output means" refers to a method or device for displaying or providing analyzed data or generated information in a form that is understandable to the user.

[0623] "Emotional analysis means" refers to a technology or method that analyzes facial expressions, voice, etc., in order to identify the emotional state of a user.

[0624] "Providing guidance" means showing users information and instructions, and prompting them to take procedures or actions.

[0625] This invention implements a system in which a consumer robot supports users with paperwork procedures. The user uses the robot as an interface with a terminal and performs real-time emotion analysis.

[0626] The server receives information entered by the user. The received information is analyzed by data analysis tools and transcribed into multiple different application forms. The robot is operated as a terminal and analyzes the user's facial expressions and voice tone using emotion analysis tools. This analysis uses a camera and microphone as hardware, and software such as OpenCV or TensorFlow for emotion analysis. Based on the analysis results, appropriate guidance is provided to the user.

[0627] Furthermore, if the user shows signs of stress or anxiety, the robot will provide voice guidance to lead them through each step of the procedure. This is done by playing voice guidance through a speaker and displaying the procedure's progress and input fields on a screen.

[0628] As a concrete example, consider a scenario where a user wants to obtain a resident registration certificate. The robot would guide the user by saying, "Next, please enter your name correctly. If you think you might make a mistake, please relax and check again." Furthermore, if the user is feeling anxious, calming music would be played to help them relax.

[0629] An example of a prompt using a generative AI model is: "I need help filling out this form, but I'm a little unsure. Could you please explain the procedure?"

[0630] In this way, users can complete paperwork efficiently while reducing their emotional burden through the robot's emotion recognition and guidance functions.

[0631] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0632] Step 1:

[0633] The user accesses the system through their device and logs in. The information entered is the user's ID and password, and the device uses this authentication information to recognize the user. If authentication is successful, the user's profile data is retrieved from the server.

[0634] Step 2:

[0635] The terminal displays a list of available application documents to the user based on data retrieved from the server. The input here is the user's profile information, and the output is a list of the corresponding application documents. The user then selects the necessary application documents.

[0636] Step 3:

[0637] When the user selects an application form, the terminal provides an input interface. At this stage, the emotion analysis system is activated, analyzing the user's facial expressions with the camera and their voice tone with the microphone in real time. The input consists of the user's facial expression data and voice data, and the output is an indicator of the user's emotional state.

[0638] Step 4:

[0639] The server receives the entered personal information. The information entered is personal information entered by the user through the interface. The server analyzes this information and converts it into a data format for transfer to multiple application forms using data analysis tools.

[0640] Step 5:

[0641] Based on the emotion analysis results, the device provides interactive support when the user's emotional state indicates stress or anxiety. For example, it may display detailed explanations on the screen for each step of a procedure, or play audio guidance through the speaker. The output is presented in a way that is easy for the user to understand.

[0642] Step 6:

[0643] The server automatically generates the necessary application documents based on the analyzed information and sends them to the terminal. Input consists of the user's personal information and selected application documents, while output is the completed application documents. This allows the user to preview the document contents.

[0644] Step 7:

[0645] The user reviews the application form generated on the terminal and makes corrections as needed. Once verification is complete, the user formally approves it using an electronic signature. The input is the revised application information and electronic signature, and the output is the signed, formal application form.

[0646] Step 8:

[0647] The server collects the signed documents and sends them appropriately to the relevant authorities. The output serves as proof that the formal procedures have been completed. This completes the user's process, which is carried out quickly and with reduced emotional burden.

[0648] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0649] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0650] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0651] [Fourth Embodiment]

[0652] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0653] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0654] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0655] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0656] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0657] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0658] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0659] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0660] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0661] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0662] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0663] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0664] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0665] This invention provides a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. This system consists of a terminal, a server, and user operations.

[0666] The user first logs into the system using a terminal. After successful login, the terminal displays a list of available application forms. The user can then select the documents that best suit their needs.

[0667] Based on the selected documents, the terminal provides an interface for the user to enter the necessary personal information. Once the user enters the required information, the terminal sends that data to the server.

[0668] The server is equipped with data analysis capabilities to analyze the received data. This allows the server to identify the necessary information for each application document and distribute the data to streamline the process. This analysis reduces the need for redundant data entry.

[0669] After analysis and sorting are complete, the server generates information in a format suitable for multiple application documents and outputs it to the terminal. The user can review the generated application documents on the terminal and make corrections as needed. The corrected data is sent back to the server for a final verification process.

[0670] Next, the user affixes an electronic signature to the application documents via the terminal. This electronic signature officially authenticates the documents. Finally, the server submits the signed documents to the relevant government office's system. The user uses the terminal to schedule an appointment with the government office, ensuring the entire process proceeds smoothly.

[0671] This system allows users to avoid the hassle of repeatedly entering the same information during the application process, enabling them to complete the process quickly and accurately.

[0672] The following describes the processing flow.

[0673] Step 1:

[0674] The user logs into the system using a terminal. The terminal displays a login screen to the user and prompts them to enter their ID and password. Once the user enters the information, the terminal sends that information to the server to attempt authentication.

[0675] Step 2:

[0676] The server compares the received authentication information with the registered information in the database. If authentication is successful, the server retrieves the user's account information and sends an authentication success message to the terminal.

[0677] Step 3:

[0678] The terminal displays a list of available application forms to the user. The user selects the necessary documents from the list according to their purpose.

[0679] Step 4:

[0680] When the user selects an application document, the terminal sends that information to the server. The server generates a list of required information fields for the selected document.

[0681] Step 5:

[0682] The terminal displays an interface for the user to enter the necessary personal information for the selected document. The user enters the required information into the terminal.

[0683] Step 6:

[0684] The terminal sends the entered user data to the server. The server receives the data using data analysis tools and distributes the necessary information to the appropriate fields in each application form.

[0685] Step 7:

[0686] Based on the analysis results, the server generates application forms containing the necessary information for various application documents, sends them to the terminal, and displays a preview.

[0687] Step 8:

[0688] The user reviews the application form preview on their device and makes corrections if necessary. The corrected information is then resent from the device to the server.

[0689] Step 9:

[0690] The user applies an electronic signature to the application document using their device. The device then sends the signed data to the server.

[0691] Step 10:

[0692] The server submits the final application documents to the relevant government office's system. The user then uses their terminal to schedule an appointment to visit the office and complete the process.

[0693] (Example 1)

[0694] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0695] Traditional application procedures required users to repeatedly enter the same information into multiple documents, which was not only time-consuming but also prone to input errors. Furthermore, the process of formally authenticating the submitted documents was complex, reducing the overall efficiency of the process.

[0696] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0697] In this invention, the server includes means for receiving information entered by a user, data analysis means for analyzing the entered information and checking for duplicates or omissions, means for sorting the data for transcription into multiple different types of documents, and means for automatically generating and outputting multiple documents based on the sorted information. This significantly reduces the time and effort required for the user's procedures, enabling the application process to be completed quickly and accurately.

[0698] "User" refers to a person who operates the system, inputs information, and submits an application.

[0699] "Means of receiving information" refers to the mechanism by which a system receives and stores input from users.

[0700] "Data analysis means" refers to techniques that analyze the content of received information and detect duplication or omissions in that information.

[0701] "Methods for distributing data" refers to methods of distributing data in formats suitable for different documents based on analysis results.

[0702] "Methods for automatically generating documents" refers to the process by which a system automatically creates documents based on sorted information.

[0703] An "electronic signature" is a means of authenticating digital information and refers to a technology used to guarantee the authenticity of documents.

[0704] "Means of providing an interface" refers to the technology that provides the user interface for inputting information or checking and modifying documents.

[0705] This invention is a system for efficiently handling application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and user operations.

[0706] The user first logs into the system using a terminal. A standard personal computer or tablet device is suitable as the terminal. Upon successful login, the terminal displays a list of available application forms to the user. These include wedding invitations and funeral arrangements.

[0707] When a user selects a document, the terminal provides an interface for entering the necessary personal information. This interface is designed to allow users to easily enter information and enables intuitive operation through the user interface.

[0708] Once information is entered, the terminal sends it to the server. The server uses high-performance data analysis software to analyze the information received from the user. This process eliminates duplicate information and identifies any missing information. The server then sorts the data based on the analysis results. This sorting process automatically organizes the information into multiple different types of application forms.

[0709] Next, the server automatically generates the necessary documents and sends their contents to the terminal. The user reviews the generated documents via the terminal and makes corrections as needed. This corrected information is sent back to the server, which then digitally signs the documents. The digital signature officially authenticates the document's legitimacy.

[0710] Ultimately, the server submits the signed documents online to the relevant department's information system. Users can also use the terminal to schedule visits to the relevant departments. Furthermore, it is possible to automatically input data and generate prompts using a generated AI model based on user actions.

[0711] As a concrete example of a prompt message, you could enter something like, "Please tell me how to create a wedding invitation using the system for streamlining wedding and funeral procedures."

[0712] This system allows users to complete the application process easily and quickly, ensuring the entire process runs smoothly.

[0713] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0714] Step 1:

[0715] The user logs into the system using a terminal. Authentication is performed by entering a username and password into the login interface, and if authentication is successful, the system proceeds to the next step. Login information (input) is received, and the authentication result (output) is obtained.

[0716] Step 2:

[0717] Upon successful login, the terminal displays a list of available application forms to the user. The user then selects the document that best suits their purpose. Based on the selected document (input), the corresponding document's information (output) is displayed.

[0718] Step 3:

[0719] When a user selects a document, the terminal provides an interface for entering the personal information required for that document. Here, the user enters necessary information such as their name and address. Based on the entered personal information (input), a dataset (output) is generated.

[0720] Step 4:

[0721] The terminal sends the personal information entered by the user to the server. The server uses data analysis tools to analyze the received data. Duplicate or missing data is detected, and necessary corrections are listed. Analysis results (output) are obtained from the personal information data (input).

[0722] Step 5:

[0723] The server sorts the data for each document based on the analysis results. This ensures that the necessary information is transferred to each application form. Data sets (output) are created for each document sorted from the analysis results (input).

[0724] Step 6:

[0725] The server uses a generation AI model to automatically generate documents based on the sorted information. The generated documents (output) are quickly sent to the terminal. The completed application documents (output) are obtained from the sorted data (input).

[0726] Step 7:

[0727] The terminal displays the generated application document to the user, who can review the content and make corrections as needed. The corrected document (output) is then sent back to the server. Based on the user's feedback (input), the corrected data (output) is generated.

[0728] Step 8:

[0729] The server affixes an electronic signature to the final application document reflecting the revisions. The document is officially authenticated by the electronic signature (output). An electronically authenticated document (output) is obtained from the revised document (input).

[0730] Step 9:

[0731] The server submits the signed documents to the relevant institution's system. After confirmation of submission completion (output), the user makes a reservation to visit the relevant institution via the terminal. The process goes from preparation for submission (input) to the generation of a completion notification (output).

[0732] This system allows users to complete a series of procedures efficiently.

[0733] (Application Example 1)

[0734] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0735] In store procedures and reservations, it is necessary to prevent duplication of information entered by users and streamline the process. However, traditional systems involve a lot of manual work, which is time-consuming and labor-intensive, so there is a need to improve operational efficiency.

[0736] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0737] In this invention, the server includes means for receiving data entered by a user, means for analyzing the entered data and transcribing it into multiple different documents, means for generating and outputting the data transcribed into the multiple documents, and means for managing the registration and reservation of in-store procedures. This makes it possible to streamline information registration and reservation procedures at stores and to reuse the entered information.

[0738] "User" refers to an individual or group that operates the system and enters data.

[0739] "Data" refers to information entered by users, and includes various forms of information that are subject to analysis and transcription.

[0740] "Information analysis means" refers to technical methods and devices for processing input data and transcribing it into necessary documents.

[0741] "Document" refers to digital or physical documents generated by information analysis tools and used for user procedures and reservations.

[0742] "Management means" refers to the software and processes within a system that enable efficient procedures.

[0743] A "store" refers to a place where goods or services are actually provided, and there is a need to streamline the procedures.

[0744] This invention is implemented as a system for efficiently handling procedures and reservations within a store. The hardware used includes smartphones and tablets as user terminals and servers for data processing. For software, Python is used for data analysis, and DocuSign or Adobe Sign are used as document management systems for information transfer and document management.

[0745] Users log in to the system using a terminal and select procedures or reservations. Based on the selected procedure, they can input the necessary data. The terminal sends the entered data to the server. The server receives the data and uses information analysis tools to sort it into the necessary documents. This enables efficient data transfer to multiple documents.

[0746] As a concrete example, this system can be used for member registration at a cafe, allowing new members to smoothly complete the registration process using their smartphones. The prompt used to input into the generating AI model would be something like this: "Please give me your ideas for a system to streamline member registration at a cafe. I'm looking for a way to simplify the traditional application process and minimize the amount of input required from the user."

[0747] In this way, we can streamline in-store procedures and reservations, providing a less burdensome environment for users.

[0748] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0749] Step 1:

[0750] The terminal provides the functionality to log in to the system. It receives a username and password as input and sends the login information to the server. The server compares the input information with the authentication database, determines whether the login was successful, and returns the result to the user.

[0751] Step 2:

[0752] The user selects a procedure or reservation on the application. The terminal displays a list of information items related to the selected procedure. Upon receiving user input, the terminal sends that information to the server. Here, the user's selection is input, and the necessary data items are output.

[0753] Step 3:

[0754] The server analyzes the received data and transcribes the necessary information into the appropriate document format using analytical tools. Based on the received data, it maps the data to a document template and fills in the variables to generate the document. In this process, the input data is converted into data in the document format, and each document layout is arranged before output.

[0755] Step 4:

[0756] For the generated document, the server sends the document data to the user's terminal for review. The user reviews the document on the terminal and makes corrections as needed. The corrected data is sent back to the server, and the document is updated without any discrepancies and a final check is performed.

[0757] Step 5:

[0758] The user performs an electronic signature via a terminal. The server manages the signing process and adds the electronic signature to the document. At this time, the input from the signing device is output as signature data.

[0759] Step 6:

[0760] The server submits the signed document to the relevant institution's system. The server securely transmits the document through the document management system and confirms the response from the institution's system. In this step, the signed document is the input, and the institution's receipt is the output.

[0761] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0762] This invention is a system that combines an emotion engine to recognize user emotions and aims to efficiently support application procedures related to weddings, funerals, and other ceremonial occasions. The system consists of a terminal, a server, and a user, and provides users with an excellent experience.

[0763] The user accesses the system and logs in using a terminal. After logging in, the terminal displays a list of available application forms, and the user selects the documents they need. At this time, the emotion engine is activated and analyzes the user's facial expressions and tone of voice in real time to understand their emotions.

[0764] The terminal provides an input interface based on the selected application form, and the user enters their personal information. The emotion engine monitors whether the user is experiencing stress during the input process and provides interactive support as needed. For example, if the user shows signs of anxiety, it will display explanations of the procedure on the screen or play an audio guide to help the user.

[0765] The input information is sent from the terminal to the server, which analyzes the information using data analysis tools and automatically transfers the data to each application form. The server generates the necessary application forms and sends them to the terminal to provide the user with a preview.

[0766] The user reviews the application form generated on their device and makes any necessary corrections. After further review, they formally approve it using an electronic signature. The signed documents are collected by the server and appropriately transmitted to the relevant authorities.

[0767] Throughout this entire process, the emotion engine continuously provides proactive, emotion-based support to ensure user satisfaction and a smooth procedure. This system allows users to complete the application process quickly and efficiently while reducing emotional burden.

[0768] The following describes the processing flow.

[0769] Step 1:

[0770] The user logs into the device. The device displays a login screen, and the user enters their ID and password. This information is sent from the device to the server for authentication.

[0771] Step 2:

[0772] The server checks the user's authentication information in the database, and if authentication is successful, sends a login success notification to the terminal. The terminal then displays a list of available application forms to the user.

[0773] Step 3:

[0774] The user selects the necessary application documents. The terminal sends the selections to the server. At this point, the emotion engine activates and begins monitoring the user's emotional state.

[0775] Step 4:

[0776] The terminal displays an interface for the user to enter the necessary information into the selected document. Once the user begins inputting, the emotion engine analyzes emotional data from facial expressions and tone of voice.

[0777] Step 5:

[0778] The emotion engine immediately notifies the device if it detects user stress or anxiety. The device then supports the user by displaying a support message on the screen or playing an audio guide.

[0779] Step 6:

[0780] Once the user has finished entering their information, the terminal sends the information to the server. The server analyzes the information using data analysis tools and automatically transfers the necessary data to each application form.

[0781] Step 7:

[0782] The server generates application documents using the analyzed data and sends them to the terminal. The terminal then displays a preview of the generated documents to the user and asks for confirmation.

[0783] Step 8:

[0784] The user previews the document on their device and instructs the system to correct any errors. The correction information is then sent to the server via the device.

[0785] Step 9:

[0786] The user electronically signs the application documents via their device. The device then sends the signed documents to the server.

[0787] Step 10:

[0788] The server submits the signed documents to the relevant government system. The emotion engine continues to support the user's emotions until the entire process is completed smoothly.

[0789] (Example 2)

[0790] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0791] Traditional application systems often fail to alleviate the psychological burden on users, potentially compromising the overall efficiency of the process. In particular, complex procedures performed under stressful conditions can lead to input errors and misunderstandings, ultimately resulting in delays. This problem needs to be addressed.

[0792] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0793] In this invention, the server includes a device for receiving information entered by a user, a data processing device for analyzing the entered information and transcribing it into multiple different record documents, a device for generating and outputting the transcribed information into the multiple documents, a device for acquiring and analyzing emotions, and a device for providing interactive support based on the user's emotions. This makes it possible to provide flexible support according to the user's emotional state and to complete procedures quickly and efficiently.

[0794] A "user" is a person who uses the system to input information and perform procedures.

[0795] "Information entered" refers to personal information and other data provided by users through the system.

[0796] A "data processing device" is a device that analyzes input information and converts or transcribes the data according to its purpose.

[0797] "Record documents" refer to documents or forms generated by data processing equipment.

[0798] A "device for acquiring and analyzing emotions" is a device that collects data on a user's psychological state from their facial expressions, tone of voice, etc., and then analyzes that data.

[0799] An "interactive support device" is a device that provides guidance and support based on the user's emotional state, through screen displays, audio guides, and other means.

[0800] This invention is a system that recognizes user emotions and efficiently creates and manages record documents. This system mainly consists of a server, terminals, and users, each operating according to its respective role.

[0801] The server plays a central role in data processing, receiving information input from users and performing analysis using data processing devices. It can accurately transcribe and generate necessary information for multiple record documents. This analysis employs data processing techniques using specific algorithms.

[0802] The terminal serves as an interface with the user. Users can access the system and input information using the terminal. The terminal is equipped with a camera and microphone, and it is possible to capture emotions through these input devices. The emotion-capturing device analyzes the user's facial expressions and tone of voice in real time to identify their emotional state.

[0803] Users select various record documents and input the necessary information through the provided interface. During this process, an interactive support system operates, providing guidance tailored to the user's emotional state. For example, if the user shows anxiety, a guide may be displayed on the screen or audio guidance may be provided.

[0804] As a concrete example, consider a user who is going through the application process related to a wedding. The user selects the marriage registration form through the terminal and enters the necessary personal information. If the emotion-gathering device detects the user's anxiety, the terminal displays an illustrated procedural guide to support the process.

[0805] An example of a prompt would be, "Explain how sentiment analysis technology can be integrated to make the application process more user-friendly." The AI ​​model generated based on this prompt will help design more efficient and user-friendly systems, and contribute to improving services based on emotions.

[0806] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0807] Step 1:

[0808] The user accesses the system and logs in using a terminal. The terminal receives authentication information (user ID and password) entered by the user and sends it to the server. The server compares the received information with the database and performs authentication. If authentication is successful, a login completion notification is displayed on the terminal.

[0809] Step 2:

[0810] The terminal retrieves the latest list of application documents from the server and displays it in the user interface. The user selects the required documents on the terminal. This selection information is sent from the terminal to the server, which then prepares for the next processing step. As output, the terminal displays the interface of the selected documents.

[0811] Step 3:

[0812] The device activates an emotion acquisition device and collects the user's facial expressions and voice data in real time. This data is analyzed using an emotion analysis algorithm, and the results are output to the device. The user's emotional state (e.g., tension, anxiety, joy) is identified, and an interaction based on this is applied.

[0813] Step 4:

[0814] The user enters personal information according to the terminal's instructions. The terminal temporarily stores the entered information and verifies the data's integrity and format. If errors exist, the terminal displays a message prompting the user to correct them. The entered data is then sent to the server in its correct format.

[0815] Step 5:

[0816] The server analyzes the received personal information using a data processing device and performs necessary data transformations and verifications. Specifically, format conversion and duplicate data removal are carried out. After analysis, multiple record documents are automatically generated and sent to the terminal.

[0817] Step 6:

[0818] The terminal displays a preview of the new record document received from the server on the user interface. The user can review the displayed document and make changes if necessary. The changes are submitted to the server as an update via the terminal.

[0819] Step 7:

[0820] The user electronically signs the document through their device, completing the final approval process. The device then sends the signed document to a server, which distributes it to the appropriate authorities.

[0821] Step 8:

[0822] The emotion acquisition device continuously monitors the user's emotions throughout the entire process. If the emotion analysis algorithm determines that the user is experiencing stress, the device will promptly provide additional guidance or take support actions based on prompts.

[0823] (Application Example 2)

[0824] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0825] The present invention aims to provide a system that reduces the stress and anxiety users feel when performing cumbersome paperwork, and enables them to efficiently carry out the entire process. Furthermore, it intends to solve the problem of improving the user experience by recognizing emotions and providing interactive support tailored to the user.

[0826] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0827] In this invention, the server includes means for receiving information entered by the user, data analysis means for analyzing the entered information and transcribing it into multiple different application forms, means for generating and outputting the transcribed information into each of the multiple application forms, and emotion analysis means for recognizing emotions and providing guidance according to the user's state. This makes it possible for the user to complete the procedure quickly without feeling emotional burden.

[0828] "User" refers to an individual or group that uses the system or service.

[0829] "Inputted information" refers to data and facts provided to the system by the user.

[0830] "Data analysis means" refers to a technology or method for analyzing input information and processing it based on a specific purpose or format.

[0831] "Application documents" refer to official documents or papers required to complete a specific procedure.

[0832] "Transcribing" is the act of moving information from one format or document to another format or document and re-recording it.

[0833] "Output means" refers to a method or device for displaying or providing analyzed data or generated information in a form that is understandable to the user.

[0834] "Emotional analysis means" refers to a technology or method that analyzes facial expressions, voice, etc., in order to identify the emotional state of a user.

[0835] "Providing guidance" means showing users information and instructions, and prompting them to take procedures or actions.

[0836] This invention implements a system in which a consumer robot supports users with paperwork procedures. The user uses the robot as an interface with a terminal and performs real-time emotion analysis.

[0837] The server receives information entered by the user. The received information is analyzed by data analysis tools and transcribed into multiple different application forms. The robot is operated as a terminal and analyzes the user's facial expressions and voice tone using emotion analysis tools. This analysis uses a camera and microphone as hardware, and software such as OpenCV or TensorFlow for emotion analysis. Based on the analysis results, appropriate guidance is provided to the user.

[0838] Furthermore, if the user shows signs of stress or anxiety, the robot will provide voice guidance to lead them through each step of the procedure. This is done by playing voice guidance through a speaker and displaying the procedure's progress and input fields on a screen.

[0839] As a concrete example, consider a scenario where a user wants to obtain a resident registration certificate. The robot would guide the user by saying, "Next, please enter your name correctly. If you think you might make a mistake, please relax and check again." Furthermore, if the user is feeling anxious, calming music would be played to help them relax.

[0840] An example of a prompt using a generative AI model is: "I need help filling out this form, but I'm a little unsure. Could you please explain the procedure?"

[0841] In this way, users can complete paperwork efficiently while reducing their emotional burden through the robot's emotion recognition and guidance functions.

[0842] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0843] Step 1:

[0844] The user accesses the system through their device and logs in. The information entered is the user's ID and password, and the device uses this authentication information to recognize the user. If authentication is successful, the user's profile data is retrieved from the server.

[0845] Step 2:

[0846] The terminal displays a list of available application documents to the user based on data retrieved from the server. The input here is the user's profile information, and the output is a list of the corresponding application documents. The user then selects the necessary application documents.

[0847] Step 3:

[0848] When the user selects an application form, the terminal provides an input interface. At this stage, the emotion analysis system is activated, analyzing the user's facial expressions with the camera and their voice tone with the microphone in real time. The input consists of the user's facial expression data and voice data, and the output is an indicator of the user's emotional state.

[0849] Step 4:

[0850] The server receives the entered personal information. The information entered is personal information entered by the user through the interface. The server analyzes this information and converts it into a data format for transfer to multiple application forms using data analysis tools.

[0851] Step 5:

[0852] Based on the emotion analysis results, the device provides interactive support when the user's emotional state indicates stress or anxiety. For example, it may display detailed explanations on the screen for each step of a procedure, or play audio guidance through the speaker. The output is presented in a way that is easy for the user to understand.

[0853] Step 6:

[0854] The server automatically generates the necessary application documents based on the analyzed information and sends them to the terminal. Input consists of the user's personal information and selected application documents, while output is the completed application documents. This allows the user to preview the document contents.

[0855] Step 7:

[0856] The user reviews the application form generated on the terminal and makes corrections as needed. Once verification is complete, the user formally approves it using an electronic signature. The input is the revised application information and electronic signature, and the output is the signed, formal application form.

[0857] Step 8:

[0858] The server collects the signed documents and sends them appropriately to the relevant authorities. The output serves as proof that the formal procedures have been completed. This completes the user's process, which is carried out quickly and with reduced emotional burden.

[0859] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0860] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0861] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0862] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0863] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0864] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0865] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0866] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0867] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0868] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0869] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0870] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0871] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0872] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0873] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0874] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0875] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0876] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0877] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0878] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0879] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0880] The following is further disclosed regarding the embodiments described above.

[0881] (Claim 1)

[0882] A means of receiving information entered by the user,

[0883] A data analysis means for analyzing the input information and transferring it to multiple different application documents,

[0884] A means of generating and outputting information that has been transcribed into multiple application documents,

[0885] A system that includes this.

[0886] (Claim 2)

[0887] The system according to claim 1, further comprising means for affixing electronic signatures to the aforementioned plurality of application documents.

[0888] (Claim 3)

[0889] The system according to claim 1, further comprising means for selecting the aforementioned application documents and presenting the necessary information items.

[0890] "Example 1"

[0891] (Claim 1)

[0892] A means of receiving information entered by the user,

[0893] A data analysis means that analyzes the input information and checks for duplicate or missing information,

[0894] A means of distributing data for transfer to multiple different types of documents,

[0895] A means of automatically generating and outputting multiple documents based on the sorted information,

[0896] A system that includes this.

[0897] (Claim 2)

[0898] The system according to claim 1, further comprising means for affixing electronic signatures to and authenticating the aforementioned plurality of documents.

[0899] (Claim 3)

[0900] The system according to claim 1, further comprising means for selecting the aforementioned documents, presenting the necessary information items, and providing an interface for the user to input information.

[0901] "Application Example 1"

[0902] (Claim 1)

[0903] A means of receiving data entered by the user,

[0904] Information analysis means for analyzing the input data and transcribing it into multiple different documents,

[0905] A means for generating and outputting data that has been transcribed into multiple documents,

[0906] A management system to streamline in-store procedures such as registration and reservations,

[0907] A system that includes this.

[0908] (Claim 2)

[0909] The system according to claim 1, further comprising means for affixing electronic signatures to the plurality of documents.

[0910] (Claim 3)

[0911] The system according to claim 1, further comprising means for selecting the aforementioned document and presenting the necessary information items.

[0912] "Example 2 of combining an emotion engine"

[0913] (Claim 1)

[0914] A device that receives information entered by the user,

[0915] A data processing device for analyzing the input information and transcribing it into multiple different record documents,

[0916] A device that generates and outputs information transcribed into multiple documents,

[0917] A device that acquires and analyzes emotions,

[0918] A device that provides interactive support based on the user's emotions,

[0919] A system that includes this.

[0920] (Claim 2)

[0921] The system according to claim 1, further comprising a device for affixing electronic signatures to the aforementioned plurality of documents.

[0922] (Claim 3)

[0923] A device for selecting the aforementioned record documents and presenting the necessary information items,

[0924] The system according to claim 1, further comprising a device for analyzing the user's emotions in real time.

[0925] "Application example 2 when combining with an emotional engine"

[0926] (Claim 1)

[0927] A means of receiving information entered by the user,

[0928] A data analysis means for analyzing the input information and transferring it to multiple different application documents,

[0929] A means of generating and outputting information that has been transcribed into multiple application documents,

[0930] An emotion analysis tool that recognizes emotions and provides guidance according to the user's state,

[0931] A system that includes this.

[0932] (Claim 2)

[0933] The system according to claim 1, further comprising means for affixing electronic signatures to the aforementioned plurality of application documents.

[0934] (Claim 3)

[0935] The system according to claim 1, further comprising means for selecting the aforementioned application documents and presenting the necessary information items. [Explanation of Symbols]

[0936] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving data entered by the user, Information analysis means for analyzing the input data and transcribing it into multiple different documents, A means for generating and outputting data that has been transcribed into multiple documents, A management system to streamline in-store procedures such as registration and reservations, A system that includes this.

2. The system according to claim 1, further comprising means for affixing electronic signatures to the plurality of documents.

3. The system according to claim 1, further comprising means for selecting the document and presenting the necessary information items.

Images