system

Abstract

Provide a system. [Solution] a means for establishing secure communications; A means of automating routine processes, A means of interconnecting multiple cloud environments; How to back up your data; means of working with financial and postal institutions; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In recent years, a wide range of operations, including public services, financial institutions, and postal services, have been moving online, but this has also increased the risk of security threats and data loss. While there is a demand for greater efficiency through the automation of routine tasks, insufficient integration of data sharing and backup functions across multiple cloud environments can lead to a decline in system reliability and availability. This invention aims to solve these problems. [Means for solving the problem]

[0005] To solve the above problems, the present invention employs the following configuration. First, by using a virtual private network (VPN) as a means of establishing secure communications, unauthorized access from outside can be prevented. Second, by introducing a means of automating routine processes, including a function for automating application processing for public services, business efficiency is improved. Furthermore, by implementing a means of interconnecting multiple cloud environments, seamless data sharing between different cloud providers is possible. Furthermore, by providing a means for performing regular data backups, the risk of data loss is reduced. Finally, by adding a means for linking with financial institutions and postal organizations, automatic management of online transactions and mailing procedures is realized. This provides a highly reliable, available, and efficient integrated system.

[0006] "Secure communication" refers to a communication method that encrypts data transmission and reception to prevent unauthorized access from outside and information leaks.

[0007] A "Virtual Private Network (VPN)" is a technology that uses public lines such as the Internet to make it appear as if you are connected via a dedicated line, and it achieves secure communication through data encryption and authentication.

[0008] "Routine processing" refers to business processing that is automatically executed according to a predetermined procedure.

[0009] "Public services" are services provided by public institutions such as the national government and local governments, and are operations that are closely related to citizens' lives.

[0010] "Application processing" refers to a series of procedures that accept various applications from users, confirm the necessary information, and then carry out subsequent processes such as approval and issuance.

[0011] "Cloud environment" is a general term for computing resources provided over the Internet, including storage, computing power, databases, etc.

[0012] "Interconnection" means seamlessly linking multiple different systems and networks, enabling data exchange and sharing.

[0013] A "backup" is a process of storing a copy of data in another location in case of data loss or corruption.

[0014] "Financial institutions" is a general term for organizations that provide financial services, such as banks, trust companies, and securities companies.

[0015] A "postal institution" is an organization that provides services such as mail delivery, postal savings, and postal money orders. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10]1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The system of the present invention provides functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions. The following describes specific embodiments of the system.

[0038] Building a secure network

[0039] VPN Connection

[0040] The server runs virtual private network (VPN) software and uses the credentials to connect to a VPN server, which protects the business network from unauthorized access.

[0041] Firewall settings

[0042] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0043] Configuring encryption protocols

[0044] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[0045] Automating routine processes

[0046] Processing applications for public services

[0047] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[0048] Automation of resident registration and family register-related matters

[0049] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[0050] Cloud Interconnection and Backup

[0051] Cloud-to-cloud interconnection

[0052] The server is configured to ensure interconnection between multiple cloud environments. To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs on one of the clouds.

[0053] Data Backup

[0054] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[0055] Cooperation with financial institutions and postal institutions

[0056] Transaction collaboration with banks

[0057] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[0058] Business collaboration with the post office

[0059] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[0060] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[0061] The processing flow will be explained below.

[0062] Building a secure network

[0063] Step 1:

[0064] The server runs the VPN software.

[0065] Step 2:

[0066] The server connects to the VPN server using the authentication information (username and password).

[0067] Step 3:

[0068] The server verifies that the VPN connection has been established and monitors the connection status.

[0069] Step 4:

[0070] The server opens the firewall configuration file.

[0071] Step 5:

[0072] The server adds allowed IP addresses and port numbers to a configuration file.

[0073] Step 6:

[0074] The server will save the firewall settings and restart.

[0075] Step 7:

[0076] The server obtains an SSL / TLS certificate.

[0077] Step 8:

[0078] The server adds settings to the web server configuration file to enable SSL / TLS.

[0079] Step 9:

[0080] The server will restart the web server to reflect the settings.

[0081] Automating routine processes

[0082] Step 1:

[0083] A user uses a terminal to access a utility service application form.

[0084] Step 2:

[0085] The user enters the necessary information into the application form.

[0086] Step 3:

[0087] The user clicks the application button.

[0088] Step 4:

[0089] The server receives the application data.

[0090] Step 5:

[0091] The server stores the application data in a database.

[0092] Step 6:

[0093] The server will notify the user by email that the process is complete.

[0094] Step 7:

[0095] The user applies for a resident certificate online.

[0096] Step 8:

[0097] The server accesses a resident database and retrieves the applicant's information.

[0098] Step 9:

[0099] The server automatically generates the necessary documents.

[0100] Step 10:

[0101] The server affixes an electronic signature to the automatically generated document.

[0102] Step 11:

[0103] The server then emails the document with the electronic signature to the user.

[0104] Cloud Interconnection and Backup

[0105] Step 1:

[0106] The server checks the connection settings for NTT Cloud and au Cloud.

[0107] Step 2:

[0108] The server monitors the connection between both clouds using a HeartBeat function.

[0109] Step 3:

[0110] The server periodically checks the connection status between the clouds.

[0111] Step 4:

[0112] The server sets up a regular data backup schedule.

[0113] Step 5:

[0114] When it's time for a backup, the server creates a snapshot of the database.

[0115] Step 6:

[0116] The server transfers the snapshot to the second cloud.

[0117] Cooperation with banks and post offices

[0118] Step 1:

[0119] The user uses the terminal to submit a request to pay the tax online.

[0120] Step 2:

[0121] The server receives the request and connects to the bank's API.

[0122] Step 3:

[0123] The server uses the user's authentication information to access the bank account and debit the required amount.

[0124] Step 4:

[0125] The server notifies the user of the transaction result.

[0126] Step 5:

[0127] The user submits a request for a mail transaction.

[0128] Step 6:

[0129] The server sends the transaction information to the post office system.

[0130] Step 7:

[0131] The server receives a confirmation reply from the post office.

[0132] Step 8:

[0133] The server will send a notification to the user that the transaction is complete.

[0134] Example 1

[0135] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0136] The current system faces many challenges, including security vulnerabilities, inefficient routine processing, complex data exchange between cloud environments, a lack of a secure data backup method, and complex collaboration with financial institutions and postal organizations. These challenges are particularly significant when it comes to operations involving sensitive information.

[0137] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0138] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, and a means for coordinating with financial institutions and postal institutions, thereby significantly improving the safety and efficiency of the system and enabling fast and safe processing, particularly when providing public services.

[0139] "Secure communication" means that data is protected from unauthorized access or interception from outside.

[0140] "Routine processing" refers to a series of operations that automatically execute repetitive business processes and procedures.

[0141] A "cloud environment" refers to a computer network infrastructure that allows data and applications to be stored and accessed on remote servers via the Internet.

[0142] A "backup" is the process of duplicating data and storing it in case the original data is lost.

[0143] "Financial institution" refers to an organization or establishment that provides financial services, such as a bank or credit union.

[0144] "Postal agency" means any public or private organization that collects and delivers mail.

[0145] A "virtual private network" is a virtual dedicated line for securely sending and receiving data over the Internet.

[0146] A "firewall" is a device or software that blocks unauthorized traffic to enhance network security.

[0147] An "encryption protocol" is a communication protocol that encrypts data so that only the sender and receiver can read it.

[0148] "Public services" refers to administrative services provided by the national government and local governments.

[0149] A "resident card" is a certificate of residence issued to residents by local governments.

[0150] An "electronic signature" is an electronic signature that the creator of digital data affixes to that data, and is used to prevent data tampering and to authenticate the data.

[0151] "Cloud interconnection" is a mechanism that enables seamless collaboration between data and services across different cloud providers.

[0152] A "database" is a system for efficiently storing, searching, and managing data.

[0153] A "snapshot" refers to the process of recording and saving the state of data or a system at a certain point in time.

[0154] "OAuth authentication" is an open standard protocol that allows users to authorize third-party applications to access their resources.

[0155] The system of the present invention provides the functionality to establish secure communications, automate routine processes, interconnect multiple cloud environments, back up data, and collaborate with financial institutions and postal institutions.

[0156] Establishing Secure Communications

[0157] VPN Connection

[0158] The server runs virtual private network (VPN) software and connects to the VPN server using the credentials. The specific software used is OpenVPN. This connection protects the business network from unauthorized access from outside.

[0159] Firewall settings

[0160] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, using the tool iptables, so that only allowed traffic can access the network.

[0161] Configuring encryption protocols

[0162] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. In this case, the specific software is Let's Encrypt and Nginx. This encrypts and protects communication between the user and the server.

[0163] Automating routine processes

[0164] Processing applications for public services

[0165] The user uses a terminal to access the application form for public services and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database. The specific software used is PHP and MySQL (registered trademark). Once processing is complete, the server sends a confirmation email to the user using the SMTP protocol. This ensures that application processing is fast and accurate.

[0166] Automation of resident registration and family register-related matters

[0167] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. The specific tools used are an Oracle database and electronic signature software. This allows users to quickly receive the necessary documents.

[0168] Cloud Interconnection and Backup

[0169] Cloud-to-cloud interconnection

[0170] The server is configured to ensure interconnection between multiple cloud environments (e.g., domestic cloud A and domestic cloud B). To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs in one of the clouds.

[0171] Data Backup

[0172] The server schedules regular data backups, creates snapshots of the database, and transfers them to the second cloud using AWS S3 and the MySQL snapshot feature, minimizing the risk of data loss.

[0173] Cooperation with financial institutions and postal institutions

[0174] Transaction collaboration with banks

[0175] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API and debits the account with the user's credentials. The specific tools used are REST API and the OAuth authentication system. Once the transaction is complete, the server notifies the user of the result.

[0176] Business collaboration with the post office

[0177] When a user requests a postal transaction, the server sends the information to the post office's system using a SOAP API. After receiving a confirmation from the post office, the server notifies the user that the transaction is complete.

[0178] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[0179] Example prompts for generative AI models

[0180] "Please explain in natural language the process of the city hall's resident registration system. Please provide details of the steps a user takes to apply online and the processes the system performs in the background."

[0181] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0182] Establishing Secure Communications

[0183] Step 1:

[0184] The server launches the VPN software (e.g., OpenVPN). It uses the VPN configuration file and authentication information as input. The VPN configuration file contains the server's IP address, port number, and encryption method. The output is a VPN connection established. Specifically, it sends the authentication information and receives a successful connection response from the VPN server.

[0185] Step 2:

[0186] The server edits the firewall configuration file. As input, it adds a rule that allows a specific IP address and port number. Specifically, it updates the configuration file using the iptables command. The output is the updated firewall configuration file. Specifically, after the settings are reflected, it runs a test command to confirm that the settings have been reflected correctly.

[0187] Step 3:

[0188] The server obtains an SSL / TLS certificate. As input, it connects to the Let's Encrypt API and sends a CSR (Certificate Signing Request). The output is the obtained SSL / TLS certificate. Specifically, it adds the obtained certificate to the configuration file of the web server (e.g., Nginx), restarts Nginx, and establishes encrypted communication.

[0189] Automating routine processes

[0190] Step 4:

[0191] A user accesses a public service application form using a terminal. As input, the user enters necessary information such as name, address, and application details. The output is the entered form data. Specifically, the user clicks the application button, and the data is sent to the server.

[0192] Step 5:

[0193] The server processes the received form data. As input, it receives the form data submitted by the user. As data processing, it validates the data using a PHP script and saves it to a MySQL database. The output is the data saved in the database. Specifically, if the save is successful, it generates an SMTP request to send a confirmation email to the user.

[0194] Step 6:

[0195] The server automates the application for issuing a resident certificate. As input, it receives request data for issuing a resident certificate from the user. As data calculation, it accesses the resident database and searches for the necessary information. The output is a resident certificate with an electronic signature. Specifically, it creates the generated resident certificate in PDF format, adds an electronic signature, and sends it to the user by email.

[0196] Cloud Interconnection and Backup

[0197] Step 7:

[0198] The server sets up interconnections between clouds. It uses connection information between two cloud providers (e.g., domestic cloud A and domestic cloud B) as input. Specific operations include using Heartbeat software to monitor the connection status. The output shows that the interconnection has been established. If an abnormality occurs, a log is generated that automatically switches the connection to another cloud.

[0199] Step 8:

[0200] The server performs data backup. As input, it uses a schedule setting to create a snapshot of the MySQL database. As data processing, it generates a snapshot and uploads it to AWS S3. The output is a notification that the backup is complete. Specifically, after the backup process is complete, it logs "The database snapshot has been uploaded to AWS S3."

[0201] Cooperation with financial institutions and postal institutions

[0202] Step 9:

[0203] The user submits a tax payment request online using a terminal. As input, the user enters tax payment details. The output is the request data sent to the server. The specific action is to click the pay button.

[0204] Step 10:

[0205] The server connects to the bank's API. As input, it uses the tax payment request data and user authentication information. As data calculation, it accesses the bank system via the REST API and performs OAuth authentication. The output is a notification of the payment result. Specifically, once the transaction is completed, it generates and sends an email notifying the user of the result.

[0206] Step 11:

[0207] A user requests a transaction by mail. As input, they enter details about the transaction. The output is the request data sent to the server. The specific action is to click the request button.

[0208] Step 12:

[0209] The server connects to the post office system. As input, it receives the user's request data. As data processing, it accesses the post office system using the SOAP API and sends the transaction information. The output is a notification of transaction completion. As a specific operation, after receiving a confirmation reply, it generates and sends an email notifying the user that the transaction has been completed.

[0210] (Application example 1)

[0211] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0212] In today's digital society, users of financial institutions and public services are required to manage their data in multiple cloud environments and to carry out transactions and service requests quickly and securely through secure networks. This requires mitigating security risks, automating data backups, and seamless integration with financial institutions and postal organizations. However, managing and operating these systems separately can be time-consuming and resource-intensive. It can also be difficult to ensure high levels of security to prevent security threats and unauthorized network access.

[0213] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0214] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, a means for processing applications for public services using terminals for secure transactions, and a means for enhancing security using VPN connections, firewall settings, and SSL / TLS encrypted communications. This allows users to conduct financial transactions and apply for public services on a network with multiple layers of security through a centralized system. Furthermore, data linkage and automatic backup between clouds improves data reliability and service continuity.

[0215] "Secure communication" refers to a safe network connection that is protected from unauthorized access using a virtual private network or SSL / TLS encrypted communication, etc.

[0216] "Routine processing" refers to the process of improving efficiency by automating routine procedures.

[0217] "Cloud environment" refers to a virtual server environment that includes data storage and computing resources provided via the Internet.

[0218] "Interconnection" refers to a connection method that enables seamless availability of data and services between different systems and cloud providers.

[0219] "Data backup" refers to a method of reducing the risk of data loss by regularly duplicating important data and storing it in a different location.

[0220] "Financial institution" means an organization that provides financial services, such as a bank or credit card company.

[0221] "Postal institution" means an organization or institution that provides postal services, including the collection, delivery, and sending of mail.

[0222] "Terminal" refers to a device used by a User, such as a computer, smartphone, or tablet.

[0223] "VPN connection" refers to technology that establishes a secure communication path using a virtual private network.

[0224] "Firewall Settings" means security settings that control or allow traffic to protect a network from unauthorized access.

[0225] "SSL / TLS encrypted communication" refers to a protocol that encrypts communication content to prevent data eavesdropping and tampering.

[0226] The system for implementing the present invention includes a terminal for conducting secure transactions, a server for establishing secure communications, and a program for providing interconnection and data backup functions between multiple cloud environments. The components of this system and their specific operations will be described below.

[0227] Hardware and Software Configuration

[0228] 1. Terminal

[0229] A terminal is a device used by a user, such as a computer, smartphone, or tablet, on which a secure trading application is installed.

[0230] 2. Server

[0231] The server establishes secure communications, automates routine processes, interconnects multiple cloud environments, and backs up data. It also manages collaboration with financial institutions and postal agencies.

[0232] The specific software used

[0233] VPN Services: Establish a secure VPN connection using off-the-shelf or open-source VPN software such as OpenVPN.

[0234] SSL / TLS libraries: Use libraries such as OpenSSL to set up encrypted data communications.

[0235] Web server: Provides web services using Apache (registered trademark) or Nginx.

[0236] REST API: Provides APIs used for processing public service applications and backing up data.

[0237] Processing Details

[0238] 1. Establishing secure communications

[0239] The server uses VPN software (e.g., OpenVPN) to set up a virtual private network and encrypt communications between the device and the server, preventing unauthorized access from outside.

[0240] The server also uses firewall settings to allow only specific IP addresses and port numbers, and obtains an SSL / TLS certificate to encrypt web server communications.

[0241] 2. Automating routine processes

[0242] When a user applies for a public service using a terminal, the data is sent to the server via a web server, which receives the data and processes it automatically.

[0243] For example, when a user applies for a resident registration certificate, the server extracts the necessary data from the resident database and automatically generates the necessary documents. The documents are then digitally signed and sent to the user's email address.

[0244] 3. Cloud interconnection and data backup

[0245] The server shares data between multiple cloud environments. This includes, for example, seamless data exchange between NTT Cloud and au Cloud. Connections between different providers are monitored by a heartbeat function, and in the event of a failure, the server immediately switches to a backup.

[0246] The server also periodically takes snapshots of the data on an automated schedule and transfers the data to a second cloud, minimizing the risk of data loss.

[0247] Specific examples

[0248] Let's take the example of a user applying for a resident registration card using a secure transaction app. The user launches the app installed on their smartphone, enters the required information, and clicks the "Apply" button. The server receives the data, automatically generates and approves the resident registration card, and sends an electronic copy to the user's email address. During this process, the data is securely transmitted via a VPN connection and SSL / TLS encryption. This data is also backed up in the cloud, ensuring data safety even in the event of a system failure.

[0249] Prompt Sentence Examples

[0250] "Create a story where a user applies for a residence certificate using the Secure Transaction app, receives a secure digital residence certificate to their email address, and their data is backed up."

[0251] With this configuration, the present invention has the effect of enhancing security while enabling efficient use of public services and minimizing the risk of data loss and system failure.

[0252] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0253] Step 1:

[0254] Terminal: The user launches the secure transaction app on their smartphone. The user inputs the information required to apply for public services (e.g., name, address, application details). The input information is sent from the terminal to the server.

[0255] Step 2:

[0256] Server: The server first establishes a VPN connection to process the received user data. The input is the application data sent from the terminal. A secure communication path is set up using VPN software (e.g., OpenVPN) to prevent unauthorized access from outside. The output is the data being sent through the secure network.

[0257] Step 3:

[0258] Server: The server applies firewall rules, allowing only specific IP addresses and port numbers. Input: Network traffic after VPN connection is established. Edit firewall settings to allow only allowed traffic to access the network. Output: Secure connection established.

[0259] Step 4:

[0260] Server: The server sets up SSL / TLS encrypted communication and encrypts data. The input is traffic from a securely connected network. An SSL / TLS certificate is obtained and settings to enable encrypted communication are added to the web server configuration file. The output is encrypted data communication.

[0261] Step 5:

[0262] Server: The server automates the application process for public services. The input is the user's application data. The server accesses the database and automatically processes the application information. For example, when an application is made for the issuance of a resident certificate, the server extracts data from the resident database and generates the necessary documents. The output is the generated document with an electronic signature.

[0263] Step 6:

[0264] Server: The server uses a mail server to send an email to the user to deliver the generated document. The input is the generated digitally signed document and the user's email address. The server uses this information to send a confirmation email. The output is a confirmation email sent to the user's inbox.

[0265] Step 7:

[0266] Server: The server performs regular data backups. The input is the latest user data and system status. According to a schedule, a snapshot of the database is created and transferred to the second cloud. The output is the backed-up data.

[0267] Step 8:

[0268] Server: Monitors interconnections between cloud environments and ensures seamless data integration. Input is heartbeat data from each cloud environment. If the server detects an abnormality, it immediately switches to the second cloud. Output ensures continuous data availability.

[0269] In this way, the system allows users to securely and efficiently access public services and conduct safe transactions over a network with multiple layers of security.

[0270] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0271] The system of the present invention combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, as well as an emotion engine that recognizes user emotions. A specific embodiment of the system will be described below.

[0272] Building a secure network

[0273] VPN Connection

[0274] The server launches the VPN software and connects to the VPN server using the authentication information, protecting the business network from unauthorized access from outside.

[0275] Firewall settings

[0276] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0277] Configuring encryption protocols

[0278] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[0279] Automating routine processes

[0280] Processing applications for public services

[0281] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[0282] Automation of resident registration and family register-related matters

[0283] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[0284] Cloud Interconnection and Backup

[0285] Cloud-to-cloud interconnection

[0286] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[0287] Data Backup

[0288] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[0289] Cooperation with financial institutions and postal institutions

[0290] Transaction collaboration with banks

[0291] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[0292] Business collaboration with the post office

[0293] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[0294] Introducing the Emotion Engine

[0295] emotion recognition

[0296] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as text, voice, and images.

[0297] Text analytics

[0298] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[0299] Audio analysis

[0300] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[0301] Image analysis

[0302] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[0303] Response Control

[0304] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[0305] As a result, the system of the present invention is expected to further improve the user experience by responding to the user's emotions as well as linking with public services and financial institutions. As a specific example, in a city hall online application system, when a user feels stressed, the system can provide interactions such as displaying guidance or encouraging messages.

[0306] The processing flow will be explained below.

[0307] Building a secure network

[0308] Step 1:

[0309] The server runs the VPN software.

[0310] Step 2:

[0311] The server connects to the VPN server using the authentication information (username and password).

[0312] Step 3:

[0313] The server verifies that the VPN connection has been established.

[0314] Step 4:

[0315] The server opens the firewall configuration file.

[0316] Step 5:

[0317] The server adds allowed IP addresses and port numbers to a configuration file.

[0318] Step 6:

[0319] The server will save the firewall settings and restart.

[0320] Step 7:

[0321] The server obtains an SSL / TLS certificate.

[0322] Step 8:

[0323] The server adds settings to the web server configuration file to enable SSL / TLS.

[0324] Step 9:

[0325] The server will restart the web server to reflect the settings.

[0326] Automating routine processes

[0327] Step 1:

[0328] A user uses a terminal to access a utility service application form.

[0329] Step 2:

[0330] The user enters the necessary information into the application form.

[0331] Step 3:

[0332] The user clicks the application button.

[0333] Step 4:

[0334] The server receives the application data.

[0335] Step 5:

[0336] The server stores the application data in a database.

[0337] Step 6:

[0338] The server will notify the user by email that the process is complete.

[0339] Step 7:

[0340] The user applies for a resident certificate online.

[0341] Step 8:

[0342] The server accesses a resident database and retrieves the applicant's information.

[0343] Step 9:

[0344] The server automatically generates the necessary documents.

[0345] Step 10:

[0346] The server affixes an electronic signature to the automatically generated document.

[0347] Step 11:

[0348] The server then emails the document with the electronic signature to the user.

[0349] Cloud Interconnection and Backup

[0350] Step 1:

[0351] The server checks the connection settings between NTT Cloud and other companies' clouds.

[0352] Step 2:

[0353] The server monitors the connection between both clouds using a HeartBeat function.

[0354] Step 3:

[0355] The server periodically checks the connection status between the clouds.

[0356] Step 4:

[0357] The server sets up a regular data backup schedule.

[0358] Step 5:

[0359] When it's time for a backup, the server creates a snapshot of the database.

[0360] Step 6:

[0361] The server transfers the snapshot to the second cloud.

[0362] Cooperation with financial institutions and postal institutions

[0363] Step 1:

[0364] The user uses the terminal to submit a request to pay the tax online.

[0365] Step 2:

[0366] The server receives the request and connects to the bank's API.

[0367] Step 3:

[0368] The server uses the user's authentication information to access the bank account and debit the required amount.

[0369] Step 4:

[0370] The server notifies the user of the transaction result.

[0371] Step 5:

[0372] The user submits a request for a mail transaction.

[0373] Step 6:

[0374] The server sends the transaction information to the post office system.

[0375] Step 7:

[0376] The server receives a confirmation reply from the post office.

[0377] Step 8:

[0378] The server will send a notification to the user that the transaction is complete.

[0379] Introducing the Emotion Engine

[0380] Step 1:

[0381] A user accesses the system using a terminal and uses the service.

[0382] Step 2:

[0383] The server performs text analysis on each text entered by the user as it is submitted, identifying sentiment from keywords and context.

[0384] Step 3:

[0385] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[0386] Step 4:

[0387] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[0388] Step 5:

[0389] The server generates an appropriate response based on the emotion recognized by the emotion engine.

[0390] Step 6:

[0391] The server generates a response that is then displayed or sent to the user.

[0392] Step 7:

[0393] The user receives the response from the server and begins the next interaction.

[0394] This process allows the system to generate responses that reflect the user's emotions and provide more personalized services. For example, in a city hall's online application system, if a user is feeling stressed, the server can display encouraging messages or guidance to the user. This improves the user experience and encourages service use.

[0395] Example 2

[0396] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0397] Previous systems provided separate functions for secure communications, automated routine processes, connectivity between multiple cloud environments, and data backup, but few systems comprehensively integrated these functions. Furthermore, they lacked the ability to recognize user emotions and dynamically respond, creating challenges in improving the user experience. Furthermore, there was a need for a system that provided a seamless interface for collaboration with financial institutions and postal institutions.

[0398] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0399] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, and a means including an emotion engine that recognizes user emotions. This ensures secure communications, enables efficient and automated routine processes, safe data backup, and seamless data linkage between multiple clouds. Furthermore, by responding to user emotions, an improved user experience can be expected.

[0400] "Secure communication" refers to a highly secure means of communication that prevents unauthorized access from outside, data tampering, and information leaks.

[0401] "Automation of routine processes" is a means of increasing efficiency by automating repetitive tasks that have set procedures.

[0402] A "cloud environment" is a virtualized IT infrastructure that uses data storage and computing resources provided via the Internet.

[0403] "Means of interconnection" refers to a communication method that enables data exchange and collaboration between multiple cloud environments.

[0404] "Means for backing up data" refers to a method for regularly copying and saving data in preparation for data loss or corruption.

[0405] A "financial institution" is an organization that manages and administers funds, such as a bank or credit company.

[0406] A "postal organization" is an organization that provides mail delivery and logistics services.

[0407] An "emotion engine" is software or a system that analyzes input data such as text, voice, and images from a user and identifies the user's emotions.

[0408] The present invention is a system that combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, with an emotion engine that recognizes user emotions. An embodiment of the system will be described in detail below.

[0409] Building a secure network

[0410] VPN Connection

[0411] The server uses OpenVPN software to connect to a VPN server using authentication information (username, password, certificate), which protects the business network from unauthorized access from outside.

[0412] Example: A company's employees use this VPN connection to connect to a secure internal network when working remotely.

[0413] Firewall settings

[0414] The server edits firewall configuration files, such as iptables or pfSense, and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0415] Example: In a corporate network, an administrator configures the network to allow access only from a specific server room.

[0416] Configuring encryption protocols

[0417] The server obtains an SSL / TLS certificate from a certificate authority such as Let's Encrypt and adds settings to the web server (Apache or NGINX) configuration file to enable encrypted communication, which encrypts and protects communication between the user and the server.

[0418] Example: Used by online shopping sites to securely transmit users' credit card information.

[0419] Automating routine processes

[0420] Processing applications for public services

[0421] The user accesses the application form for the public service using a device (browser or dedicated app) and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database (MySQL or PostgreSQL). Once processing is complete, the server uses the SMTP server to send a confirmation email to the user.

[0422] Example: When a resident applies for a residence certificate on a local government website.

[0423] Automation of resident registration and family register-related matters

[0424] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information and automatically generates the necessary documents in PDF format. The generated PDF is digitally signed and the server then emails it to the user.

[0425] Example: The procedure for transferring your residence registration to your new residence when moving.

[0426] Cloud Interconnection and Backup

[0427] Cloud-to-cloud interconnection

[0428] The server stores API credentials for multiple cloud environments (AWS and Azure®) in a configuration file. The server connects to both clouds, initiates data synchronization, and monitors the connection status with a heartbeat function.

[0429] Example: An e-commerce company replicating data between AWS and Azure.

[0430] Data Backup

[0431] Schedule regular backups of your servers using cron jobs, AWS Lambda, etc. Create snapshots of your databases and transfer them to a second cloud, such as Google Cloud Storage or an S3 bucket.

[0432] Example: A financial institution periodically backs up customer transaction information.

[0433] Cooperation with financial institutions and postal institutions

[0434] Transaction collaboration with banks

[0435] The user uses a terminal to access an online payment form and enters the information. The server receives this information, connects to the bank's API, sends the user's authentication information, debits the required amount from the account, and notifies the user of the transaction result.

[0436] Example: A local government accepts online payments for resident taxes.

[0437] Business collaboration with the post office

[0438] When a user requests a postal transaction, the server sends the transaction information to the post office API, receives a confirmation reply from the post office, and notifies the user that the transaction is complete.

[0439] Example: When checking the shipping status of an item from an online shop.

[0440] Introducing the Emotion Engine

[0441] emotion recognition

[0442] The server uses emotion engines such as IBM Watson® or Google Cloud Natural Language API to recognize the user's emotions as they interact with the system.

[0443] Example prompt: "If a user feels stressed while applying on the city hall's online application system, what message can be displayed to make the user feel more at ease?"

[0444] Text analytics

[0445] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions.

[0446] Example prompt: "When a user says, 'I'm tired today,' how should the system respond?"

[0447] Audio analysis

[0448] When a user interacts with the system through voice, the server analyzes the voice data to identify emotions.

[0449] Example prompt: "How should the system respond if the user speaks in an excited voice?"

[0450] Image analysis

[0451] When a user accesses the system using a camera, the server analyzes the image data to identify emotions.

[0452] Example prompt: "If a user sends a picture of a smiling face, how should the system respond?"

[0453] Response Control

[0454] The server generates and sends an appropriate response to the user based on the emotion recognized by the emotion engine.

[0455] Example: In a local government online application system, when a user feels stressed, the system displays a guide message such as, "The necessary steps will be shown step by step, so please remain calm and proceed."

[0456] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0457] Step 1:

[0458] The user accesses the system using a device (browser or dedicated app). The user opens the application form for a public service, enters the required information, and clicks the application button. The user's input includes name, address, application details, etc.

[0459] Input: Application information entered by the user (name, address, application details, etc.)

[0460] Output: Trigger to send application information

[0461] What happens: A user enters information into a web form and clicks the "Submit" button, which sends an HTTP POST request to the server.

[0462] Step 2:

[0463] The server receives the application form data sent from the user and validates it, checking that it has been entered in the correct format and that it does not contain any invalid data.

[0464] Input: Application form data sent by the user

[0465] Output: Validation result (success / failure)

[0466] Specific behavior: The server parses the form data (e.g., JSON format), checks the format and required fields of each field, and decides whether to return an error message to the user or proceed to the next step.

[0467] Step 3:

[0468] The server saves the validated application data in a database (MySQL or PostgreSQL), and then adds a new record to the database as a result.

[0469] Input: Successfully validated application data

[0470] Output: Application records stored in the database

[0471] Specific behavior: The server executes an SQL query such as "INSERT INTO applications (name, address, application_type) VALUES ('John Doe', '123 Main St', 'Resident Card')".

[0472] Step 4:

[0473] The server generates an application completion email and sends it to the user, which includes a notification of acceptance of the application and information about future procedures.

[0474] Input: Application record stored in the database

[0475] Output: A confirmation email to the user.

[0476] Specific operation: The server sends an "application confirmation email to the user" via the SMTP server. The subject will be something like "Subject: Notification of application completion" and the email body will say "Your application has been accepted."

[0477] Step 5:

[0478] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information, and automatically generates the necessary documents in PDF format based on the user's information.

[0479] Input: User request for issuance of resident certificate

[0480] Output: Generated PDF document

[0481] What it does: The server runs an SQL query like "SELECT FROM residents WHERE user_id = 'john_doe'" and generates a PDF using the FPDF library.

[0482] Step 6:

[0483] The server then affixes a digital signature to the generated PDF, ensuring the authenticity of the document.

[0484] Input: Generated PDF document

[0485] Output: PDF document with digital signature

[0486] Specific behavior: The server runs a command like "gpg --sign resident_certificate.pdf" to add a digital signature to the PDF.

[0487] Step 7:

[0488] The server then emails the generated PDF with the digital signature to the user, allowing them to receive the necessary documents.

[0489] Input: PDF document with digital signature

[0490] Output: PDF sent to user

[0491] Specific operation: The server uses an SMTP server to send a PDF with an electronic signature to the user with the subject "Notice of Resident Registration Issuance."

[0492] Step 8:

[0493] The server configures API credentials for multiple cloud environments (e.g. AWS and Azure), starts synchronizing data, and monitors connections with a heartbeat function.

[0494] Input: API credentials for your cloud environment

[0495] Output: Data synchronization and connection monitoring between cloud environments

[0496] Specific operations: The server executes the "aws configure" and "az login" commands, synchronizes data using rsync, and monitors the connection health using the heartbeat function.

[0497] Step 9:

[0498] The server schedules regular data backups using cron jobs or Lambda functions and transfers snapshots to a second cloud (Google Cloud Storage or S3).

[0499] Input: Schedule settings and data to be backed up

[0500] Output: Backup data stored in the second cloud

[0501] Specific operation: The server sets a schedule with "crontab -e", obtains a database backup with the command "pg_dump database_name > backup.sql", and transfers the backup with "gsutil cp backup.sql gs: / / bucket / ".

[0502] Step 10:

[0503] The user accesses the online payment form using a terminal, enters payment information, and submits it. The server receives the information, connects to the bank API, executes the transaction, and notifies the user of the result.

[0504] Input: Payment information entered by the user

[0505] Output: Transaction result and user notification

[0506] Specific operation: The server POSTs the user information to the endpoint "https: / / api.bank.com / transaction" and notifies the user of the transaction results by email.

[0507] Step 11:

[0508] When a user requests a postal transaction, the server sends the transaction information to the Post Office API, receives a confirmation reply, and sends a notification to the user that the transaction is complete.

[0509] Input: A mail transaction request from the user

[0510] Output: Transaction completion confirmation and user notification

[0511] Specific operation: The server POSTs to "https: / / api.postoffice.com / transaction" and notifies the user of the transaction results by email.

[0512] Step 12:

[0513] The server uses the user's text, voice, and image to activate the emotion engine and recognize emotions. Based on the recognized emotions, it generates an appropriate response and sends it to the user.

[0514] Input: User text, voice, and image data

[0515] Output: Emotion recognition results and generated responses

[0516] Specific operation: The server sends the text input to IBM Watson, retrieves the analysis results using "POST https: / / api.us-south.tone-analyzer.watson.cloud.ibm.com / instances / {instance_id} / v3 / tone", generates a response, and sends it to the user.

[0517] (Application example 2)

[0518] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0519] Modern electronic payment systems require security, automated processing, and data integration between cloud environments. Furthermore, to improve the user experience, they need the ability to recognize user emotions in real time and respond appropriately. However, meeting these requirements in a single system is technically complex, and current systems are not adequately capable. This has led to problems such as user frustration and cumbersome operation.

[0520] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for establishing secure communications, means for automating routine processing, means for interconnecting multiple cloud environments, means for backing up data, means for coordinating with financial institutions and postal institutions, means for recognizing emotions, and means for optimizing the user experience based on emotions. This not only ensures security and improves business efficiency, but also enables flexible responses according to the user's emotions.

[0521] "Secure communication" refers to a communication method that ensures the safety of information by using encryption technology and virtual private networks to prevent unauthorized access and data leaks.

[0522] A "routine process" is a series of standardized tasks that are set up in advance to streamline business operations and procedures and to be executed automatically.

[0523] "Means for interconnecting multiple cloud environments" refers to technologies and methods for seamlessly linking data and services between different cloud service providers.

[0524] "Data backup" is the process of regularly creating copies of data and storing them in different locations or storage to reduce the risk of data loss.

[0525] "Means for interfacing with financial institutions and postal institutions" refers to interfaces and protocols for sharing information between systems with banks, post offices, etc., to automate and streamline transactions and postal operations.

[0526] "Emotion recognition means" refers to algorithms and technologies that analyze data such as a user's voice, text, and images to detect and determine their emotional state.

[0527] The "means for optimizing user experience based on emotions" refers to a method and system for providing appropriate application responses and support in response to detected user emotions to enhance the user experience.

[0528] One embodiment of the present invention is a system and program for use in an electronic payment service. The system has functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, cooperating with financial institutions and postal institutions, and recognizing user emotions and optimizing the user experience based on the emotions.

[0529] Building a secure network

[0530] VPN Connection

[0531] The server runs virtual private network (VPN) software and uses the authentication information to connect to a VPN server, which protects the business network from unauthorized access.

[0532] Firewall settings

[0533] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0534] Configuring encryption protocols

[0535] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[0536] Automating routine processes

[0537] Processing applications for public services

[0538] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[0539] Automation of resident registration and family register-related matters

[0540] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[0541] Cloud Interconnection and Backup

[0542] Cloud-to-cloud interconnection

[0543] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[0544] Data Backup

[0545] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[0546] Cooperation with financial institutions and postal institutions

[0547] Transaction collaboration with banks

[0548] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[0549] Business collaboration with the post office

[0550] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[0551] Introducing the Emotion Engine

[0552] emotion recognition

[0553] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as voice, text, and images.

[0554] Text analytics

[0555] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[0556] Audio analysis

[0557] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[0558] Image analysis

[0559] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[0560] Response Control

[0561] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[0562] Specific examples

[0563] If a user is feeling stressed while shopping online, the system can detect that emotion from their tone of voice and facial expressions. For example, if a user feels that a certain process is troublesome, the system can suggest that a limited-time discount is available on a specific product.

[0564] Example prompt sentence:

[0565] Users can sometimes feel stressed while shopping online. The EmotionPay system analyzes voice and facial expression data in real time to detect user emotions. It then provides useful suggestions and support to users based on the detected emotions, providing a stress-free payment experience. Please automate the API calls and data processing required for this program.

[0566] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0567] Step 1:

[0568] The server establishes the VPN connection by launching the VPN software and connecting to the VPN server using the authentication information. The inputs are the authentication information and the VPN server address, and the output is a secure communication path.

[0569] Step 2:

[0570] The server configures the firewall. Specifically, it edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers. The input is the IP addresses and port numbers to be allowed, and the output is a secure network environment.

[0571] Step 3:

[0572] The server obtains the SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. The input is the SSL / TLS certificate and the web server configuration, and the output is an encrypted communication channel.

[0573] Step 4:

[0574] A user accesses a public service application form using a terminal and inputs the required information. The input is the application data from the user, and the output is the data to be sent to the server.

[0575] Step 5:

[0576] The server stores the received application data in a database. The input is the application data received from the user, and the output is the data stored in the database.

[0577] Step 6:

[0578] The server notifies the user that the process is complete by sending a confirmation email. The input is the notification of the process completion, and the output is the email sent to the user.

[0579] Step 7:

[0580] When a user applies for a resident certificate, the server accesses the resident database to search for the applicant's information. The input is the user's application data and the resident database, and the output is the search result.

[0581] Step 8:

[0582] The server automatically generates the necessary documents and attaches a digital signature to them. The input is the search results, and the output is the document with the digital signature attached.

[0583] Step 9:

[0584] The server emails the generated document to the user. The input is the document with the digital signature, and the output is the email to the user.

[0585] Step 10:

[0586] The server monitors interconnections between multiple cloud environments. The input is connection information and heartbeat signals of the cloud environments, and the output is the result of continuous monitoring of the connection status.

[0587] Step 11:

[0588] The server periodically backs up data and transfers the database snapshot to the second cloud. The input is the database snapshot, and the output is the backup data stored in the second cloud.

[0589] Step 12:

[0590] A user uses a terminal to submit a request to pay tax online. The input is the user's request data, and the output is the data sent to the server.

[0591] Step 13:

[0592] The server connects to the bank's API and debits the account using the user's credentials. The inputs are the user's credentials and the transaction details, and the output is the transaction result.

[0593] Step 14:

[0594] The server notifies the user that the transaction is complete. The input is the transaction result, and the output is a notification to the user.

[0595] Step 15:

[0596] When a user requests a postal transaction, the server sends the information to the post office's system. The input is the user's request data, and the output is the data to be sent to the post office.

[0597] Step 16:

[0598] After receiving a confirmation from the post office, the server notifies the user that the transaction is complete. The input is the confirmation data from the post office, and the output is a notification to the user.

[0599] Step 17:

[0600] When a user interacts with the system, the server uses an emotion engine to recognize the user's emotions. The input is the user's voice, text, and image data, and the output is their emotional state.

[0601] Step 18:

[0602] The server generates an appropriate response based on the emotion recognized by the emotion engine. The input is the emotional state, and the output is the appropriate response or support content.

[0603] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0604] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0605] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0606] [Second embodiment]

[0607] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0608] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0609] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0610] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0611] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0612] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0613] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0614] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0615] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0616] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0617] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0618] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0619] The system of the present invention provides functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions. The following describes specific embodiments of the system.

[0620] Building a secure network

[0621] VPN Connection

[0622] The server runs virtual private network (VPN) software and uses the credentials to connect to a VPN server, which protects the business network from unauthorized access.

[0623] Firewall settings

[0624] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0625] Configuring encryption protocols

[0626] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[0627] Automating routine processes

[0628] Processing applications for public services

[0629] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[0630] Automation of resident registration and family register-related matters

[0631] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[0632] Cloud Interconnection and Backup

[0633] Cloud-to-cloud interconnection

[0634] The server is configured to ensure interconnection between multiple cloud environments. To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs on one of the clouds.

[0635] Data Backup

[0636] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[0637] Cooperation with financial institutions and postal institutions

[0638] Transaction collaboration with banks

[0639] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[0640] Business collaboration with the post office

[0641] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[0642] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[0643] The processing flow will be explained below.

[0644] Building a secure network

[0645] Step 1:

[0646] The server runs the VPN software.

[0647] Step 2:

[0648] The server connects to the VPN server using the authentication information (username and password).

[0649] Step 3:

[0650] The server verifies that the VPN connection has been established and monitors the connection status.

[0651] Step 4:

[0652] The server opens the firewall configuration file.

[0653] Step 5:

[0654] The server adds allowed IP addresses and port numbers to a configuration file.

[0655] Step 6:

[0656] The server will save the firewall settings and restart.

[0657] Step 7:

[0658] The server obtains an SSL / TLS certificate.

[0659] Step 8:

[0660] The server adds settings to the web server configuration file to enable SSL / TLS.

[0661] Step 9:

[0662] The server will restart the web server to reflect the settings.

[0663] Automating routine processes

[0664] Step 1:

[0665] A user uses a terminal to access a utility service application form.

[0666] Step 2:

[0667] The user enters the necessary information into the application form.

[0668] Step 3:

[0669] The user clicks the application button.

[0670] Step 4:

[0671] The server receives the application data.

[0672] Step 5:

[0673] The server stores the application data in a database.

[0674] Step 6:

[0675] The server will notify the user by email that the process is complete.

[0676] Step 7:

[0677] The user applies for a resident certificate online.

[0678] Step 8:

[0679] The server accesses a resident database and retrieves the applicant's information.

[0680] Step 9:

[0681] The server automatically generates the necessary documents.

[0682] Step 10:

[0683] The server affixes an electronic signature to the automatically generated document.

[0684] Step 11:

[0685] The server then emails the document with the electronic signature to the user.

[0686] Cloud Interconnection and Backup

[0687] Step 1:

[0688] The server checks the connection settings for NTT Cloud and au Cloud.

[0689] Step 2:

[0690] The server monitors the connection between both clouds using a HeartBeat function.

[0691] Step 3:

[0692] The server periodically checks the connection status between the clouds.

[0693] Step 4:

[0694] The server sets up a regular data backup schedule.

[0695] Step 5:

[0696] When it's time for a backup, the server creates a snapshot of the database.

[0697] Step 6:

[0698] The server transfers the snapshot to the second cloud.

[0699] Cooperation with banks and post offices

[0700] Step 1:

[0701] The user uses the terminal to submit a request to pay the tax online.

[0702] Step 2:

[0703] The server receives the request and connects to the bank's API.

[0704] Step 3:

[0705] The server uses the user's authentication information to access the bank account and debit the required amount.

[0706] Step 4:

[0707] The server notifies the user of the transaction result.

[0708] Step 5:

[0709] The user submits a request for a mail transaction.

[0710] Step 6:

[0711] The server sends the transaction information to the post office system.

[0712] Step 7:

[0713] The server receives a confirmation reply from the post office.

[0714] Step 8:

[0715] The server will send a notification to the user that the transaction is complete.

[0716] Example 1

[0717] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0718] The current system faces many challenges, including security vulnerabilities, inefficient routine processing, complex data exchange between cloud environments, a lack of a secure data backup method, and complex collaboration with financial institutions and postal organizations. These challenges are particularly significant when it comes to operations involving sensitive information.

[0719] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0720] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, and a means for coordinating with financial institutions and postal institutions, thereby significantly improving the safety and efficiency of the system and enabling fast and safe processing, particularly when providing public services.

[0721] "Secure communication" means that data is protected from unauthorized access or interception from outside.

[0722] "Routine processing" refers to a series of operations that automatically execute repetitive business processes and procedures.

[0723] A "cloud environment" refers to a computer network infrastructure that allows data and applications to be stored and accessed on remote servers via the Internet.

[0724] A "backup" is the process of duplicating data and storing it in case the original data is lost.

[0725] "Financial institution" refers to an organization or establishment that provides financial services, such as a bank or credit union.

[0726] "Postal agency" means any public or private organization that collects and delivers mail.

[0727] A "virtual private network" is a virtual dedicated line for securely sending and receiving data over the Internet.

[0728] A "firewall" is a device or software that blocks unauthorized traffic to enhance network security.

[0729] An "encryption protocol" is a communication protocol that encrypts data so that only the sender and receiver can read it.

[0730] "Public services" refers to administrative services provided by the national government and local governments.

[0731] A "resident card" is a certificate of residence issued to residents by local governments.

[0732] An "electronic signature" is an electronic signature that the creator of digital data affixes to that data, and is used to prevent data tampering and to authenticate the data.

[0733] "Cloud interconnection" is a mechanism that enables seamless collaboration between data and services across different cloud providers.

[0734] A "database" is a system for efficiently storing, searching, and managing data.

[0735] A "snapshot" refers to the process of recording and saving the state of data or a system at a certain point in time.

[0736] "OAuth authentication" is an open standard protocol that allows users to authorize third-party applications to access their resources.

[0737] The system of the present invention provides the functionality to establish secure communications, automate routine processes, interconnect multiple cloud environments, back up data, and collaborate with financial institutions and postal institutions.

[0738] Establishing Secure Communications

[0739] VPN Connection

[0740] The server runs virtual private network (VPN) software and connects to the VPN server using the credentials. The specific software used is OpenVPN. This connection protects the business network from unauthorized access from outside.

[0741] Firewall settings

[0742] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, using the tool iptables, so that only allowed traffic can access the network.

[0743] Configuring encryption protocols

[0744] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. In this case, the specific software is Let's Encrypt and Nginx. This encrypts and protects communication between the user and the server.

[0745] Automating routine processes

[0746] Processing applications for public services

[0747] The user accesses the application form for the public service using a terminal and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database. The specific software used is PHP and MySQL. Once processing is complete, the server sends a confirmation email to the user using the SMTP protocol. This ensures that application processing is fast and accurate.

[0748] Automation of resident registration and family register-related matters

[0749] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. The specific tools used are an Oracle database and electronic signature software. This allows users to quickly receive the necessary documents.

[0750] Cloud Interconnection and Backup

[0751] Cloud-to-cloud interconnection

[0752] The server is configured to ensure interconnection between multiple cloud environments (e.g., domestic cloud A and domestic cloud B). To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs in one of the clouds.

[0753] Data Backup

[0754] The server schedules regular data backups, creates snapshots of the database, and transfers them to the second cloud using AWS S3 and MySQL snapshot features, which minimizes the risk of data loss.

[0755] Cooperation with financial institutions and postal institutions

[0756] Transaction collaboration with banks

[0757] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API and debits the account with the user's credentials. The specific tools used are REST API and the OAuth authentication system. Once the transaction is complete, the server notifies the user of the result.

[0758] Business collaboration with the post office

[0759] When a user requests a postal transaction, the server sends the information to the post office's system using a SOAP API. After receiving a confirmation from the post office, the server notifies the user that the transaction is complete.

[0760] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[0761] Example prompts for generative AI models

[0762] "Please explain in natural language the process of the city hall's resident registration system. Please provide details of the steps a user takes to apply online and the processes the system performs in the background."

[0763] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0764] Establishing Secure Communications

[0765] Step 1:

[0766] The server launches the VPN software (e.g., OpenVPN). It uses the VPN configuration file and authentication information as input. The VPN configuration file contains the server's IP address, port number, and encryption method. The output is a VPN connection established. Specifically, it sends the authentication information and receives a successful connection response from the VPN server.

[0767] Step 2:

[0768] The server edits the firewall configuration file. As input, it adds a rule that allows a specific IP address and port number. Specifically, it updates the configuration file using the iptables command. The output is the updated firewall configuration file. Specifically, after the settings are reflected, it runs a test command to confirm that the settings have been reflected correctly.

[0769] Step 3:

[0770] The server obtains an SSL / TLS certificate. As input, it connects to the Let's Encrypt API and sends a CSR (Certificate Signing Request). The output is the obtained SSL / TLS certificate. Specifically, it adds the obtained certificate to the configuration file of the web server (e.g., Nginx), restarts Nginx, and establishes encrypted communication.

[0771] Automating routine processes

[0772] Step 4:

[0773] A user accesses a public service application form using a terminal. As input, the user enters necessary information such as name, address, and application details. The output is the entered form data. Specifically, the user clicks the application button, and the data is sent to the server.

[0774] Step 5:

[0775] The server processes the received form data. As input, it receives the form data submitted by the user. As data processing, it validates the data using a PHP script and saves it to a MySQL database. The output is the data saved in the database. Specifically, if the save is successful, it generates an SMTP request to send a confirmation email to the user.

[0776] Step 6:

[0777] The server automates the application for issuing a resident certificate. As input, it receives request data for issuing a resident certificate from the user. As data calculation, it accesses the resident database and searches for the necessary information. The output is a resident certificate with an electronic signature. Specifically, it creates the generated resident certificate in PDF format, adds an electronic signature, and sends it to the user by email.

[0778] Cloud Interconnection and Backup

[0779] Step 7:

[0780] The server sets up interconnections between clouds. It uses connection information between two cloud providers (e.g., domestic cloud A and domestic cloud B) as input. Specific operations include using Heartbeat software to monitor the connection status. The output shows that the interconnection has been established. If an abnormality occurs, a log is generated that automatically switches the connection to another cloud.

[0781] Step 8:

[0782] The server performs data backup. As input, it uses a schedule setting to create a snapshot of the MySQL database. As data processing, it generates a snapshot and uploads it to AWS S3. The output is a notification that the backup is complete. Specifically, after the backup process is complete, it logs "The database snapshot has been uploaded to AWS S3."

[0783] Cooperation with financial institutions and postal institutions

[0784] Step 9:

[0785] The user submits a tax payment request online using a terminal. As input, the user enters tax payment details. The output is the request data sent to the server. The specific action is to click the pay button.

[0786] Step 10:

[0787] The server connects to the bank's API. As input, it uses the tax payment request data and user authentication information. As data calculation, it accesses the bank system via the REST API and performs OAuth authentication. The output is a notification of the payment result. Specifically, once the transaction is completed, it generates and sends an email notifying the user of the result.

[0788] Step 11:

[0789] A user requests a transaction by mail. As input, they enter details about the transaction. The output is the request data sent to the server. The specific action is to click the request button.

[0790] Step 12:

[0791] The server connects to the post office system. As input, it receives the user's request data. As data processing, it accesses the post office system using the SOAP API and sends the transaction information. The output is a notification of transaction completion. As a specific operation, after receiving a confirmation reply, it generates and sends an email notifying the user that the transaction has been completed.

[0792] (Application example 1)

[0793] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0794] In today's digital society, users of financial institutions and public services are required to manage their data in multiple cloud environments and to carry out transactions and service requests quickly and securely through secure networks. This requires mitigating security risks, automating data backups, and seamless integration with financial institutions and postal organizations. However, managing and operating these systems separately can be time-consuming and resource-intensive. It can also be difficult to ensure high levels of security to prevent security threats and unauthorized network access.

[0795] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0796] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, a means for processing applications for public services using terminals for secure transactions, and a means for enhancing security using VPN connections, firewall settings, and SSL / TLS encrypted communications. This allows users to conduct financial transactions and apply for public services on a network with multiple layers of security through a centralized system. Furthermore, data linkage and automatic backup between clouds improves data reliability and service continuity.

[0797] "Secure communication" refers to a safe network connection that is protected from unauthorized access using a virtual private network or SSL / TLS encrypted communication, etc.

[0798] "Routine processing" refers to the process of improving efficiency by automating routine procedures.

[0799] "Cloud environment" refers to a virtual server environment that includes data storage and computing resources provided via the Internet.

[0800] "Interconnection" refers to a connection method that enables seamless availability of data and services between different systems and cloud providers.

[0801] "Data backup" refers to a method of reducing the risk of data loss by regularly duplicating important data and storing it in a different location.

[0802] "Financial institution" means an organization that provides financial services, such as a bank or credit card company.

[0803] "Postal institution" means an organization or institution that provides postal services, including the collection, delivery, and sending of mail.

[0804] "Terminal" refers to a device used by a User, such as a computer, smartphone, or tablet.

[0805] "VPN connection" refers to technology that establishes a secure communication path using a virtual private network.

[0806] "Firewall Settings" means security settings that control or allow traffic to protect a network from unauthorized access.

[0807] "SSL / TLS encrypted communication" refers to a protocol that encrypts communication content to prevent data eavesdropping and tampering.

[0808] The system for implementing the present invention includes a terminal for conducting secure transactions, a server for establishing secure communications, and a program for providing interconnection and data backup functions between multiple cloud environments. The components of this system and their specific operations will be described below.

[0809] Hardware and Software Configuration

[0810] 1. Terminal

[0811] A terminal is a device used by a user, such as a computer, smartphone, or tablet, on which a secure trading application is installed.

[0812] 2. Server

[0813] The server establishes secure communications, automates routine processes, interconnects multiple cloud environments, and backs up data. It also manages collaboration with financial institutions and postal agencies.

[0814] The specific software used

[0815] VPN Services: Establish a secure VPN connection using off-the-shelf or open-source VPN software such as OpenVPN.

[0816] SSL / TLS libraries: Use libraries such as OpenSSL to set up encrypted data communications.

[0817] Web server: Uses Apache or Nginx to provide web services.

[0818] REST API: Provides APIs used for processing public service applications and backing up data.

[0819] Processing Details

[0820] 1. Establishing secure communications

[0821] The server uses VPN software (e.g., OpenVPN) to set up a virtual private network and encrypt communications between the device and the server, preventing unauthorized access from outside.

[0822] The server also uses firewall settings to allow only specific IP addresses and port numbers, and obtains an SSL / TLS certificate to encrypt web server communications.

[0823] 2. Automating routine processes

[0824] When a user applies for a public service using a terminal, the data is sent to the server via a web server, which receives the data and processes it automatically.

[0825] For example, when a user applies for a resident registration certificate, the server extracts the necessary data from the resident database and automatically generates the necessary documents. The documents are then digitally signed and sent to the user's email address.

[0826] 3. Cloud interconnection and data backup

[0827] The server shares data between multiple cloud environments. This includes, for example, seamless data exchange between NTT Cloud and au Cloud. Connections between different providers are monitored by a heartbeat function, and in the event of a failure, the server immediately switches to a backup.

[0828] The server also periodically takes snapshots of the data on an automated schedule and transfers the data to a second cloud, minimizing the risk of data loss.

[0829] Specific examples

[0830] Let's take the example of a user applying for a resident registration card using a secure transaction app. The user launches the app installed on their smartphone, enters the required information, and clicks the "Apply" button. The server receives the data, automatically generates and approves the resident registration card, and sends an electronic copy to the user's email address. During this process, the data is securely transmitted via a VPN connection and SSL / TLS encryption. This data is also backed up in the cloud, ensuring data safety even in the event of a system failure.

[0831] Prompt Sentence Examples

[0832] "Create a story where a user applies for a residence certificate using the Secure Transaction app, receives a secure digital residence certificate to their email address, and their data is backed up."

[0833] With this configuration, the present invention has the effect of enhancing security while enabling efficient use of public services and minimizing the risk of data loss and system failure.

[0834] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0835] Step 1:

[0836] Terminal: The user launches the secure transaction app on their smartphone. The user inputs the information required to apply for public services (e.g., name, address, application details). The input information is sent from the terminal to the server.

[0837] Step 2:

[0838] Server: The server first establishes a VPN connection to process the received user data. The input is the application data sent from the terminal. A secure communication path is set up using VPN software (e.g., OpenVPN) to prevent unauthorized access from outside. The output is the data being sent through the secure network.

[0839] Step 3:

[0840] Server: The server applies firewall rules, allowing only specific IP addresses and port numbers. Input: Network traffic after VPN connection is established. Edit firewall settings to allow only allowed traffic to access the network. Output: Secure connection established.

[0841] Step 4:

[0842] Server: The server sets up SSL / TLS encrypted communication and encrypts data. The input is traffic from a securely connected network. An SSL / TLS certificate is obtained and settings to enable encrypted communication are added to the web server configuration file. The output is encrypted data communication.

[0843] Step 5:

[0844] Server: The server automates the application process for public services. The input is the user's application data. The server accesses the database and automatically processes the application information. For example, when an application is made for the issuance of a resident certificate, the server extracts data from the resident database and generates the necessary documents. The output is the generated document with an electronic signature.

[0845] Step 6:

[0846] Server: The server uses a mail server to send an email to the user to deliver the generated document. The input is the generated digitally signed document and the user's email address. The server uses this information to send a confirmation email. The output is a confirmation email sent to the user's inbox.

[0847] Step 7:

[0848] Server: The server performs regular data backups. The input is the latest user data and system status. According to a schedule, a snapshot of the database is created and transferred to the second cloud. The output is the backed-up data.

[0849] Step 8:

[0850] Server: Monitors interconnections between cloud environments and ensures seamless data integration. Input is heartbeat data from each cloud environment. If the server detects an abnormality, it immediately switches to the second cloud. Output ensures continuous data availability.

[0851] In this way, the system allows users to securely and efficiently access public services and conduct safe transactions over a network with multiple layers of security.

[0852] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0853] The system of the present invention combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, as well as an emotion engine that recognizes user emotions. A specific embodiment of the system will be described below.

[0854] Building a secure network

[0855] VPN Connection

[0856] The server launches the VPN software and connects to the VPN server using the authentication information, protecting the business network from unauthorized access from outside.

[0857] Firewall settings

[0858] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0859] Configuring encryption protocols

[0860] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[0861] Automating routine processes

[0862] Processing applications for public services

[0863] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[0864] Automation of resident registration and family register-related matters

[0865] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[0866] Cloud Interconnection and Backup

[0867] Cloud-to-cloud interconnection

[0868] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[0869] Data Backup

[0870] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[0871] Cooperation with financial institutions and postal institutions

[0872] Transaction collaboration with banks

[0873] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[0874] Business collaboration with the post office

[0875] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[0876] Introducing the Emotion Engine

[0877] emotion recognition

[0878] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as text, voice, and images.

[0879] Text analytics

[0880] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[0881] Audio analysis

[0882] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[0883] Image analysis

[0884] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[0885] Response Control

[0886] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[0887] As a result, the system of the present invention is expected to further improve the user experience by responding to the user's emotions as well as linking with public services and financial institutions. As a specific example, in a city hall online application system, when a user feels stressed, the system can provide interactions such as displaying guidance or encouraging messages.

[0888] The processing flow will be explained below.

[0889] Building a secure network

[0890] Step 1:

[0891] The server runs the VPN software.

[0892] Step 2:

[0893] The server connects to the VPN server using the authentication information (username and password).

[0894] Step 3:

[0895] The server verifies that the VPN connection has been established.

[0896] Step 4:

[0897] The server opens the firewall configuration file.

[0898] Step 5:

[0899] The server adds allowed IP addresses and port numbers to a configuration file.

[0900] Step 6:

[0901] The server will save the firewall settings and restart.

[0902] Step 7:

[0903] The server obtains an SSL / TLS certificate.

[0904] Step 8:

[0905] The server adds settings to the web server configuration file to enable SSL / TLS.

[0906] Step 9:

[0907] The server will restart the web server to reflect the settings.

[0908] Automating routine processes

[0909] Step 1:

[0910] A user uses a terminal to access a utility service application form.

[0911] Step 2:

[0912] The user enters the necessary information into the application form.

[0913] Step 3:

[0914] The user clicks the application button.

[0915] Step 4:

[0916] The server receives the application data.

[0917] Step 5:

[0918] The server stores the application data in a database.

[0919] Step 6:

[0920] The server will notify the user by email that the process is complete.

[0921] Step 7:

[0922] The user applies for a resident certificate online.

[0923] Step 8:

[0924] The server accesses a resident database and retrieves the applicant's information.

[0925] Step 9:

[0926] The server automatically generates the necessary documents.

[0927] Step 10:

[0928] The server affixes an electronic signature to the automatically generated document.

[0929] Step 11:

[0930] The server then emails the document with the electronic signature to the user.

[0931] Cloud Interconnection and Backup

[0932] Step 1:

[0933] The server checks the connection settings between NTT Cloud and other companies' clouds.

[0934] Step 2:

[0935] The server monitors the connection between both clouds using a HeartBeat function.

[0936] Step 3:

[0937] The server periodically checks the connection status between the clouds.

[0938] Step 4:

[0939] The server sets up a regular data backup schedule.

[0940] Step 5:

[0941] When it's time for a backup, the server creates a snapshot of the database.

[0942] Step 6:

[0943] The server transfers the snapshot to the second cloud.

[0944] Cooperation with financial institutions and postal institutions

[0945] Step 1:

[0946] The user uses the terminal to submit a request to pay the tax online.

[0947] Step 2:

[0948] The server receives the request and connects to the bank's API.

[0949] Step 3:

[0950] The server uses the user's authentication information to access the bank account and debit the required amount.

[0951] Step 4:

[0952] The server notifies the user of the transaction result.

[0953] Step 5:

[0954] The user submits a request for a mail transaction.

[0955] Step 6:

[0956] The server sends the transaction information to the post office system.

[0957] Step 7:

[0958] The server receives a confirmation reply from the post office.

[0959] Step 8:

[0960] The server will send a notification to the user that the transaction is complete.

[0961] Introducing the Emotion Engine

[0962] Step 1:

[0963] A user accesses the system using a terminal and uses the service.

[0964] Step 2:

[0965] The server performs text analysis on each text entered by the user as it is submitted, identifying sentiment from keywords and context.

[0966] Step 3:

[0967] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[0968] Step 4:

[0969] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[0970] Step 5:

[0971] The server generates an appropriate response based on the emotion recognized by the emotion engine.

[0972] Step 6:

[0973] The server generates a response that is then displayed or sent to the user.

[0974] Step 7:

[0975] The user receives the response from the server and begins the next interaction.

[0976] This process allows the system to generate responses that reflect the user's emotions and provide more personalized services. For example, in a city hall's online application system, if a user is feeling stressed, the server can display encouraging messages or guidance to the user. This improves the user experience and encourages service use.

[0977] Example 2

[0978] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0979] Previous systems provided separate functions for secure communications, automated routine processes, connectivity between multiple cloud environments, and data backup, but few systems comprehensively integrated these functions. Furthermore, they lacked the ability to recognize user emotions and dynamically respond, creating challenges in improving the user experience. Furthermore, there was a need for a system that provided a seamless interface for collaboration with financial institutions and postal institutions.

[0980] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0981] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, and a means including an emotion engine that recognizes user emotions. This ensures secure communications, enables efficient and automated routine processes, safe data backup, and seamless data linkage between multiple clouds. Furthermore, by responding to user emotions, an improved user experience can be expected.

[0982] "Secure communication" refers to a highly secure means of communication that prevents unauthorized access from outside, data tampering, and information leaks.

[0983] "Automation of routine processes" is a means of increasing efficiency by automating repetitive tasks that have set procedures.

[0984] A "cloud environment" is a virtualized IT infrastructure that uses data storage and computing resources provided via the Internet.

[0985] "Means of interconnection" refers to a communication method that enables data exchange and collaboration between multiple cloud environments.

[0986] "Means for backing up data" refers to a method for regularly copying and saving data in preparation for data loss or corruption.

[0987] A "financial institution" is an organization that manages and administers funds, such as a bank or credit company.

[0988] A "postal organization" is an organization that provides mail delivery and logistics services.

[0989] An "emotion engine" is software or a system that analyzes input data such as text, voice, and images from a user and identifies the user's emotions.

[0990] The present invention is a system that combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, with an emotion engine that recognizes user emotions. An embodiment of the system will be described in detail below.

[0991] Building a secure network

[0992] VPN Connection

[0993] The server uses OpenVPN software to connect to a VPN server using authentication information (username, password, certificate), which protects the business network from unauthorized access from outside.

[0994] Example: A company's employees use this VPN connection to connect to a secure internal network when working remotely.

[0995] Firewall settings

[0996] The server edits firewall configuration files, such as iptables or pfSense, and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[0997] Example: In a corporate network, an administrator configures the network to allow access only from a specific server room.

[0998] Configuring encryption protocols

[0999] The server obtains an SSL / TLS certificate from a certificate authority such as Let's Encrypt and adds settings to the web server (Apache or NGINX) configuration file to enable encrypted communication, which encrypts and protects communication between the user and the server.

[1000] Example: Used by online shopping sites to securely transmit users' credit card information.

[1001] Automating routine processes

[1002] Processing applications for public services

[1003] The user accesses the application form for the public service using a device (browser or dedicated app) and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database (MySQL or PostgreSQL). Once processing is complete, the server uses the SMTP server to send a confirmation email to the user.

[1004] Example: When a resident applies for a residence certificate on a local government website.

[1005] Automation of resident registration and family register-related matters

[1006] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information and automatically generates the necessary documents in PDF format. The generated PDF is digitally signed and the server then emails it to the user.

[1007] Example: The procedure for transferring your residence registration to your new residence when moving.

[1008] Cloud Interconnection and Backup

[1009] Cloud-to-cloud interconnection

[1010] The server stores API credentials for multiple cloud environments (AWS and Azure) in a configuration file, connects to both clouds, initiates data synchronization, and monitors the connection status with a heartbeat function.

[1011] Example: An e-commerce company replicating data between AWS and Azure.

[1012] Data Backup

[1013] Schedule regular backups of your servers using cron jobs, AWS Lambda, etc. Create snapshots of your databases and transfer them to a second cloud storage location such as Google Cloud Storage or an S3 bucket.

[1014] Example: A financial institution periodically backs up customer transaction information.

[1015] Cooperation with financial institutions and postal institutions

[1016] Transaction collaboration with banks

[1017] The user uses a terminal to access an online payment form and enters the information. The server receives this information, connects to the bank's API, sends the user's authentication information, debits the required amount from the account, and notifies the user of the transaction result.

[1018] Example: A local government accepts online payments for resident taxes.

[1019] Business collaboration with the post office

[1020] When a user requests a postal transaction, the server sends the transaction information to the post office API, receives a confirmation reply from the post office, and notifies the user that the transaction is complete.

[1021] Example: When checking the shipping status of an item from an online shop.

[1022] Introducing the Emotion Engine

[1023] emotion recognition

[1024] The server uses emotion engines such as IBM Watson and Google Cloud Natural Language API to recognize the user's emotions as they interact with the system.

[1025] Example prompt: "If a user feels stressed while applying on the city hall's online application system, what message can be displayed to make the user feel more at ease?"

[1026] Text analytics

[1027] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions.

[1028] Example prompt: "When a user says, 'I'm tired today,' how should the system respond?"

[1029] Audio analysis

[1030] When a user interacts with the system through voice, the server analyzes the voice data to identify emotions.

[1031] Example prompt: "How should the system respond if the user speaks in an excited voice?"

[1032] Image analysis

[1033] When a user accesses the system using a camera, the server analyzes the image data to identify emotions.

[1034] Example prompt: "If a user sends a picture of a smiling face, how should the system respond?"

[1035] Response Control

[1036] The server generates and sends an appropriate response to the user based on the emotion recognized by the emotion engine.

[1037] Example: In a local government online application system, when a user feels stressed, the system displays a guide message such as, "The necessary steps will be shown step by step, so please remain calm and proceed."

[1038] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1039] Step 1:

[1040] The user accesses the system using a device (browser or dedicated app). The user opens the application form for a public service, enters the required information, and clicks the application button. The user's input includes name, address, application details, etc.

[1041] Input: Application information entered by the user (name, address, application details, etc.)

[1042] Output: Trigger to send application information

[1043] What happens: A user enters information into a web form and clicks the "Submit" button, which sends an HTTP POST request to the server.

[1044] Step 2:

[1045] The server receives the application form data sent from the user and validates it, checking that it has been entered in the correct format and that it does not contain any invalid data.

[1046] Input: Application form data sent by the user

[1047] Output: Validation result (success / failure)

[1048] Specific behavior: The server parses the form data (e.g., JSON format), checks the format and required fields of each field, and decides whether to return an error message to the user or proceed to the next step.

[1049] Step 3:

[1050] The server saves the validated application data in a database (MySQL or PostgreSQL), and then adds a new record to the database as a result.

[1051] Input: Successfully validated application data

[1052] Output: Application records stored in the database

[1053] Specific behavior: The server executes an SQL query such as "INSERT INTO applications (name, address, application_type) VALUES ('John Doe', '123 Main St', 'Resident Card')".

[1054] Step 4:

[1055] The server generates an application completion email and sends it to the user, which includes a notification of acceptance of the application and information about future procedures.

[1056] Input: Application record stored in the database

[1057] Output: A confirmation email to the user.

[1058] Specific operation: The server sends an "application confirmation email to the user" via the SMTP server. The subject will be something like "Subject: Notification of application completion" and the email body will say "Your application has been accepted."

[1059] Step 5:

[1060] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information, and automatically generates the necessary documents in PDF format based on the user's information.

[1061] Input: User request for issuance of resident certificate

[1062] Output: Generated PDF document

[1063] What it does: The server runs an SQL query like "SELECT FROM residents WHERE user_id = 'john_doe'" and generates a PDF using the FPDF library.

[1064] Step 6:

[1065] The server then affixes a digital signature to the generated PDF, ensuring the authenticity of the document.

[1066] Input: Generated PDF document

[1067] Output: PDF document with digital signature

[1068] Specific behavior: The server runs a command like "gpg --sign resident_certificate.pdf" to add a digital signature to the PDF.

[1069] Step 7:

[1070] The server then emails the generated PDF with the digital signature to the user, allowing them to receive the necessary documents.

[1071] Input: PDF document with digital signature

[1072] Output: PDF sent to user

[1073] Specific operation: The server uses an SMTP server to send a PDF with an electronic signature to the user with the subject "Notice of Resident Registration Issuance."

[1074] Step 8:

[1075] The server configures API credentials for multiple cloud environments (e.g. AWS and Azure), starts synchronizing data, and monitors connections with a heartbeat function.

[1076] Input: API credentials for your cloud environment

[1077] Output: Data synchronization and connection monitoring between cloud environments

[1078] Specific operations: The server executes the "aws configure" and "az login" commands, synchronizes data using rsync, and monitors the connection health using the heartbeat function.

[1079] Step 9:

[1080] The server schedules regular data backups using cron jobs or Lambda functions and transfers snapshots to a second cloud (Google Cloud Storage or S3).

[1081] Input: Schedule settings and data to be backed up

[1082] Output: Backup data stored in the second cloud

[1083] Specific operation: The server sets a schedule with "crontab -e", obtains a database backup with the command "pg_dump database_name > backup.sql", and transfers the backup with "gsutil cp backup.sql gs: / / bucket / ".

[1084] Step 10:

[1085] The user accesses the online payment form using a terminal, enters payment information, and submits it. The server receives the information, connects to the bank API, executes the transaction, and notifies the user of the result.

[1086] Input: Payment information entered by the user

[1087] Output: Transaction result and user notification

[1088] Specific operation: The server POSTs the user information to the endpoint "https: / / api.bank.com / transaction" and notifies the user of the transaction results by email.

[1089] Step 11:

[1090] When a user requests a postal transaction, the server sends the transaction information to the Post Office API, receives a confirmation reply, and sends a notification to the user that the transaction is complete.

[1091] Input: A mail transaction request from the user

[1092] Output: Transaction completion confirmation and user notification

[1093] Specific operation: The server POSTs to "https: / / api.postoffice.com / transaction" and notifies the user of the transaction results by email.

[1094] Step 12:

[1095] The server uses the user's text, voice, and image to activate the emotion engine and recognize emotions. Based on the recognized emotions, it generates an appropriate response and sends it to the user.

[1096] Input: User text, voice, and image data

[1097] Output: Emotion recognition results and generated responses

[1098] Specific operation: The server sends the text input to IBM Watson, retrieves the analysis results using "POST https: / / api.us-south.tone-analyzer.watson.cloud.ibm.com / instances / {instance_id} / v3 / tone", generates a response, and sends it to the user.

[1099] (Application example 2)

[1100] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1101] Modern electronic payment systems require security, automated processing, and data integration between cloud environments. Furthermore, to improve the user experience, they need the ability to recognize user emotions in real time and respond appropriately. However, meeting these requirements in a single system is technically complex, and current systems are not adequately capable. This has led to problems such as user frustration and cumbersome operation.

[1102] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for establishing secure communications, means for automating routine processing, means for interconnecting multiple cloud environments, means for backing up data, means for coordinating with financial institutions and postal institutions, means for recognizing emotions, and means for optimizing the user experience based on emotions. This not only ensures security and improves business efficiency, but also enables flexible responses according to the user's emotions.

[1103] "Secure communication" refers to a communication method that ensures the safety of information by using encryption technology and virtual private networks to prevent unauthorized access and data leaks.

[1104] A "routine process" is a series of standardized tasks that are set up in advance to streamline business operations and procedures and to be executed automatically.

[1105] "Means for interconnecting multiple cloud environments" refers to technologies and methods for seamlessly linking data and services between different cloud service providers.

[1106] "Data backup" is the process of regularly creating copies of data and storing them in different locations or storage to reduce the risk of data loss.

[1107] "Means for interfacing with financial institutions and postal institutions" refers to interfaces and protocols for sharing information between systems with banks, post offices, etc., to automate and streamline transactions and postal operations.

[1108] "Emotion recognition means" refers to algorithms and technologies that analyze data such as a user's voice, text, and images to detect and determine their emotional state.

[1109] The "means for optimizing user experience based on emotions" refers to a method and system for providing appropriate application responses and support in response to detected user emotions to enhance the user experience.

[1110] One embodiment of the present invention is a system and program for use in an electronic payment service. The system has functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, cooperating with financial institutions and postal institutions, and recognizing user emotions and optimizing the user experience based on the emotions.

[1111] Building a secure network

[1112] VPN Connection

[1113] The server runs virtual private network (VPN) software and uses the authentication information to connect to a VPN server, which protects the business network from unauthorized access.

[1114] Firewall settings

[1115] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[1116] Configuring encryption protocols

[1117] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[1118] Automating routine processes

[1119] Processing applications for public services

[1120] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[1121] Automation of resident registration and family register-related matters

[1122] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[1123] Cloud Interconnection and Backup

[1124] Cloud-to-cloud interconnection

[1125] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[1126] Data Backup

[1127] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[1128] Cooperation with financial institutions and postal institutions

[1129] Transaction collaboration with banks

[1130] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[1131] Business collaboration with the post office

[1132] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[1133] Introducing the Emotion Engine

[1134] emotion recognition

[1135] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as voice, text, and images.

[1136] Text analytics

[1137] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[1138] Audio analysis

[1139] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[1140] Image analysis

[1141] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[1142] Response Control

[1143] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[1144] Specific examples

[1145] If a user is feeling stressed while shopping online, the system can detect that emotion from their tone of voice and facial expressions. For example, if a user feels that a certain process is troublesome, the system can suggest that a limited-time discount is available on a specific product.

[1146] Example prompt sentence:

[1147] Users can sometimes feel stressed while shopping online. The EmotionPay system analyzes voice and facial expression data in real time to detect user emotions. It then provides useful suggestions and support to users based on the detected emotions, providing a stress-free payment experience. Please automate the API calls and data processing required for this program.

[1148] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1149] Step 1:

[1150] The server establishes the VPN connection by launching the VPN software and connecting to the VPN server using the authentication information. The inputs are the authentication information and the VPN server address, and the output is a secure communication path.

[1151] Step 2:

[1152] The server configures the firewall. Specifically, it edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers. The input is the IP addresses and port numbers to be allowed, and the output is a secure network environment.

[1153] Step 3:

[1154] The server obtains the SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. The input is the SSL / TLS certificate and the web server configuration, and the output is an encrypted communication channel.

[1155] Step 4:

[1156] A user accesses a public service application form using a terminal and inputs the required information. The input is the application data from the user, and the output is the data to be sent to the server.

[1157] Step 5:

[1158] The server stores the received application data in a database. The input is the application data received from the user, and the output is the data stored in the database.

[1159] Step 6:

[1160] The server notifies the user that the process is complete by sending a confirmation email. The input is the notification of the process completion, and the output is the email sent to the user.

[1161] Step 7:

[1162] When a user applies for a resident certificate, the server accesses the resident database to search for the applicant's information. The input is the user's application data and the resident database, and the output is the search result.

[1163] Step 8:

[1164] The server automatically generates the necessary documents and attaches a digital signature to them. The input is the search results, and the output is the document with the digital signature attached.

[1165] Step 9:

[1166] The server emails the generated document to the user. The input is the document with the digital signature, and the output is the email to the user.

[1167] Step 10:

[1168] The server monitors interconnections between multiple cloud environments. The input is connection information and heartbeat signals of the cloud environments, and the output is the result of continuous monitoring of the connection status.

[1169] Step 11:

[1170] The server periodically backs up data and transfers the database snapshot to the second cloud. The input is the database snapshot, and the output is the backup data stored in the second cloud.

[1171] Step 12:

[1172] A user uses a terminal to submit a request to pay tax online. The input is the user's request data, and the output is the data sent to the server.

[1173] Step 13:

[1174] The server connects to the bank's API and debits the account using the user's credentials. The inputs are the user's credentials and the transaction details, and the output is the transaction result.

[1175] Step 14:

[1176] The server notifies the user that the transaction is complete. The input is the transaction result, and the output is a notification to the user.

[1177] Step 15:

[1178] When a user requests a postal transaction, the server sends the information to the post office's system. The input is the user's request data, and the output is the data to be sent to the post office.

[1179] Step 16:

[1180] After receiving a confirmation from the post office, the server notifies the user that the transaction is complete. The input is the confirmation data from the post office, and the output is a notification to the user.

[1181] Step 17:

[1182] When a user interacts with the system, the server uses an emotion engine to recognize the user's emotions. The input is the user's voice, text, and image data, and the output is their emotional state.

[1183] Step 18:

[1184] The server generates an appropriate response based on the emotion recognized by the emotion engine. The input is the emotional state, and the output is the appropriate response or support content.

[1185] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1186] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1187] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1188] [Third embodiment]

[1189] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1190] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1191] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1192] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1193] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1194] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1195] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1196] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1197] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1198] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1199] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1200] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1201] The system of the present invention provides functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions. The following describes specific embodiments of the system.

[1202] Building a secure network

[1203] VPN Connection

[1204] The server runs virtual private network (VPN) software and uses the credentials to connect to a VPN server, which protects the business network from unauthorized access.

[1205] Firewall settings

[1206] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[1207] Configuring encryption protocols

[1208] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[1209] Automating routine processes

[1210] Processing applications for public services

[1211] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[1212] Automation of resident registration and family register-related matters

[1213] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[1214] Cloud Interconnection and Backup

[1215] Cloud-to-cloud interconnection

[1216] The server is configured to ensure interconnection between multiple cloud environments. To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs on one of the clouds.

[1217] Data Backup

[1218] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[1219] Cooperation with financial institutions and postal institutions

[1220] Transaction collaboration with banks

[1221] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[1222] Business collaboration with the post office

[1223] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[1224] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[1225] The processing flow will be explained below.

[1226] Building a secure network

[1227] Step 1:

[1228] The server runs the VPN software.

[1229] Step 2:

[1230] The server connects to the VPN server using the authentication information (username and password).

[1231] Step 3:

[1232] The server verifies that the VPN connection has been established and monitors the connection status.

[1233] Step 4:

[1234] The server opens the firewall configuration file.

[1235] Step 5:

[1236] The server adds allowed IP addresses and port numbers to a configuration file.

[1237] Step 6:

[1238] The server will save the firewall settings and restart.

[1239] Step 7:

[1240] The server obtains an SSL / TLS certificate.

[1241] Step 8:

[1242] The server adds settings to the web server configuration file to enable SSL / TLS.

[1243] Step 9:

[1244] The server will restart the web server to reflect the settings.

[1245] Automating routine processes

[1246] Step 1:

[1247] A user uses a terminal to access a utility service application form.

[1248] Step 2:

[1249] The user enters the necessary information into the application form.

[1250] Step 3:

[1251] The user clicks the application button.

[1252] Step 4:

[1253] The server receives the application data.

[1254] Step 5:

[1255] The server stores the application data in a database.

[1256] Step 6:

[1257] The server will notify the user by email that the process is complete.

[1258] Step 7:

[1259] The user applies for a resident certificate online.

[1260] Step 8:

[1261] The server accesses a resident database and retrieves the applicant's information.

[1262] Step 9:

[1263] The server automatically generates the necessary documents.

[1264] Step 10:

[1265] The server affixes an electronic signature to the automatically generated document.

[1266] Step 11:

[1267] The server then emails the document with the electronic signature to the user.

[1268] Cloud Interconnection and Backup

[1269] Step 1:

[1270] The server checks the connection settings for NTT Cloud and au Cloud.

[1271] Step 2:

[1272] The server monitors the connection between both clouds using a HeartBeat function.

[1273] Step 3:

[1274] The server periodically checks the connection status between the clouds.

[1275] Step 4:

[1276] The server sets up a regular data backup schedule.

[1277] Step 5:

[1278] When it's time for a backup, the server creates a snapshot of the database.

[1279] Step 6:

[1280] The server transfers the snapshot to the second cloud.

[1281] Cooperation with banks and post offices

[1282] Step 1:

[1283] The user uses the terminal to submit a request to pay the tax online.

[1284] Step 2:

[1285] The server receives the request and connects to the bank's API.

[1286] Step 3:

[1287] The server uses the user's authentication information to access the bank account and debit the required amount.

[1288] Step 4:

[1289] The server notifies the user of the transaction result.

[1290] Step 5:

[1291] The user submits a request for a mail transaction.

[1292] Step 6:

[1293] The server sends the transaction information to the post office system.

[1294] Step 7:

[1295] The server receives a confirmation reply from the post office.

[1296] Step 8:

[1297] The server will send a notification to the user that the transaction is complete.

[1298] Example 1

[1299] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1300] The current system faces many challenges, including security vulnerabilities, inefficient routine processing, complex data exchange between cloud environments, a lack of a secure data backup method, and complex collaboration with financial institutions and postal organizations. These challenges are particularly significant when it comes to operations involving sensitive information.

[1301] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1302] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, and a means for coordinating with financial institutions and postal institutions, thereby significantly improving the safety and efficiency of the system and enabling fast and safe processing, particularly when providing public services.

[1303] "Secure communication" means that data is protected from unauthorized access or interception from outside.

[1304] "Routine processing" refers to a series of operations that automatically execute repetitive business processes and procedures.

[1305] A "cloud environment" refers to a computer network infrastructure that allows data and applications to be stored and accessed on remote servers via the Internet.

[1306] A "backup" is the process of duplicating data and storing it in case the original data is lost.

[1307] "Financial institution" refers to an organization or establishment that provides financial services, such as a bank or credit union.

[1308] "Postal agency" means any public or private organization that collects and delivers mail.

[1309] A "virtual private network" is a virtual dedicated line for securely sending and receiving data over the Internet.

[1310] A "firewall" is a device or software that blocks unauthorized traffic to enhance network security.

[1311] An "encryption protocol" is a communication protocol that encrypts data so that only the sender and receiver can read it.

[1312] "Public services" refers to administrative services provided by the national government and local governments.

[1313] A "resident card" is a certificate of residence issued to residents by local governments.

[1314] An "electronic signature" is an electronic signature that the creator of digital data affixes to that data, and is used to prevent data tampering and to authenticate the data.

[1315] "Cloud interconnection" is a mechanism that enables seamless collaboration between data and services across different cloud providers.

[1316] A "database" is a system for efficiently storing, searching, and managing data.

[1317] A "snapshot" refers to the process of recording and saving the state of data or a system at a certain point in time.

[1318] "OAuth authentication" is an open standard protocol that allows users to authorize third-party applications to access their resources.

[1319] The system of the present invention provides the functionality to establish secure communications, automate routine processes, interconnect multiple cloud environments, back up data, and collaborate with financial institutions and postal institutions.

[1320] Establishing Secure Communications

[1321] VPN Connection

[1322] The server runs virtual private network (VPN) software and connects to the VPN server using the credentials. The specific software used is OpenVPN. This connection protects the business network from unauthorized access from outside.

[1323] Firewall settings

[1324] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, using the tool iptables, so that only allowed traffic can access the network.

[1325] Configuring encryption protocols

[1326] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. In this case, the specific software is Let's Encrypt and Nginx. This encrypts and protects communication between the user and the server.

[1327] Automating routine processes

[1328] Processing applications for public services

[1329] The user accesses the application form for the public service using a terminal and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database. The specific software used is PHP and MySQL. Once processing is complete, the server sends a confirmation email to the user using the SMTP protocol. This ensures that application processing is fast and accurate.

[1330] Automation of resident registration and family register-related matters

[1331] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. The specific tools used are an Oracle database and electronic signature software. This allows users to quickly receive the necessary documents.

[1332] Cloud Interconnection and Backup

[1333] Cloud-to-cloud interconnection

[1334] The server is configured to ensure interconnection between multiple cloud environments (e.g., domestic cloud A and domestic cloud B). To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs in one of the clouds.

[1335] Data Backup

[1336] The server schedules regular data backups, creates snapshots of the database, and transfers them to the second cloud using AWS S3 and MySQL snapshot features, which minimizes the risk of data loss.

[1337] Cooperation with financial institutions and postal institutions

[1338] Transaction collaboration with banks

[1339] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API and debits the account with the user's credentials. The specific tools used are REST API and the OAuth authentication system. Once the transaction is complete, the server notifies the user of the result.

[1340] Business collaboration with the post office

[1341] When a user requests a postal transaction, the server sends the information to the post office's system using a SOAP API. After receiving a confirmation from the post office, the server notifies the user that the transaction is complete.

[1342] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[1343] Example prompts for generative AI models

[1344] "Please explain in natural language the process of the city hall's resident registration system. Please provide details of the steps a user takes to apply online and the processes the system performs in the background."

[1345] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1346] Establishing Secure Communications

[1347] Step 1:

[1348] The server launches the VPN software (e.g., OpenVPN). It uses the VPN configuration file and authentication information as input. The VPN configuration file contains the server's IP address, port number, and encryption method. The output is a VPN connection established. Specifically, it sends the authentication information and receives a successful connection response from the VPN server.

[1349] Step 2:

[1350] The server edits the firewall configuration file. As input, it adds a rule that allows a specific IP address and port number. Specifically, it updates the configuration file using the iptables command. The output is the updated firewall configuration file. Specifically, after the settings are reflected, it runs a test command to confirm that the settings have been reflected correctly.

[1351] Step 3:

[1352] The server obtains an SSL / TLS certificate. As input, it connects to the Let's Encrypt API and sends a CSR (Certificate Signing Request). The output is the obtained SSL / TLS certificate. Specifically, it adds the obtained certificate to the configuration file of the web server (e.g., Nginx), restarts Nginx, and establishes encrypted communication.

[1353] Automating routine processes

[1354] Step 4:

[1355] A user accesses a public service application form using a terminal. As input, the user enters necessary information such as name, address, and application details. The output is the entered form data. Specifically, the user clicks the application button, and the data is sent to the server.

[1356] Step 5:

[1357] The server processes the received form data. As input, it receives the form data submitted by the user. As data processing, it validates the data using a PHP script and saves it to a MySQL database. The output is the data saved in the database. Specifically, if the save is successful, it generates an SMTP request to send a confirmation email to the user.

[1358] Step 6:

[1359] The server automates the application for issuing a resident certificate. As input, it receives request data for issuing a resident certificate from the user. As data calculation, it accesses the resident database and searches for the necessary information. The output is a resident certificate with an electronic signature. Specifically, it creates the generated resident certificate in PDF format, adds an electronic signature, and sends it to the user by email.

[1360] Cloud Interconnection and Backup

[1361] Step 7:

[1362] The server sets up interconnections between clouds. It uses connection information between two cloud providers (e.g., domestic cloud A and domestic cloud B) as input. Specific operations include using Heartbeat software to monitor the connection status. The output shows that the interconnection has been established. If an abnormality occurs, a log is generated that automatically switches the connection to another cloud.

[1363] Step 8:

[1364] The server performs data backup. As input, it uses a schedule setting to create a snapshot of the MySQL database. As data processing, it generates a snapshot and uploads it to AWS S3. The output is a notification that the backup is complete. Specifically, after the backup process is complete, it logs "The database snapshot has been uploaded to AWS S3."

[1365] Cooperation with financial institutions and postal institutions

[1366] Step 9:

[1367] The user submits a tax payment request online using a terminal. As input, the user enters tax payment details. The output is the request data sent to the server. The specific action is to click the pay button.

[1368] Step 10:

[1369] The server connects to the bank's API. As input, it uses the tax payment request data and user authentication information. As data calculation, it accesses the bank system via the REST API and performs OAuth authentication. The output is a notification of the payment result. Specifically, once the transaction is completed, it generates and sends an email notifying the user of the result.

[1370] Step 11:

[1371] A user requests a transaction by mail. As input, they enter details about the transaction. The output is the request data sent to the server. The specific action is to click the request button.

[1372] Step 12:

[1373] The server connects to the post office system. As input, it receives the user's request data. As data processing, it accesses the post office system using the SOAP API and sends the transaction information. The output is a notification of transaction completion. As a specific operation, after receiving a confirmation reply, it generates and sends an email notifying the user that the transaction has been completed.

[1374] (Application example 1)

[1375] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1376] In today's digital society, users of financial institutions and public services are required to manage their data in multiple cloud environments and to carry out transactions and service requests quickly and securely through secure networks. This requires mitigating security risks, automating data backups, and seamless integration with financial institutions and postal organizations. However, managing and operating these systems separately can be time-consuming and resource-intensive. It can also be difficult to ensure high levels of security to prevent security threats and unauthorized network access.

[1377] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1378] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, a means for processing applications for public services using terminals for secure transactions, and a means for enhancing security using VPN connections, firewall settings, and SSL / TLS encrypted communications. This allows users to conduct financial transactions and apply for public services on a network with multiple layers of security through a centralized system. Furthermore, data linkage and automatic backup between clouds improves data reliability and service continuity.

[1379] "Secure communication" refers to a safe network connection that is protected from unauthorized access using a virtual private network or SSL / TLS encrypted communication, etc.

[1380] "Routine processing" refers to the process of improving efficiency by automating routine procedures.

[1381] "Cloud environment" refers to a virtual server environment that includes data storage and computing resources provided via the Internet.

[1382] "Interconnection" refers to a connection method that enables seamless availability of data and services between different systems and cloud providers.

[1383] "Data backup" refers to a method of reducing the risk of data loss by regularly duplicating important data and storing it in a different location.

[1384] "Financial institution" means an organization that provides financial services, such as a bank or credit card company.

[1385] "Postal institution" means an organization or institution that provides postal services, including the collection, delivery, and sending of mail.

[1386] "Terminal" refers to a device used by a User, such as a computer, smartphone, or tablet.

[1387] "VPN connection" refers to technology that establishes a secure communication path using a virtual private network.

[1388] "Firewall Settings" means security settings that control or allow traffic to protect a network from unauthorized access.

[1389] "SSL / TLS encrypted communication" refers to a protocol that encrypts communication content to prevent data eavesdropping and tampering.

[1390] The system for implementing the present invention includes a terminal for conducting secure transactions, a server for establishing secure communications, and a program for providing interconnection and data backup functions between multiple cloud environments. The components of this system and their specific operations will be described below.

[1391] Hardware and Software Configuration

[1392] 1. Terminal

[1393] A terminal is a device used by a user, such as a computer, smartphone, or tablet, on which a secure trading application is installed.

[1394] 2. Server

[1395] The server establishes secure communications, automates routine processes, interconnects multiple cloud environments, and backs up data. It also manages collaboration with financial institutions and postal agencies.

[1396] The specific software used

[1397] VPN Services: Establish a secure VPN connection using off-the-shelf or open-source VPN software such as OpenVPN.

[1398] SSL / TLS libraries: Use libraries such as OpenSSL to set up encrypted data communications.

[1399] Web server: Uses Apache or Nginx to provide web services.

[1400] REST API: Provides APIs used for processing public service applications and backing up data.

[1401] Processing Details

[1402] 1. Establishing secure communications

[1403] The server uses VPN software (e.g., OpenVPN) to set up a virtual private network and encrypt communications between the device and the server, preventing unauthorized access from outside.

[1404] The server also uses firewall settings to allow only specific IP addresses and port numbers, and obtains an SSL / TLS certificate to encrypt web server communications.

[1405] 2. Automating routine processes

[1406] When a user applies for a public service using a terminal, the data is sent to the server via a web server, which receives the data and processes it automatically.

[1407] For example, when a user applies for a resident registration certificate, the server extracts the necessary data from the resident database and automatically generates the necessary documents. The documents are then digitally signed and sent to the user's email address.

[1408] 3. Cloud interconnection and data backup

[1409] The server shares data between multiple cloud environments. This includes, for example, seamless data exchange between NTT Cloud and au Cloud. Connections between different providers are monitored by a heartbeat function, and in the event of a failure, the server immediately switches to a backup.

[1410] The server also periodically takes snapshots of the data on an automated schedule and transfers the data to a second cloud, minimizing the risk of data loss.

[1411] Specific examples

[1412] Let's take the example of a user applying for a resident registration card using a secure transaction app. The user launches the app installed on their smartphone, enters the required information, and clicks the "Apply" button. The server receives the data, automatically generates and approves the resident registration card, and sends an electronic copy to the user's email address. During this process, the data is securely transmitted via a VPN connection and SSL / TLS encryption. This data is also backed up in the cloud, ensuring data safety even in the event of a system failure.

[1413] Prompt Sentence Examples

[1414] "Create a story where a user applies for a residence certificate using the Secure Transaction app, receives a secure digital residence certificate to their email address, and their data is backed up."

[1415] With this configuration, the present invention has the effect of enhancing security while enabling efficient use of public services and minimizing the risk of data loss and system failure.

[1416] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1417] Step 1:

[1418] Terminal: The user launches the secure transaction app on their smartphone. The user inputs the information required to apply for public services (e.g., name, address, application details). The input information is sent from the terminal to the server.

[1419] Step 2:

[1420] Server: The server first establishes a VPN connection to process the received user data. The input is the application data sent from the terminal. A secure communication path is set up using VPN software (e.g., OpenVPN) to prevent unauthorized access from outside. The output is the data being sent through the secure network.

[1421] Step 3:

[1422] Server: The server applies firewall rules, allowing only specific IP addresses and port numbers. Input: Network traffic after VPN connection is established. Edit firewall settings to allow only allowed traffic to access the network. Output: Secure connection established.

[1423] Step 4:

[1424] Server: The server sets up SSL / TLS encrypted communication and encrypts data. The input is traffic from a securely connected network. An SSL / TLS certificate is obtained and settings to enable encrypted communication are added to the web server configuration file. The output is encrypted data communication.

[1425] Step 5:

[1426] Server: The server automates the application process for public services. The input is the user's application data. The server accesses the database and automatically processes the application information. For example, when an application is made for the issuance of a resident certificate, the server extracts data from the resident database and generates the necessary documents. The output is the generated document with an electronic signature.

[1427] Step 6:

[1428] Server: The server uses a mail server to send an email to the user to deliver the generated document. The input is the generated digitally signed document and the user's email address. The server uses this information to send a confirmation email. The output is a confirmation email sent to the user's inbox.

[1429] Step 7:

[1430] Server: The server performs regular data backups. The input is the latest user data and system status. According to a schedule, a snapshot of the database is created and transferred to the second cloud. The output is the backed-up data.

[1431] Step 8:

[1432] Server: Monitors interconnections between cloud environments and ensures seamless data integration. Input is heartbeat data from each cloud environment. If the server detects an abnormality, it immediately switches to the second cloud. Output ensures continuous data availability.

[1433] In this way, the system allows users to securely and efficiently access public services and conduct safe transactions over a network with multiple layers of security.

[1434] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1435] The system of the present invention combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, as well as an emotion engine that recognizes user emotions. A specific embodiment of the system will be described below.

[1436] Building a secure network

[1437] VPN Connection

[1438] The server launches the VPN software and connects to the VPN server using the authentication information, protecting the business network from unauthorized access from outside.

[1439] Firewall settings

[1440] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[1441] Configuring encryption protocols

[1442] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[1443] Automating routine processes

[1444] Processing applications for public services

[1445] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[1446] Automation of resident registration and family register-related matters

[1447] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[1448] Cloud Interconnection and Backup

[1449] Cloud-to-cloud interconnection

[1450] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[1451] Data Backup

[1452] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[1453] Cooperation with financial institutions and postal institutions

[1454] Transaction collaboration with banks

[1455] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[1456] Business collaboration with the post office

[1457] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[1458] Introducing the Emotion Engine

[1459] emotion recognition

[1460] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as text, voice, and images.

[1461] Text analytics

[1462] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[1463] Audio analysis

[1464] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[1465] Image analysis

[1466] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[1467] Response Control

[1468] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[1469] As a result, the system of the present invention is expected to further improve the user experience by responding to the user's emotions as well as linking with public services and financial institutions. As a specific example, in a city hall online application system, when a user feels stressed, the system can provide interactions such as displaying guidance or encouraging messages.

[1470] The processing flow will be explained below.

[1471] Building a secure network

[1472] Step 1:

[1473] The server runs the VPN software.

[1474] Step 2:

[1475] The server connects to the VPN server using the authentication information (username and password).

[1476] Step 3:

[1477] The server verifies that the VPN connection has been established.

[1478] Step 4:

[1479] The server opens the firewall configuration file.

[1480] Step 5:

[1481] The server adds allowed IP addresses and port numbers to a configuration file.

[1482] Step 6:

[1483] The server will save the firewall settings and restart.

[1484] Step 7:

[1485] The server obtains an SSL / TLS certificate.

[1486] Step 8:

[1487] The server adds settings to the web server configuration file to enable SSL / TLS.

[1488] Step 9:

[1489] The server will restart the web server to reflect the settings.

[1490] Automating routine processes

[1491] Step 1:

[1492] A user uses a terminal to access a utility service application form.

[1493] Step 2:

[1494] The user enters the necessary information into the application form.

[1495] Step 3:

[1496] The user clicks the application button.

[1497] Step 4:

[1498] The server receives the application data.

[1499] Step 5:

[1500] The server stores the application data in a database.

[1501] Step 6:

[1502] The server will notify the user by email that the process is complete.

[1503] Step 7:

[1504] The user applies for a resident certificate online.

[1505] Step 8:

[1506] The server accesses a resident database and retrieves the applicant's information.

[1507] Step 9:

[1508] The server automatically generates the necessary documents.

[1509] Step 10:

[1510] The server affixes an electronic signature to the automatically generated document.

[1511] Step 11:

[1512] The server then emails the document with the electronic signature to the user.

[1513] Cloud Interconnection and Backup

[1514] Step 1:

[1515] The server checks the connection settings between NTT Cloud and other companies' clouds.

[1516] Step 2:

[1517] The server monitors the connection between both clouds using a HeartBeat function.

[1518] Step 3:

[1519] The server periodically checks the connection status between the clouds.

[1520] Step 4:

[1521] The server sets up a regular data backup schedule.

[1522] Step 5:

[1523] When it's time for a backup, the server creates a snapshot of the database.

[1524] Step 6:

[1525] The server transfers the snapshot to the second cloud.

[1526] Cooperation with financial institutions and postal institutions

[1527] Step 1:

[1528] The user uses the terminal to submit a request to pay the tax online.

[1529] Step 2:

[1530] The server receives the request and connects to the bank's API.

[1531] Step 3:

[1532] The server uses the user's authentication information to access the bank account and debit the required amount.

[1533] Step 4:

[1534] The server notifies the user of the transaction result.

[1535] Step 5:

[1536] The user submits a request for a mail transaction.

[1537] Step 6:

[1538] The server sends the transaction information to the post office system.

[1539] Step 7:

[1540] The server receives a confirmation reply from the post office.

[1541] Step 8:

[1542] The server will send a notification to the user that the transaction is complete.

[1543] Introducing the Emotion Engine

[1544] Step 1:

[1545] A user accesses the system using a terminal and uses the service.

[1546] Step 2:

[1547] The server performs text analysis on each text entered by the user as it is submitted, identifying sentiment from keywords and context.

[1548] Step 3:

[1549] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[1550] Step 4:

[1551] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[1552] Step 5:

[1553] The server generates an appropriate response based on the emotion recognized by the emotion engine.

[1554] Step 6:

[1555] The server generates a response that is then displayed or sent to the user.

[1556] Step 7:

[1557] The user receives the response from the server and begins the next interaction.

[1558] This process allows the system to generate responses that reflect the user's emotions and provide more personalized services. For example, in a city hall's online application system, if a user is feeling stressed, the server can display encouraging messages or guidance to the user. This improves the user experience and encourages service use.

[1559] Example 2

[1560] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1561] Previous systems provided separate functions for secure communications, automated routine processes, connectivity between multiple cloud environments, and data backup, but few systems comprehensively integrated these functions. Furthermore, they lacked the ability to recognize user emotions and dynamically respond, creating challenges in improving the user experience. Furthermore, there was a need for a system that provided a seamless interface for collaboration with financial institutions and postal institutions.

[1562] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1563] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, and a means including an emotion engine that recognizes user emotions. This ensures secure communications, enables efficient and automated routine processes, safe data backup, and seamless data linkage between multiple clouds. Furthermore, by responding to user emotions, an improved user experience can be expected.

[1564] "Secure communication" refers to a highly secure means of communication that prevents unauthorized access from outside, data tampering, and information leaks.

[1565] "Automation of routine processes" is a means of increasing efficiency by automating repetitive tasks that have set procedures.

[1566] A "cloud environment" is a virtualized IT infrastructure that uses data storage and computing resources provided via the Internet.

[1567] "Means of interconnection" refers to a communication method that enables data exchange and collaboration between multiple cloud environments.

[1568] "Means for backing up data" refers to a method for regularly copying and saving data in preparation for data loss or corruption.

[1569] A "financial institution" is an organization that manages and administers funds, such as a bank or credit company.

[1570] A "postal organization" is an organization that provides mail delivery and logistics services.

[1571] An "emotion engine" is software or a system that analyzes input data such as text, voice, and images from a user and identifies the user's emotions.

[1572] The present invention is a system that combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, with an emotion engine that recognizes user emotions. An embodiment of the system will be described in detail below.

[1573] Building a secure network

[1574] VPN Connection

[1575] The server uses OpenVPN software to connect to a VPN server using authentication information (username, password, certificate), which protects the business network from unauthorized access from outside.

[1576] Example: A company's employees use this VPN connection to connect to a secure internal network when working remotely.

[1577] Firewall settings

[1578] The server edits firewall configuration files, such as iptables or pfSense, and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[1579] Example: In a corporate network, an administrator configures the network to allow access only from a specific server room.

[1580] Configuring encryption protocols

[1581] The server obtains an SSL / TLS certificate from a certificate authority such as Let's Encrypt and adds settings to the web server (Apache or NGINX) configuration file to enable encrypted communication, which encrypts and protects communication between the user and the server.

[1582] Example: Used by online shopping sites to securely transmit users' credit card information.

[1583] Automating routine processes

[1584] Processing applications for public services

[1585] The user accesses the application form for the public service using a device (browser or dedicated app) and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database (MySQL or PostgreSQL). Once processing is complete, the server uses the SMTP server to send a confirmation email to the user.

[1586] Example: When a resident applies for a residence certificate on a local government website.

[1587] Automation of resident registration and family register-related matters

[1588] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information and automatically generates the necessary documents in PDF format. The generated PDF is digitally signed and the server then emails it to the user.

[1589] Example: The procedure for transferring your residence registration to your new residence when moving.

[1590] Cloud Interconnection and Backup

[1591] Cloud-to-cloud interconnection

[1592] The server stores API credentials for multiple cloud environments (AWS and Azure) in a configuration file, connects to both clouds, initiates data synchronization, and monitors the connection status with a heartbeat function.

[1593] Example: An e-commerce company replicating data between AWS and Azure.

[1594] Data Backup

[1595] Schedule regular backups of your servers using cron jobs, AWS Lambda, etc. Create snapshots of your databases and transfer them to a second cloud storage location such as Google Cloud Storage or an S3 bucket.

[1596] Example: A financial institution periodically backs up customer transaction information.

[1597] Cooperation with financial institutions and postal institutions

[1598] Transaction collaboration with banks

[1599] The user uses a terminal to access an online payment form and enters the information. The server receives this information, connects to the bank's API, sends the user's authentication information, debits the required amount from the account, and notifies the user of the transaction result.

[1600] Example: A local government accepts online payments for resident taxes.

[1601] Business collaboration with the post office

[1602] When a user requests a postal transaction, the server sends the transaction information to the post office API, receives a confirmation reply from the post office, and notifies the user that the transaction is complete.

[1603] Example: When checking the shipping status of an item from an online shop.

[1604] Introducing the Emotion Engine

[1605] emotion recognition

[1606] The server uses emotion engines such as IBM Watson and Google Cloud Natural Language API to recognize the user's emotions as they interact with the system.

[1607] Example prompt: "If a user feels stressed while applying on the city hall's online application system, what message can be displayed to make the user feel more at ease?"

[1608] Text analytics

[1609] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions.

[1610] Example prompt: "When a user says, 'I'm tired today,' how should the system respond?"

[1611] Audio analysis

[1612] When a user interacts with the system through voice, the server analyzes the voice data to identify emotions.

[1613] Example prompt: "How should the system respond if the user speaks in an excited voice?"

[1614] Image analysis

[1615] When a user accesses the system using a camera, the server analyzes the image data to identify emotions.

[1616] Example prompt: "If a user sends a picture of a smiling face, how should the system respond?"

[1617] Response Control

[1618] The server generates and sends an appropriate response to the user based on the emotion recognized by the emotion engine.

[1619] Example: In a local government online application system, when a user feels stressed, the system displays a guide message such as, "The necessary steps will be shown step by step, so please remain calm and proceed."

[1620] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1621] Step 1:

[1622] The user accesses the system using a device (browser or dedicated app). The user opens the application form for a public service, enters the required information, and clicks the application button. The user's input includes name, address, application details, etc.

[1623] Input: Application information entered by the user (name, address, application details, etc.)

[1624] Output: Trigger to send application information

[1625] What happens: A user enters information into a web form and clicks the "Submit" button, which sends an HTTP POST request to the server.

[1626] Step 2:

[1627] The server receives the application form data sent from the user and validates it, checking that it has been entered in the correct format and that it does not contain any invalid data.

[1628] Input: Application form data sent by the user

[1629] Output: Validation result (success / failure)

[1630] Specific behavior: The server parses the form data (e.g., JSON format), checks the format and required fields of each field, and decides whether to return an error message to the user or proceed to the next step.

[1631] Step 3:

[1632] The server saves the validated application data in a database (MySQL or PostgreSQL), and then adds a new record to the database as a result.

[1633] Input: Successfully validated application data

[1634] Output: Application records stored in the database

[1635] Specific behavior: The server executes an SQL query such as "INSERT INTO applications (name, address, application_type) VALUES ('John Doe', '123 Main St', 'Resident Card')".

[1636] Step 4:

[1637] The server generates an application completion email and sends it to the user, which includes a notification of acceptance of the application and information about future procedures.

[1638] Input: Application record stored in the database

[1639] Output: A confirmation email to the user.

[1640] Specific operation: The server sends an "application confirmation email to the user" via the SMTP server. The subject will be something like "Subject: Notification of application completion" and the email body will say "Your application has been accepted."

[1641] Step 5:

[1642] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information, and automatically generates the necessary documents in PDF format based on the user's information.

[1643] Input: User request for issuance of resident certificate

[1644] Output: Generated PDF document

[1645] What it does: The server runs an SQL query like "SELECT FROM residents WHERE user_id = 'john_doe'" and generates a PDF using the FPDF library.

[1646] Step 6:

[1647] The server then affixes a digital signature to the generated PDF, ensuring the authenticity of the document.

[1648] Input: Generated PDF document

[1649] Output: PDF document with digital signature

[1650] Specific behavior: The server runs a command like "gpg --sign resident_certificate.pdf" to add a digital signature to the PDF.

[1651] Step 7:

[1652] The server then emails the generated PDF with the digital signature to the user, allowing them to receive the necessary documents.

[1653] Input: PDF document with digital signature

[1654] Output: PDF sent to user

[1655] Specific operation: The server uses an SMTP server to send a PDF with an electronic signature to the user with the subject "Notice of Resident Registration Issuance."

[1656] Step 8:

[1657] The server configures API credentials for multiple cloud environments (e.g. AWS and Azure), starts synchronizing data, and monitors connections with a heartbeat function.

[1658] Input: API credentials for your cloud environment

[1659] Output: Data synchronization and connection monitoring between cloud environments

[1660] Specific operations: The server executes the "aws configure" and "az login" commands, synchronizes data using rsync, and monitors the connection health using the heartbeat function.

[1661] Step 9:

[1662] The server schedules regular data backups using cron jobs or Lambda functions and transfers snapshots to a second cloud (Google Cloud Storage or S3).

[1663] Input: Schedule settings and data to be backed up

[1664] Output: Backup data stored in the second cloud

[1665] Specific operation: The server sets a schedule with "crontab -e", obtains a database backup with the command "pg_dump database_name > backup.sql", and transfers the backup with "gsutil cp backup.sql gs: / / bucket / ".

[1666] Step 10:

[1667] The user accesses the online payment form using a terminal, enters payment information, and submits it. The server receives the information, connects to the bank API, executes the transaction, and notifies the user of the result.

[1668] Input: Payment information entered by the user

[1669] Output: Transaction result and user notification

[1670] Specific operation: The server POSTs the user information to the endpoint "https: / / api.bank.com / transaction" and notifies the user of the transaction results by email.

[1671] Step 11:

[1672] When a user requests a postal transaction, the server sends the transaction information to the Post Office API, receives a confirmation reply, and sends a notification to the user that the transaction is complete.

[1673] Input: A mail transaction request from the user

[1674] Output: Transaction completion confirmation and user notification

[1675] Specific operation: The server POSTs to "https: / / api.postoffice.com / transaction" and notifies the user of the transaction results by email.

[1676] Step 12:

[1677] The server uses the user's text, voice, and image to activate the emotion engine and recognize emotions. Based on the recognized emotions, it generates an appropriate response and sends it to the user.

[1678] Input: User text, voice, and image data

[1679] Output: Emotion recognition results and generated responses

[1680] Specific operation: The server sends the text input to IBM Watson, retrieves the analysis results using "POST https: / / api.us-south.tone-analyzer.watson.cloud.ibm.com / instances / {instance_id} / v3 / tone", generates a response, and sends it to the user.

[1681] (Application example 2)

[1682] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1683] Modern electronic payment systems require security, automated processing, and data integration between cloud environments. Furthermore, to improve the user experience, they need the ability to recognize user emotions in real time and respond appropriately. However, meeting these requirements in a single system is technically complex, and current systems are not adequately capable. This has led to problems such as user frustration and cumbersome operation.

[1684] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for establishing secure communications, means for automating routine processing, means for interconnecting multiple cloud environments, means for backing up data, means for coordinating with financial institutions and postal institutions, means for recognizing emotions, and means for optimizing the user experience based on emotions. This not only ensures security and improves business efficiency, but also enables flexible responses according to the user's emotions.

[1685] "Secure communication" refers to a communication method that ensures the safety of information by using encryption technology and virtual private networks to prevent unauthorized access and data leaks.

[1686] A "routine process" is a series of standardized tasks that are set up in advance to streamline business operations and procedures and to be executed automatically.

[1687] "Means for interconnecting multiple cloud environments" refers to technologies and methods for seamlessly linking data and services between different cloud service providers.

[1688] "Data backup" is the process of regularly creating copies of data and storing them in different locations or storage to reduce the risk of data loss.

[1689] "Means for interfacing with financial institutions and postal institutions" refers to interfaces and protocols for sharing information between systems with banks, post offices, etc., to automate and streamline transactions and postal operations.

[1690] "Emotion recognition means" refers to algorithms and technologies that analyze data such as a user's voice, text, and images to detect and determine their emotional state.

[1691] The "means for optimizing user experience based on emotions" refers to a method and system for providing appropriate application responses and support in response to detected user emotions to enhance the user experience.

[1692] One embodiment of the present invention is a system and program for use in an electronic payment service. The system has functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, cooperating with financial institutions and postal institutions, and recognizing user emotions and optimizing the user experience based on the emotions.

[1693] Building a secure network

[1694] VPN Connection

[1695] The server runs virtual private network (VPN) software and uses the authentication information to connect to a VPN server, which protects the business network from unauthorized access.

[1696] Firewall settings

[1697] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[1698] Configuring encryption protocols

[1699] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[1700] Automating routine processes

[1701] Processing applications for public services

[1702] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[1703] Automation of resident registration and family register-related matters

[1704] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[1705] Cloud Interconnection and Backup

[1706] Cloud-to-cloud interconnection

[1707] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[1708] Data Backup

[1709] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[1710] Cooperation with financial institutions and postal institutions

[1711] Transaction collaboration with banks

[1712] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[1713] Business collaboration with the post office

[1714] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[1715] Introducing the Emotion Engine

[1716] emotion recognition

[1717] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as voice, text, and images.

[1718] Text analytics

[1719] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[1720] Audio analysis

[1721] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[1722] Image analysis

[1723] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[1724] Response Control

[1725] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[1726] Specific examples

[1727] If a user is feeling stressed while shopping online, the system can detect that emotion from their tone of voice and facial expressions. For example, if a user feels that a certain process is troublesome, the system can suggest that a limited-time discount is available on a specific product.

[1728] Example prompt sentence:

[1729] Users can sometimes feel stressed while shopping online. The EmotionPay system analyzes voice and facial expression data in real time to detect user emotions. It then provides useful suggestions and support to users based on the detected emotions, providing a stress-free payment experience. Please automate the API calls and data processing required for this program.

[1730] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1731] Step 1:

[1732] The server establishes the VPN connection by launching the VPN software and connecting to the VPN server using the authentication information. The inputs are the authentication information and the VPN server address, and the output is a secure communication path.

[1733] Step 2:

[1734] The server configures the firewall. Specifically, it edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers. The input is the IP addresses and port numbers to be allowed, and the output is a secure network environment.

[1735] Step 3:

[1736] The server obtains the SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. The input is the SSL / TLS certificate and the web server configuration, and the output is an encrypted communication channel.

[1737] Step 4:

[1738] A user accesses a public service application form using a terminal and inputs the required information. The input is the application data from the user, and the output is the data to be sent to the server.

[1739] Step 5:

[1740] The server stores the received application data in a database. The input is the application data received from the user, and the output is the data stored in the database.

[1741] Step 6:

[1742] The server notifies the user that the process is complete by sending a confirmation email. The input is the notification of the process completion, and the output is the email sent to the user.

[1743] Step 7:

[1744] When a user applies for a resident certificate, the server accesses the resident database to search for the applicant's information. The input is the user's application data and the resident database, and the output is the search result.

[1745] Step 8:

[1746] The server automatically generates the necessary documents and attaches a digital signature to them. The input is the search results, and the output is the document with the digital signature attached.

[1747] Step 9:

[1748] The server emails the generated document to the user. The input is the document with the digital signature, and the output is the email to the user.

[1749] Step 10:

[1750] The server monitors interconnections between multiple cloud environments. The input is connection information and heartbeat signals of the cloud environments, and the output is the result of continuous monitoring of the connection status.

[1751] Step 11:

[1752] The server periodically backs up data and transfers the database snapshot to the second cloud. The input is the database snapshot, and the output is the backup data stored in the second cloud.

[1753] Step 12:

[1754] A user uses a terminal to submit a request to pay tax online. The input is the user's request data, and the output is the data sent to the server.

[1755] Step 13:

[1756] The server connects to the bank's API and debits the account using the user's credentials. The inputs are the user's credentials and the transaction details, and the output is the transaction result.

[1757] Step 14:

[1758] The server notifies the user that the transaction is complete. The input is the transaction result, and the output is a notification to the user.

[1759] Step 15:

[1760] When a user requests a postal transaction, the server sends the information to the post office's system. The input is the user's request data, and the output is the data to be sent to the post office.

[1761] Step 16:

[1762] After receiving a confirmation from the post office, the server notifies the user that the transaction is complete. The input is the confirmation data from the post office, and the output is a notification to the user.

[1763] Step 17:

[1764] When a user interacts with the system, the server uses an emotion engine to recognize the user's emotions. The input is the user's voice, text, and image data, and the output is their emotional state.

[1765] Step 18:

[1766] The server generates an appropriate response based on the emotion recognized by the emotion engine. The input is the emotional state, and the output is the appropriate response or support content.

[1767] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1768] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1769] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1770] [Fourth embodiment]

[1771] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1772] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1773] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1774] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1775] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1776] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1777] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1778] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1779] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1780] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1781] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1782] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1783] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1784] The system of the present invention provides functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions. The following describes specific embodiments of the system.

[1785] Building a secure network

[1786] VPN Connection

[1787] The server runs virtual private network (VPN) software and uses the credentials to connect to a VPN server, which protects the business network from unauthorized access.

[1788] Firewall settings

[1789] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[1790] Configuring encryption protocols

[1791] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[1792] Automating routine processes

[1793] Processing applications for public services

[1794] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[1795] Automation of resident registration and family register-related matters

[1796] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[1797] Cloud Interconnection and Backup

[1798] Cloud-to-cloud interconnection

[1799] The server is configured to ensure interconnection between multiple cloud environments. To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs on one of the clouds.

[1800] Data Backup

[1801] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[1802] Cooperation with financial institutions and postal institutions

[1803] Transaction collaboration with banks

[1804] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[1805] Business collaboration with the post office

[1806] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[1807] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[1808] The processing flow will be explained below.

[1809] Building a secure network

[1810] Step 1:

[1811] The server runs the VPN software.

[1812] Step 2:

[1813] The server connects to the VPN server using the authentication information (username and password).

[1814] Step 3:

[1815] The server verifies that the VPN connection has been established and monitors the connection status.

[1816] Step 4:

[1817] The server opens the firewall configuration file.

[1818] Step 5:

[1819] The server adds allowed IP addresses and port numbers to a configuration file.

[1820] Step 6:

[1821] The server will save the firewall settings and restart.

[1822] Step 7:

[1823] The server obtains an SSL / TLS certificate.

[1824] Step 8:

[1825] The server adds settings to the web server configuration file to enable SSL / TLS.

[1826] Step 9:

[1827] The server will restart the web server to reflect the settings.

[1828] Automating routine processes

[1829] Step 1:

[1830] A user uses a terminal to access a utility service application form.

[1831] Step 2:

[1832] The user enters the necessary information into the application form.

[1833] Step 3:

[1834] The user clicks the application button.

[1835] Step 4:

[1836] The server receives the application data.

[1837] Step 5:

[1838] The server stores the application data in a database.

[1839] Step 6:

[1840] The server will notify the user by email that the process is complete.

[1841] Step 7:

[1842] The user applies for a resident certificate online.

[1843] Step 8:

[1844] The server accesses a resident database and retrieves the applicant's information.

[1845] Step 9:

[1846] The server automatically generates the necessary documents.

[1847] Step 10:

[1848] The server affixes an electronic signature to the automatically generated document.

[1849] Step 11:

[1850] The server then emails the document with the electronic signature to the user.

[1851] Cloud Interconnection and Backup

[1852] Step 1:

[1853] The server checks the connection settings for NTT Cloud and au Cloud.

[1854] Step 2:

[1855] The server monitors the connection between both clouds using a HeartBeat function.

[1856] Step 3:

[1857] The server periodically checks the connection status between the clouds.

[1858] Step 4:

[1859] The server sets up a regular data backup schedule.

[1860] Step 5:

[1861] When it's time for a backup, the server creates a snapshot of the database.

[1862] Step 6:

[1863] The server transfers the snapshot to the second cloud.

[1864] Cooperation with banks and post offices

[1865] Step 1:

[1866] The user uses the terminal to submit a request to pay the tax online.

[1867] Step 2:

[1868] The server receives the request and connects to the bank's API.

[1869] Step 3:

[1870] The server uses the user's authentication information to access the bank account and debit the required amount.

[1871] Step 4:

[1872] The server notifies the user of the transaction result.

[1873] Step 5:

[1874] The user submits a request for a mail transaction.

[1875] Step 6:

[1876] The server sends the transaction information to the post office system.

[1877] Step 7:

[1878] The server receives a confirmation reply from the post office.

[1879] Step 8:

[1880] The server will send a notification to the user that the transaction is complete.

[1881] Example 1

[1882] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1883] The current system faces many challenges, including security vulnerabilities, inefficient routine processing, complex data exchange between cloud environments, a lack of a secure data backup method, and complex collaboration with financial institutions and postal organizations. These challenges are particularly significant when it comes to operations involving sensitive information.

[1884] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1885] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, and a means for coordinating with financial institutions and postal institutions, thereby significantly improving the safety and efficiency of the system and enabling fast and safe processing, particularly when providing public services.

[1886] "Secure communication" means that data is protected from unauthorized access or interception from outside.

[1887] "Routine processing" refers to a series of operations that automatically execute repetitive business processes and procedures.

[1888] A "cloud environment" refers to a computer network infrastructure that allows data and applications to be stored and accessed on remote servers via the Internet.

[1889] A "backup" is the process of duplicating data and storing it in case the original data is lost.

[1890] "Financial institution" refers to an organization or establishment that provides financial services, such as a bank or credit union.

[1891] "Postal agency" means any public or private organization that collects and delivers mail.

[1892] A "virtual private network" is a virtual dedicated line for securely sending and receiving data over the Internet.

[1893] A "firewall" is a device or software that blocks unauthorized traffic to enhance network security.

[1894] An "encryption protocol" is a communication protocol that encrypts data so that only the sender and receiver can read it.

[1895] "Public services" refers to administrative services provided by the national government and local governments.

[1896] A "resident card" is a certificate of residence issued to residents by local governments.

[1897] An "electronic signature" is an electronic signature that the creator of digital data affixes to that data, and is used to prevent data tampering and to authenticate the data.

[1898] "Cloud interconnection" is a mechanism that enables seamless collaboration between data and services across different cloud providers.

[1899] A "database" is a system for efficiently storing, searching, and managing data.

[1900] A "snapshot" refers to the process of recording and saving the state of data or a system at a certain point in time.

[1901] "OAuth authentication" is an open standard protocol that allows users to authorize third-party applications to access their resources.

[1902] The system of the present invention provides the functionality to establish secure communications, automate routine processes, interconnect multiple cloud environments, back up data, and collaborate with financial institutions and postal institutions.

[1903] Establishing Secure Communications

[1904] VPN Connection

[1905] The server runs virtual private network (VPN) software and connects to the VPN server using the credentials. The specific software used is OpenVPN. This connection protects the business network from unauthorized access from outside.

[1906] Firewall settings

[1907] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, using the tool iptables, so that only allowed traffic can access the network.

[1908] Configuring encryption protocols

[1909] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication. In this case, the specific software is Let's Encrypt and Nginx. This encrypts and protects communication between the user and the server.

[1910] Automating routine processes

[1911] Processing applications for public services

[1912] The user accesses the application form for the public service using a terminal and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database. The specific software used is PHP and MySQL. Once processing is complete, the server sends a confirmation email to the user using the SMTP protocol. This ensures that application processing is fast and accurate.

[1913] Automation of resident registration and family register-related matters

[1914] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. The specific tools used are an Oracle database and electronic signature software. This allows users to quickly receive the necessary documents.

[1915] Cloud Interconnection and Backup

[1916] Cloud-to-cloud interconnection

[1917] The server is configured to ensure interconnection between multiple cloud environments (e.g., domestic cloud A and domestic cloud B). To achieve seamless data integration between different cloud providers, such as NTT Cloud and au Cloud, the heartbeat function is used to monitor the connection. This ensures continuous data availability even if a failure occurs in one of the clouds.

[1918] Data Backup

[1919] The server schedules regular data backups, creates snapshots of the database, and transfers them to the second cloud using AWS S3 and MySQL snapshot features, which minimizes the risk of data loss.

[1920] Cooperation with financial institutions and postal institutions

[1921] Transaction collaboration with banks

[1922] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API and debits the account with the user's credentials. The specific tools used are REST API and the OAuth authentication system. Once the transaction is complete, the server notifies the user of the result.

[1923] Business collaboration with the post office

[1924] When a user requests a postal transaction, the server sends the information to the post office's system using a SOAP API. After receiving a confirmation from the post office, the server notifies the user that the transaction is complete.

[1925] As a result, the system of the present invention can improve the efficiency of public services, strengthen security, improve data reliability, and achieve seamless collaboration with financial institutions and postal services. As a concrete example, consider a city hall's resident registration system, where users can apply online and receive the necessary documents quickly and safely. Furthermore, the risk of system failure and data loss is minimized, ensuring service continuity.

[1926] Example prompts for generative AI models

[1927] "Please explain in natural language the process of the city hall's resident registration system. Please provide details of the steps a user takes to apply online and the processes the system performs in the background."

[1928] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1929] Establishing Secure Communications

[1930] Step 1:

[1931] The server launches the VPN software (e.g., OpenVPN). It uses the VPN configuration file and authentication information as input. The VPN configuration file contains the server's IP address, port number, and encryption method. The output is a VPN connection established. Specifically, it sends the authentication information and receives a successful connection response from the VPN server.

[1932] Step 2:

[1933] The server edits the firewall configuration file. As input, it adds a rule that allows a specific IP address and port number. Specifically, it updates the configuration file using the iptables command. The output is the updated firewall configuration file. Specifically, after the settings are reflected, it runs a test command to confirm that the settings have been reflected correctly.

[1934] Step 3:

[1935] The server obtains an SSL / TLS certificate. As input, it connects to the Let's Encrypt API and sends a CSR (Certificate Signing Request). The output is the obtained SSL / TLS certificate. Specifically, it adds the obtained certificate to the configuration file of the web server (e.g., Nginx), restarts Nginx, and establishes encrypted communication.

[1936] Automating routine processes

[1937] Step 4:

[1938] A user accesses a public service application form using a terminal. As input, the user enters necessary information such as name, address, and application details. The output is the entered form data. Specifically, the user clicks the application button, and the data is sent to the server.

[1939] Step 5:

[1940] The server processes the received form data. As input, it receives the form data submitted by the user. As data processing, it validates the data using a PHP script and saves it to a MySQL database. The output is the data saved in the database. Specifically, if the save is successful, it generates an SMTP request to send a confirmation email to the user.

[1941] Step 6:

[1942] The server automates the application for issuing a resident certificate. As input, it receives request data for issuing a resident certificate from the user. As data calculation, it accesses the resident database and searches for the necessary information. The output is a resident certificate with an electronic signature. Specifically, it creates the generated resident certificate in PDF format, adds an electronic signature, and sends it to the user by email.

[1943] Cloud Interconnection and Backup

[1944] Step 7:

[1945] The server sets up interconnections between clouds. It uses connection information between two cloud providers (e.g., domestic cloud A and domestic cloud B) as input. Specific operations include using Heartbeat software to monitor the connection status. The output shows that the interconnection has been established. If an abnormality occurs, a log is generated that automatically switches the connection to another cloud.

[1946] Step 8:

[1947] The server performs data backup. As input, it uses a schedule setting to create a snapshot of the MySQL database. As data processing, it generates a snapshot and uploads it to AWS S3. The output is a notification that the backup is complete. Specifically, after the backup process is complete, it logs "The database snapshot has been uploaded to AWS S3."

[1948] Cooperation with financial institutions and postal institutions

[1949] Step 9:

[1950] The user submits a tax payment request online using a terminal. As input, the user enters tax payment details. The output is the request data sent to the server. The specific action is to click the pay button.

[1951] Step 10:

[1952] The server connects to the bank's API. As input, it uses the tax payment request data and user authentication information. As data calculation, it accesses the bank system via the REST API and performs OAuth authentication. The output is a notification of the payment result. Specifically, once the transaction is completed, it generates and sends an email notifying the user of the result.

[1953] Step 11:

[1954] A user requests a transaction by mail. As input, they enter details about the transaction. The output is the request data sent to the server. The specific action is to click the request button.

[1955] Step 12:

[1956] The server connects to the post office system. As input, it receives the user's request data. As data processing, it accesses the post office system using the SOAP API and sends the transaction information. The output is a notification of transaction completion. As a specific operation, after receiving a confirmation reply, it generates and sends an email notifying the user that the transaction has been completed.

[1957] (Application example 1)

[1958] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1959] In today's digital society, users of financial institutions and public services are required to manage their data in multiple cloud environments and to carry out transactions and service requests quickly and securely through secure networks. This requires mitigating security risks, automating data backups, and seamless integration with financial institutions and postal organizations. However, managing and operating these systems separately can be time-consuming and resource-intensive. It can also be difficult to ensure high levels of security to prevent security threats and unauthorized network access.

[1960] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1961] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, a means for processing applications for public services using terminals for secure transactions, and a means for enhancing security using VPN connections, firewall settings, and SSL / TLS encrypted communications. This allows users to conduct financial transactions and apply for public services on a network with multiple layers of security through a centralized system. Furthermore, data linkage and automatic backup between clouds improves data reliability and service continuity.

[1962] "Secure communication" refers to a safe network connection that is protected from unauthorized access using a virtual private network or SSL / TLS encrypted communication, etc.

[1963] "Routine processing" refers to the process of improving efficiency by automating routine procedures.

[1964] "Cloud environment" refers to a virtual server environment that includes data storage and computing resources provided via the Internet.

[1965] "Interconnection" refers to a connection method that enables seamless availability of data and services between different systems and cloud providers.

[1966] "Data backup" refers to a method of reducing the risk of data loss by regularly duplicating important data and storing it in a different location.

[1967] "Financial institution" means an organization that provides financial services, such as a bank or credit card company.

[1968] "Postal institution" means an organization or institution that provides postal services, including the collection, delivery, and sending of mail.

[1969] "Terminal" refers to a device used by a User, such as a computer, smartphone, or tablet.

[1970] "VPN connection" refers to technology that establishes a secure communication path using a virtual private network.

[1971] "Firewall Settings" means security settings that control or allow traffic to protect a network from unauthorized access.

[1972] "SSL / TLS encrypted communication" refers to a protocol that encrypts communication content to prevent data eavesdropping and tampering.

[1973] The system for implementing the present invention includes a terminal for conducting secure transactions, a server for establishing secure communications, and a program for providing interconnection and data backup functions between multiple cloud environments. The components of this system and their specific operations will be described below.

[1974] Hardware and Software Configuration

[1975] 1. Terminal

[1976] A terminal is a device used by a user, such as a computer, smartphone, or tablet, on which a secure trading application is installed.

[1977] 2. Server

[1978] The server establishes secure communications, automates routine processes, interconnects multiple cloud environments, and backs up data. It also manages collaboration with financial institutions and postal agencies.

[1979] The specific software used

[1980] VPN Services: Establish a secure VPN connection using off-the-shelf or open-source VPN software such as OpenVPN.

[1981] SSL / TLS libraries: Use libraries such as OpenSSL to set up encrypted data communications.

[1982] Web server: Uses Apache or Nginx to provide web services.

[1983] REST API: Provides APIs used for processing public service applications and backing up data.

[1984] Processing Details

[1985] 1. Establishing secure communications

[1986] The server uses VPN software (e.g., OpenVPN) to set up a virtual private network and encrypt communications between the device and the server, preventing unauthorized access from outside.

[1987] The server also uses firewall settings to allow only specific IP addresses and port numbers, and obtains an SSL / TLS certificate to encrypt web server communications.

[1988] 2. Automating routine processes

[1989] When a user applies for a public service using a terminal, the data is sent to the server via a web server, which receives the data and processes it automatically.

[1990] For example, when a user applies for a resident registration certificate, the server extracts the necessary data from the resident database and automatically generates the necessary documents. The documents are then digitally signed and sent to the user's email address.

[1991] 3. Cloud interconnection and data backup

[1992] The server shares data between multiple cloud environments. This includes, for example, seamless data exchange between NTT Cloud and au Cloud. Connections between different providers are monitored by a heartbeat function, and in the event of a failure, the server immediately switches to a backup.

[1993] The server also periodically takes snapshots of the data on an automated schedule and transfers the data to a second cloud, minimizing the risk of data loss.

[1994] Specific examples

[1995] Let's take the example of a user applying for a resident registration card using a secure transaction app. The user launches the app installed on their smartphone, enters the required information, and clicks the "Apply" button. The server receives the data, automatically generates and approves the resident registration card, and sends an electronic copy to the user's email address. During this process, the data is securely transmitted via a VPN connection and SSL / TLS encryption. This data is also backed up in the cloud, ensuring data safety even in the event of a system failure.

[1996] Prompt Sentence Examples

[1997] "Create a story where a user applies for a residence certificate using the Secure Transaction app, receives a secure digital residence certificate to their email address, and their data is backed up."

[1998] With this configuration, the present invention has the effect of enhancing security while enabling efficient use of public services and minimizing the risk of data loss and system failure.

[1999] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2000] Step 1:

[2001] Terminal: The user launches the secure transaction app on their smartphone. The user inputs the information required to apply for public services (e.g., name, address, application details). The input information is sent from the terminal to the server.

[2002] Step 2:

[2003] Server: The server first establishes a VPN connection to process the received user data. The input is the application data sent from the terminal. A secure communication path is set up using VPN software (e.g., OpenVPN) to prevent unauthorized access from outside. The output is the data being sent through the secure network.

[2004] Step 3:

[2005] Server: The server applies firewall rules, allowing only specific IP addresses and port numbers. Input: Network traffic after VPN connection is established. Edit firewall settings to allow only allowed traffic to access the network. Output: Secure connection established.

[2006] Step 4:

[2007] Server: The server sets up SSL / TLS encrypted communication and encrypts data. The input is traffic from a securely connected network. An SSL / TLS certificate is obtained and settings to enable encrypted communication are added to the web server configuration file. The output is encrypted data communication.

[2008] Step 5:

[2009] Server: The server automates the application process for public services. The input is the user's application data. The server accesses the database and automatically processes the application information. For example, when an application is made for the issuance of a resident certificate, the server extracts data from the resident database and generates the necessary documents. The output is the generated document with an electronic signature.

[2010] Step 6:

[2011] Server: The server uses a mail server to send an email to the user to deliver the generated document. The input is the generated digitally signed document and the user's email address. The server uses this information to send a confirmation email. The output is a confirmation email sent to the user's inbox.

[2012] Step 7:

[2013] Server: The server performs regular data backups. The input is the latest user data and system status. According to a schedule, a snapshot of the database is created and transferred to the second cloud. The output is the backed-up data.

[2014] Step 8:

[2015] Server: Monitors interconnections between cloud environments and ensures seamless data integration. Input is heartbeat data from each cloud environment. If the server detects an abnormality, it immediately switches to the second cloud. Output ensures continuous data availability.

[2016] In this way, the system allows users to securely and efficiently access public services and conduct safe transactions over a network with multiple layers of security.

[2017] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2018] The system of the present invention combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, as well as an emotion engine that recognizes user emotions. A specific embodiment of the system will be described below.

[2019] Building a secure network

[2020] VPN Connection

[2021] The server launches the VPN software and connects to the VPN server using the authentication information, protecting the business network from unauthorized access from outside.

[2022] Firewall settings

[2023] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[2024] Configuring encryption protocols

[2025] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[2026] Automating routine processes

[2027] Processing applications for public services

[2028] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data and stores it in a database. Once processing is complete, the server sends a confirmation email to the user. This ensures that application processing is fast and accurate.

[2029] Automation of resident registration and family register-related matters

[2030] When a user applies for a resident registration certificate, the server accesses the resident database to search for the applicant's information and automatically generates the necessary documents. The generated documents are then electronically signed and sent to the user by email. This allows the user to receive the necessary documents quickly.

[2031] Cloud Interconnection and Backup

[2032] Cloud-to-cloud interconnection

[2033] The server configures the interconnection between multiple cloud environments. To ensure seamless data exchange between different cloud providers, it uses a heartbeat function to monitor the connection. This ensures continuous data availability even if one of the clouds fails.

[2034] Data Backup

[2035] The server schedules regular data backups, takes snapshots of the database, and transfers them to the second cloud, minimizing the risk of data loss.

[2036] Cooperation with financial institutions and postal institutions

[2037] Transaction collaboration with banks

[2038] The user uses a terminal to send a request to pay taxes online. The server receives this request, connects to the bank's API, and debits the required amount from the account using the user's credentials. Once the transaction is complete, the server notifies the user of the result.

[2039] Business collaboration with the post office

[2040] When a user requests a postal transaction, the server sends the information to the post office's system. After receiving a confirmation reply from the post office, the server notifies the user that the transaction is complete.

[2041] Introducing the Emotion Engine

[2042] emotion recognition

[2043] As a user interacts with the system, the server recognizes the user's emotions using an emotion engine, which identifies the user's emotional state by analyzing inputs such as text, voice, and images.

[2044] Text analytics

[2045] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions from keywords and context.

[2046] Audio analysis

[2047] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[2048] Image analysis

[2049] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[2050] Response Control

[2051] The server generates an appropriate response based on the emotion recognized by the emotion engine: for example, if the user is stressed, the system responds with a gentler tone.

[2052] As a result, the system of the present invention is expected to further improve the user experience by responding to the user's emotions as well as linking with public services and financial institutions. As a specific example, in a city hall online application system, when a user feels stressed, the system can provide interactions such as displaying guidance or encouraging messages.

[2053] The processing flow will be explained below.

[2054] Building a secure network

[2055] Step 1:

[2056] The server runs the VPN software.

[2057] Step 2:

[2058] The server connects to the VPN server using the authentication information (username and password).

[2059] Step 3:

[2060] The server verifies that the VPN connection has been established.

[2061] Step 4:

[2062] The server opens the firewall configuration file.

[2063] Step 5:

[2064] The server adds allowed IP addresses and port numbers to a configuration file.

[2065] Step 6:

[2066] The server will save the firewall settings and restart.

[2067] Step 7:

[2068] The server obtains an SSL / TLS certificate.

[2069] Step 8:

[2070] The server adds settings to the web server configuration file to enable SSL / TLS.

[2071] Step 9:

[2072] The server will restart the web server to reflect the settings.

[2073] Automating routine processes

[2074] Step 1:

[2075] A user uses a terminal to access a utility service application form.

[2076] Step 2:

[2077] The user enters the necessary information into the application form.

[2078] Step 3:

[2079] The user clicks the application button.

[2080] Step 4:

[2081] The server receives the application data.

[2082] Step 5:

[2083] The server stores the application data in a database.

[2084] Step 6:

[2085] The server will notify the user by email that the process is complete.

[2086] Step 7:

[2087] The user applies for a resident certificate online.

[2088] Step 8:

[2089] The server accesses a resident database and retrieves the applicant's information.

[2090] Step 9:

[2091] The server automatically generates the necessary documents.

[2092] Step 10:

[2093] The server affixes an electronic signature to the automatically generated document.

[2094] Step 11:

[2095] The server then emails the document with the electronic signature to the user.

[2096] Cloud Interconnection and Backup

[2097] Step 1:

[2098] The server checks the connection settings between NTT Cloud and other companies' clouds.

[2099] Step 2:

[2100] The server monitors the connection between both clouds using a HeartBeat function.

[2101] Step 3:

[2102] The server periodically checks the connection status between the clouds.

[2103] Step 4:

[2104] The server sets up a regular data backup schedule.

[2105] Step 5:

[2106] When it's time for a backup, the server creates a snapshot of the database.

[2107] Step 6:

[2108] The server transfers the snapshot to the second cloud.

[2109] Cooperation with financial institutions and postal institutions

[2110] Step 1:

[2111] The user uses the terminal to submit a request to pay the tax online.

[2112] Step 2:

[2113] The server receives the request and connects to the bank's API.

[2114] Step 3:

[2115] The server uses the user's authentication information to access the bank account and debit the required amount.

[2116] Step 4:

[2117] The server notifies the user of the transaction result.

[2118] Step 5:

[2119] The user submits a request for a mail transaction.

[2120] Step 6:

[2121] The server sends the transaction information to the post office system.

[2122] Step 7:

[2123] The server receives a confirmation reply from the post office.

[2124] Step 8:

[2125] The server will send a notification to the user that the transaction is complete.

[2126] Introducing the Emotion Engine

[2127] Step 1:

[2128] A user accesses the system using a terminal and uses the service.

[2129] Step 2:

[2130] The server performs text analysis on each text entered by the user as it is submitted, identifying sentiment from keywords and context.

[2131] Step 3:

[2132] When a user interacts with the system through voice, the server analyzes the voice data and detects emotions from tone, speed, pitch, etc.

[2133] Step 4:

[2134] When a user accesses the system using a camera, the server performs image analysis of the user's facial expressions to identify emotions.

[2135] Step 5:

[2136] The server generates an appropriate response based on the emotion recognized by the emotion engine.

[2137] Step 6:

[2138] The server generates a response that is then displayed or sent to the user.

[2139] Step 7:

[2140] The user receives the response from the server and begins the next interaction.

[2141] This process allows the system to generate responses that reflect the user's emotions and provide more personalized services. For example, in a city hall's online application system, if a user is feeling stressed, the server can display encouraging messages or guidance to the user. This improves the user experience and encourages service use.

[2142] Example 2

[2143] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2144] Previous systems provided separate functions for secure communications, automated routine processes, connectivity between multiple cloud environments, and data backup, but few systems comprehensively integrated these functions. Furthermore, they lacked the ability to recognize user emotions and dynamically respond, creating challenges in improving the user experience. Furthermore, there was a need for a system that provided a seamless interface for collaboration with financial institutions and postal institutions.

[2145] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2146] In this invention, the server includes a means for establishing secure communications, a means for automating routine processes, a means for interconnecting multiple cloud environments, a means for backing up data, a means for linking with financial institutions and postal institutions, and a means including an emotion engine that recognizes user emotions. This ensures secure communications, enables efficient and automated routine processes, safe data backup, and seamless data linkage between multiple clouds. Furthermore, by responding to user emotions, an improved user experience can be expected.

[2147] "Secure communication" refers to a highly secure means of communication that prevents unauthorized access from outside, data tampering, and information leaks.

[2148] "Automation of routine processes" is a means of increasing efficiency by automating repetitive tasks that have set procedures.

[2149] A "cloud environment" is a virtualized IT infrastructure that uses data storage and computing resources provided via the Internet.

[2150] "Means of interconnection" refers to a communication method that enables data exchange and collaboration between multiple cloud environments.

[2151] "Means for backing up data" refers to a method for regularly copying and saving data in preparation for data loss or corruption.

[2152] A "financial institution" is an organization that manages and administers funds, such as a bank or credit company.

[2153] A "postal organization" is an organization that provides mail delivery and logistics services.

[2154] An "emotion engine" is software or a system that analyzes input data such as text, voice, and images from a user and identifies the user's emotions.

[2155] The present invention is a system that combines functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, and collaborating with financial institutions and postal institutions, with an emotion engine that recognizes user emotions. An embodiment of the system will be described in detail below.

[2156] Building a secure network

[2157] VPN Connection

[2158] The server uses OpenVPN software to connect to a VPN server using authentication information (username, password, certificate), which protects the business network from unauthorized access from outside.

[2159] Example: A company's employees use this VPN connection to connect to a secure internal network when working remotely.

[2160] Firewall settings

[2161] The server edits firewall configuration files, such as iptables or pfSense, and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[2162] Example: In a corporate network, an administrator configures the network to allow access only from a specific server room.

[2163] Configuring encryption protocols

[2164] The server obtains an SSL / TLS certificate from a certificate authority such as Let's Encrypt and adds settings to the web server (Apache or NGINX) configuration file to enable encrypted communication, which encrypts and protects communication between the user and the server.

[2165] Example: Used by online shopping sites to securely transmit users' credit card information.

[2166] Automating routine processes

[2167] Processing applications for public services

[2168] The user accesses the application form for the public service using a device (browser or dedicated app) and enters the required information. When the application button is clicked, the server receives the form data and stores it in a database (MySQL or PostgreSQL). Once processing is complete, the server uses the SMTP server to send a confirmation email to the user.

[2169] Example: When a resident applies for a residence certificate on a local government website.

[2170] Automation of resident registration and family register-related matters

[2171] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information and automatically generates the necessary documents in PDF format. The generated PDF is digitally signed and the server then emails it to the user.

[2172] Example: The procedure for transferring your residence registration to your new residence when moving.

[2173] Cloud Interconnection and Backup

[2174] Cloud-to-cloud interconnection

[2175] The server stores API credentials for multiple cloud environments (AWS and Azure) in a configuration file, connects to both clouds, initiates data synchronization, and monitors the connection status with a heartbeat function.

[2176] Example: An e-commerce company replicating data between AWS and Azure.

[2177] Data Backup

[2178] Schedule regular backups of your servers using cron jobs, AWS Lambda, etc. Create snapshots of your databases and transfer them to a second cloud storage location such as Google Cloud Storage or an S3 bucket.

[2179] Example: A financial institution periodically backs up customer transaction information.

[2180] Cooperation with financial institutions and postal institutions

[2181] Transaction collaboration with banks

[2182] The user uses a terminal to access an online payment form and enters the information. The server receives this information, connects to the bank's API, sends the user's authentication information, debits the required amount from the account, and notifies the user of the transaction result.

[2183] Example: A local government accepts online payments for resident taxes.

[2184] Business collaboration with the post office

[2185] When a user requests a postal transaction, the server sends the transaction information to the post office API, receives a confirmation reply from the post office, and notifies the user that the transaction is complete.

[2186] Example: When checking the shipping status of an item from an online shop.

[2187] Introducing the Emotion Engine

[2188] emotion recognition

[2189] The server uses emotion engines such as IBM Watson and Google Cloud Natural Language API to recognize the user's emotions as they interact with the system.

[2190] Example prompt: "If a user feels stressed while applying on the city hall's online application system, what message can be displayed to make the user feel more at ease?"

[2191] Text analytics

[2192] When a user uses the system through text chat, the server analyzes the entered text and identifies emotions.

[2193] Example prompt: "When a user says, 'I'm tired today,' how should the system respond?"

[2194] Audio analysis

[2195] When a user interacts with the system through voice, the server analyzes the voice data to identify emotions.

[2196] Example prompt: "How should the system respond if the user speaks in an excited voice?"

[2197] Image analysis

[2198] When a user accesses the system using a camera, the server analyzes the image data to identify emotions.

[2199] Example prompt: "If a user sends a picture of a smiling face, how should the system respond?"

[2200] Response Control

[2201] The server generates and sends an appropriate response to the user based on the emotion recognized by the emotion engine.

[2202] Example: In a local government online application system, when a user feels stressed, the system displays a guide message such as, "The necessary steps will be shown step by step, so please remain calm and proceed."

[2203] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2204] Step 1:

[2205] The user accesses the system using a device (browser or dedicated app). The user opens the application form for a public service, enters the required information, and clicks the application button. The user's input includes name, address, application details, etc.

[2206] Input: Application information entered by the user (name, address, application details, etc.)

[2207] Output: Trigger to send application information

[2208] What happens: A user enters information into a web form and clicks the "Submit" button, which sends an HTTP POST request to the server.

[2209] Step 2:

[2210] The server receives the application form data sent from the user and validates it, checking that it has been entered in the correct format and that it does not contain any invalid data.

[2211] Input: Application form data sent by the user

[2212] Output: Validation result (success / failure)

[2213] Specific behavior: The server parses the form data (e.g., JSON format), checks the format and required fields of each field, and decides whether to return an error message to the user or proceed to the next step.

[2214] Step 3:

[2215] The server saves the validated application data in a database (MySQL or PostgreSQL), and then adds a new record to the database as a result.

[2216] Input: Successfully validated application data

[2217] Output: Application records stored in the database

[2218] Specific behavior: The server executes an SQL query such as "INSERT INTO applications (name, address, application_type) VALUES ('John Doe', '123 Main St', 'Resident Card')".

[2219] Step 4:

[2220] The server generates an application completion email and sends it to the user, which includes a notification of acceptance of the application and information about future procedures.

[2221] Input: Application record stored in the database

[2222] Output: A confirmation email to the user.

[2223] Specific operation: The server sends an "application confirmation email to the user" via the SMTP server. The subject will be something like "Subject: Notification of application completion" and the email body will say "Your application has been accepted."

[2224] Step 5:

[2225] When a user applies for a resident registration certificate, the server accesses the database to search for the user's information, and automatically generates the necessary documents in PDF format based on the user's information.

[2226] Input: User request for issuance of resident certificate

[2227] Output: Generated PDF document

[2228] What it does: The server runs an SQL query like "SELECT FROM residents WHERE user_id = 'john_doe'" and generates a PDF using the FPDF library.

[2229] Step 6:

[2230] The server then affixes a digital signature to the generated PDF, ensuring the authenticity of the document.

[2231] Input: Generated PDF document

[2232] Output: PDF document with digital signature

[2233] Specific behavior: The server runs a command like "gpg --sign resident_certificate.pdf" to add a digital signature to the PDF.

[2234] Step 7:

[2235] The server then emails the generated PDF with the digital signature to the user, allowing them to receive the necessary documents.

[2236] Input: PDF document with digital signature

[2237] Output: PDF sent to user

[2238] Specific operation: The server uses an SMTP server to send a PDF with an electronic signature to the user with the subject "Notice of Resident Registration Issuance."

[2239] Step 8:

[2240] The server configures API credentials for multiple cloud environments (e.g. AWS and Azure), starts synchronizing data, and monitors connections with a heartbeat function.

[2241] Input: API credentials for your cloud environment

[2242] Output: Data synchronization and connection monitoring between cloud environments

[2243] Specific operations: The server executes the "aws configure" and "az login" commands, synchronizes data using rsync, and monitors the connection health using the heartbeat function.

[2244] Step 9:

[2245] The server schedules regular data backups using cron jobs or Lambda functions and transfers snapshots to a second cloud (Google Cloud Storage or S3).

[2246] Input: Schedule settings and data to be backed up

[2247] Output: Backup data stored in the second cloud

[2248] Specific operation: The server sets a schedule with "crontab -e", obtains a database backup with the command "pg_dump database_name > backup.sql", and transfers the backup with "gsutil cp backup.sql gs: / / bucket / ".

[2249] Step 10:

[2250] The user accesses the online payment form using a terminal, enters payment information, and submits it. The server receives the information, connects to the bank API, executes the transaction, and notifies the user of the result.

[2251] Input: Payment information entered by the user

[2252] Output: Transaction result and user notification

[2253] Specific operation: The server POSTs the user information to the endpoint "https: / / api.bank.com / transaction" and notifies the user of the transaction results by email.

[2254] Step 11:

[2255] When a user requests a postal transaction, the server sends the transaction information to the Post Office API, receives a confirmation reply, and sends a notification to the user that the transaction is complete.

[2256] Input: A mail transaction request from the user

[2257] Output: Transaction completion confirmation and user notification

[2258] Specific operation: The server POSTs to "https: / / api.postoffice.com / transaction" and notifies the user of the transaction results by email.

[2259] Step 12:

[2260] The server uses the user's text, voice, and image to activate the emotion engine and recognize emotions. Based on the recognized emotions, it generates an appropriate response and sends it to the user.

[2261] Input: User text, voice, and image data

[2262] Output: Emotion recognition results and generated responses

[2263] Specific operation: The server sends the text input to IBM Watson, retrieves the analysis results using "POST https: / / api.us-south.tone-analyzer.watson.cloud.ibm.com / instances / {instance_id} / v3 / tone", generates a response, and sends it to the user.

[2264] (Application example 2)

[2265] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2266] Modern electronic payment systems require security, automated processing, and data integration between cloud environments. Furthermore, to improve the user experience, they need the ability to recognize user emotions in real time and respond appropriately. However, meeting these requirements in a single system is technically complex, and current systems are not adequately capable. This has led to problems such as user frustration and cumbersome operation.

[2267] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for establishing secure communications, means for automating routine processing, means for interconnecting multiple cloud environments, means for backing up data, means for coordinating with financial institutions and postal institutions, means for recognizing emotions, and means for optimizing the user experience based on emotions. This not only ensures security and improves business efficiency, but also enables flexible responses according to the user's emotions.

[2268] "Secure communication" refers to a communication method that ensures the safety of information by using encryption technology and virtual private networks to prevent unauthorized access and data leaks.

[2269] A "routine process" is a series of standardized tasks that are set up in advance to streamline business operations and procedures and to be executed automatically.

[2270] "Means for interconnecting multiple cloud environments" refers to technologies and methods for seamlessly linking data and services between different cloud service providers.

[2271] "Data backup" is the process of regularly creating copies of data and storing them in different locations or storage to reduce the risk of data loss.

[2272] "Means for interfacing with financial institutions and postal institutions" refers to interfaces and protocols for sharing information between systems with banks, post offices, etc., to automate and streamline transactions and postal operations.

[2273] "Emotion recognition means" refers to algorithms and technologies that analyze data such as a user's voice, text, and images to detect and determine their emotional state.

[2274] The "means for optimizing user experience based on emotions" refers to a method and system for providing appropriate application responses and support in response to detected user emotions to enhance the user experience.

[2275] One embodiment of the present invention is a system and program for use in an electronic payment service. The system has functions for establishing secure communications, automating routine processes, interconnecting multiple cloud environments, backing up data, cooperating with financial institutions and postal institutions, and recognizing user emotions and optimizing the user experience based on the emotions.

[2276] Building a secure network

[2277] VPN Connection

[2278] The server runs virtual private network (VPN) software and uses the authentication information to connect to a VPN server, which protects the business network from unauthorized access.

[2279] Firewall settings

[2280] The server edits the firewall configuration file and adds rules that allow only specific IP addresses and port numbers, ensuring that only authorized traffic can access the network.

[2281] Configuring encryption protocols

[2282] The server obtains an SSL / TLS certificate and adds settings to the web server configuration file to enable encrypted communication, which encrypts and protects communication between users and the server.

[2283] Automating routine processes

[2284] Processing applications for public services

[2285] The user uses a terminal to access the application form for a public service and enters the required information. When the user clicks the application button, the server receives the form data ...

Claims

1. a means for establishing secure communications; A means of automating routine processes, A means of interconnecting multiple cloud environments; How to back up your data; means of working with financial and postal institutions; A system including:

2. The means for establishing secure communication comprises: The system of claim 1 , comprising a virtual private network.

3. The means for automating the routine processing is The system of claim 1 further comprising functionality for automating application processing for public services.

Images