system

Abstract

We provide the system. [Solution] A means of obtaining address information and schedule information from the user, A means of identifying the necessary procedures based on the acquired address information, A means of sending communications to an external organization to automatically execute the identified procedures, A means of sending a notification to the user to request approval of the procedure, A means of receiving user approval or correction results and continuing or modifying the procedure, A means of notifying the user of the completion status of the procedure, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The complicated administrative procedures associated with moving house cover a wide range, such as address change, contract change of lifelines, and notification to the administration, which impose a great burden on users. Also, performing these procedures manually individually consumes time and labor, and may hinder the start of a new life. The present invention aims to reduce the burden on users and support the smooth start of a new life by automating these procedures.

Means for Solving the Problems

[0005] The present invention includes means for obtaining address and schedule information from a user when moving, and means for identifying the necessary procedures based on the obtained information. It also provides means for transmitting communications to an external organization to automatically execute the identified procedures and for sending a notification to the user requesting approval. Furthermore, it has a function to continue or modify the procedures based on the user's approval or modification results, and finally notifies the user of the completion status of the procedures, thereby providing a system that efficiently manages complex administrative processes.

[0006] "User" refers to an individual or legal entity that uses this system to complete relocation procedures.

[0007] "Address information" refers to information about the location of both the original and new addresses of the person moving.

[0008] "Schedule information" refers to information regarding the planned date and time of the move.

[0009] "Procedures" refers to various administrative tasks such as contract changes, notifications, and applications that are necessary in connection with moving.

[0010] "External organizations" refer to public institutions and service providers that accept and manage various contracts and procedures.

[0011] "Communication" refers to the act of transmitting information to an external organization using the internet or other means of communication.

[0012] "Approval" refers to the user reviewing the procedure proposed by the system and determining that it is appropriate.

[0013] "Notifications" refer to messages that inform users of information such as the progress of a procedure or requests for approval. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), and the like.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a system for efficiently managing procedures related to moving, and a specific embodiment thereof is described below.

[0036] First, the user accesses the system using their device and enters basic information such as their current and new addresses, planned moving date, and contact information. The device receives this data and sends it to the server.

[0037] Based on the received address and schedule information, the server creates a list of procedures necessary for moving. During this process, the server retrieves relevant information from geographic information databases and APIs from various service providers to identify necessary administrative procedures and changes to utility contracts.

[0038] Next, the server sends the necessary communications to external organizations (e.g., online application windows of power companies or local governments) to automatically execute the identified procedures. This process includes sending API requests and automatically filling out online application forms.

[0039] Once the procedure details are finalized, the server sends a notification to the user's device requesting approval. The user reviews the procedure details on their device and grants approval. They can also modify the procedure details as needed.

[0040] Finally, the server receives the user's approval or correction and completes the process. After all procedures are complete, the user is notified of the completion status. This reduces the burden of administrative work for the user, allowing them to smoothly start their new life.

[0041] As a concrete example, consider the case of moving from Tokyo to Osaka. When the user enters their new address and moving date into the system, the server automatically creates the corresponding change of address form and updates the contract details for electricity, gas, internet, etc. The user can complete the process simply by reviewing these procedures and clicking the approval button. Throughout this entire process, the user can effectively manage the procedures and start their new life with peace of mind.

[0042] The following describes the processing flow.

[0043] Step 1:

[0044] The user accesses a dedicated form on their device and enters their current and new addresses, planned moving date, and contact information. The device validates the entered data in real time, checking that all required fields are filled in.

[0045] Step 2:

[0046] The device encrypts the data that has passed validation before sending it to the server. The server securely stores the received data in its database.

[0047] Step 3:

[0048] The server uses the stored information to create a list of necessary administrative procedures and changes to utility contracts. During this process, the server retrieves information from geographic information databases and service provider APIs to proceed with the processing.

[0049] Step 4:

[0050] The server sends communications to various providers' APIs to automatically execute identified procedures. These include procedures for changing contracts for electricity, gas, and internet, as well as filing change-in and change-out notifications.

[0051] Step 5:

[0052] After confirming that each procedure is complete, the server sends a notification to the user's device requesting their approval of the procedure. The device then displays this notification to the user and shows the procedure details on a confirmation screen.

[0053] Step 6:

[0054] The user reviews the procedure details on the device screen and approves or modifies them. The result is sent to the server via the device.

[0055] Step 7:

[0056] The server receives the user's approval or correction and proceeds with the necessary processing. Once it confirms that all procedures are complete, the server sends a completion notification to the user via the terminal, informing them that they are ready to begin their new life.

[0057] (Example 1)

[0058] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0059] The procedures involved in moving are complex and burdensome for users, as they require contacting numerous different agencies, completing administrative procedures, and changing utility contracts. In particular, the need to proceed with each procedure individually presents challenges in managing the progress of the process and the likelihood of omissions.

[0060] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0061] In this invention, the server includes means for acquiring property information and schedule information from the user, means for identifying necessary tasks based on the acquired property information, and means for transmitting communications to an external organization for the automatic execution of the identified tasks. This allows the user to centrally manage all procedures related to moving and start their new life efficiently and quickly.

[0062] A "user" refers to an individual or corporation that uses this system to complete relocation procedures.

[0063] "Property information" refers to basic data necessary for the procedure, including information related to the address of the current and new address.

[0064] "Planned information" refers to information about the specific date and timing of the move, and serves as the basis for planning the procedural schedule.

[0065] "External organizations" refers to all external organizations that a user may need to interact with when moving, such as power companies, gas companies, internet providers, and government agencies.

[0066] "Administrative tasks" refers to the general term for procedures that users need to perform, such as changing utility contracts or filing notifications with the government when moving.

[0067] A "geographic database" refers to a database containing geographical information that is referenced when identifying necessary procedures based on address information.

[0068] A "service provider API" refers to an application programming interface used by an external service provider to facilitate changes to infrastructure, service contracts, and other related processes.

[0069] "Notification" refers to a message that the system sends to the user, such as a request for approval of a procedure or a report on its completion status.

[0070] This invention is a system for efficiently managing a series of procedures associated with moving. The embodiments for carrying out the invention will be described in detail below.

[0071] First, the user accesses the system using their own device and enters their current and new addresses, planned moving date, contact information, and other details. This information forms the basis for initiating all necessary procedures for moving. User operations are performed through a web browser interface.

[0072] The entered data is sent to the server via the terminal. Upon receiving this data, the server first accesses the geographic database and APIs of various service providers to identify the necessary procedures based on the user's old and new address information.

[0073] The server lists the identified procedures and, for those that can be automated, communicates using APIs of external organizations. Specifically, it generates API requests to change contracts with power companies and internet providers, and automatically fills in the necessary information into the external organizations' online forms. This automation significantly reduces the effort required from users.

[0074] The server then notifies the user of the details of the procedure performed and requests their approval. Approval is performed on the user's terminal, and if corrections are needed, the user can make the corrections and then approve again.

[0075] Finally, the server receives user approval and completes all procedures. Once the procedures are finished, the server notifies the user of the completion status, ensuring that all administrative tasks related to the move are completed smoothly.

[0076] As a concrete example, consider a user moving from Tokyo to Osaka. Using this system, all the user needs to do is enter their new address and moving date, and the server will automatically handle the administrative procedures and changes to electricity and gas contracts related to the address change. The user only needs to approve these changes to complete the process. This frees the user from the cumbersome procedures associated with moving, allowing them to smoothly start their new life.

[0077] Example of a prompt:

[0078] "The user is planning to move from Tokyo to Osaka Prefecture. Please enter your new address and moving date into the system. Based on that, the system will list the necessary contract changes and administrative procedures and execute them automatically."

[0079] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0080] Step 1:

[0081] The user accesses an interface on their device and enters their current and new addresses, planned moving date, and contact information. The entered data includes address information, date information, and contact information. This information is then prepared for transmission to the server by the device.

[0082] Step 2:

[0083] The terminal sends the information received from the user to the server. Specifically, it securely transmits the entered address and schedule information to the server using the SSL / TLS protocol. The input in this step is the user's basic information, and the output is this information sent to the server.

[0084] Step 3:

[0085] The server initiates the necessary processing based on the received data. First, it accesses the geographic database to collect information necessary for administrative procedures and changes to utility contracts based on the new address. The input is address and date information, and the output is a list of the necessary procedures.

[0086] Step 4:

[0087] The server accesses each service provider via APIs and communicates to automatically execute identified procedures. Specifically, it sends requests to the APIs of power companies, gas companies, and internet service providers to make necessary contract changes. The inputs here are a list of procedures and API information, and the output is the success / failure result of communication with external organizations.

[0088] Step 5:

[0089] The server sends a notification to the user requesting approval based on the results of the procedure. The notification includes details of the procedure performed and instructions for the user to approve or modify it. The input is the result of the communication, and the output is the approval request message sent to the user's terminal.

[0090] Step 6:

[0091] The user reviews the procedure details displayed on the terminal and approves or makes any necessary corrections. Once approved, the result is returned to the server via the terminal. The input is the procedure details sent from the server, and the output is the user's feedback regarding approval or corrections.

[0092] Step 7:

[0093] The server receives the user's approval and confirms that all procedures are complete. After completion, the server sends a completion notification to the user. The output is a notification of procedure completion, finally informing the user that the entire process is finished.

[0094] (Application Example 1)

[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0096] The numerous procedures involved in moving are complex, making it difficult for residents to quickly and accurately complete the associated administrative procedures and changes to utility contracts. This creates a challenge in ensuring a smooth transition to a new life.

[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0098] In this invention, the server includes means for acquiring spatial and temporal information from a user, means for identifying necessary processing content based on the acquired spatial information, and means for utilizing urban spatial information through a support application for citizens. This allows residents to simplify the procedures when moving and quickly adapt to their new living environment.

[0099] "Spatial information" refers to data that indicates the location of a user's current address or new address, and includes geographical elements.

[0100] "Time information" refers to date and time data related to a user's plans and schedules, indicating the time when a specific event or action occurs.

[0101] "Processing details" refers to information used to identify a series of procedures or actions required by the user, and includes specific tasks and obligations.

[0102] "Communication" refers to a means of exchanging information with an external organization or system, and includes electronic messages and data.

[0103] "Communication" refers to a means of informing users of necessary information, and is transmitted through notifications and messages.

[0104] "Infrastructure services" refer to basic public and private services that residents use in their daily lives, and include electricity, water, and telecommunications.

[0105] "Public institutions" refer to organizations and facilities operated by the government or local authorities that provide administrative procedures and public services.

[0106] A "support application for citizens" is an application designed to provide residents with the information and services they need on a daily basis, and its purpose is convenience and information provision.

[0107] The system that realizes this invention efficiently manages moving procedures using the user's terminal and a server. The user enters detailed moving information using a smartphone or similar device. This includes spatial and temporal information, and all relevant data related to the user's relocation is entered.

[0108] The server receives this information and identifies the necessary actions to be taken. These actions may include reporting to public institutions or changing contracts for underlying services. To perform these tasks, the server communicates with external organizations using a Node.js server and a Python backend.

[0109] When a user approves or modifies a procedure, the server sends a notification to the user's device via Firebase Cloud Messaging. This allows the user to review the procedure on their device and approve or modify it as needed.

[0110] For example, when a user moves to a new city, they can use a citizen support application to change their address. This application uses Google® Maps API and local government APIs to efficiently manage the user's relocation process.

[0111] This entire process can be made more efficient by utilizing generative AI models. An example of a prompt would be:

[0112] "Based on the following information, please generate a list of steps necessary for a user to smoothly complete their move: New address is 'Nishi-ku, Osaka Prefecture', and planned moving date is 'December 1, 2023'. Also, please create a flowchart that automates the process using relevant APIs."

[0113] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0114] Step 1:

[0115] Users access the application using their devices and input spatial and temporal information about their move. This input data includes the new address and planned moving date. This data is processed into an appropriate format within the app and then sent to the server.

[0116] Step 2:

[0117] The server analyzes the data received from the terminal and identifies the necessary processing. Specifically, it uses geographic information data and date / time information to determine whether administrative procedures or changes to utility contracts are required due to relocation, and compiles this information into a list. Geographic information databases and various administrative service APIs are used for this determination.

[0118] Step 3:

[0119] The server initiates communication to convey the identified processing details to the external organization. This involves generating API requests and automatically entering data into various public institution systems and online forms of infrastructure service providers. As a result, the necessary procedures are approved or implemented by the external organization.

[0120] Step 4:

[0121] The server sends a notification to the user via Firebase Cloud Messaging or a similar notification service, requesting confirmation of the procedure. This notification includes the progress and outcome of the procedure.

[0122] Step 5:

[0123] The user receives a notification via their device and reviews the procedure details. They make any necessary corrections and send feedback to the server by pressing the approval button. If the procedure details are modified based on the user's input, the server reprocesses the procedure accordingly.

[0124] Step 6:

[0125] The server notifies the user of the completion status after all procedures are finished. This ensures that the user can complete all the necessary procedures for living at their new address and that they can smoothly transition to their new environment.

[0126] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0127] This invention provides an automated moving procedure system that takes user emotions into consideration. This system incorporates an emotion engine that recognizes the user's emotional state when they input information, and has a function to optimize notifications and responses to the procedure according to the user's emotions.

[0128] First, the user uses the device to enter their current and new addresses, the moving date, and contact information. During this process, the device sends the entered data to an emotion engine in real time to analyze the user's emotional state. For example, it can determine emotions using parameters such as the content and speed of text input and the words selected.

[0129] Next, the server identifies the necessary procedures based on the entered address and schedule information and automatically initiates processing. These procedures include changing utility contracts and filing notifications with government agencies, but these processes are performed automatically via APIs from external organizations.

[0130] Once the progress and details of the procedure have been determined, the server sends a notification requesting approval in the most appropriate way, depending on the user's emotional state. For example, if the user is feeling anxious, the server can provide reassuring messages or additional support information.

[0131] Furthermore, after the user approves the procedure, the server uses an emotion engine to provide follow-up while the user is living away from home and even after the procedure is completed. This includes reassuring notifications about the progress of the procedure and customized support, including advice on moving.

[0132] For example, if a user is feeling anxious about moving from Tokyo to Osaka, the server will clarify the moving procedure and important points, and provide information to alleviate the user's anxiety. This allows the user to proceed with the procedure with peace of mind and adapt to their new living environment. In this way, the present invention aims to make the moving procedure more user-friendly.

[0133] The following describes the processing flow.

[0134] Step 1:

[0135] The user enters their current and new addresses, moving date, and contact information in a form on the device. The device receives the user's input data and sends the speed and keystroke patterns to an emotion engine to analyze the user's emotional state in real time.

[0136] Step 2:

[0137] The device sends the results of its analysis of the user's emotional state to the server. This includes information such as whether the user is stressed or excited. The server stores this data, along with the user's address and schedule information, in a database.

[0138] Step 3:

[0139] The server uses the information received from the user to identify the necessary procedures for moving. This involves generating a list of changes to utility contracts and notifications to government agencies, and accessing APIs of external organizations to retrieve the required information.

[0140] Step 4:

[0141] The server automatically sends procedures to external organizations and manages their progress. It also creates approval requests for procedures that take the user's emotional state into consideration. For example, if the user is feeling anxious, it will generate a notification with reassuring wording.

[0142] Step 5:

[0143] The server sends the generated approval request to the terminal. The terminal displays a notification of the approval request to the user, presenting an emotionally sensitive message along with detailed procedural instructions. The user reviews the content and gives instructions to approve or revise the request.

[0144] Step 6:

[0145] Upon receiving user approval or modification information from the terminal, the server completes the procedure or makes any further necessary modifications based on that information. Once the procedure is finally completed, the server generates a completion notification.

[0146] Step 7:

[0147] The server sends a completion notification to the user's device and simultaneously uses an emotion engine to provide additional support related to the move. This includes local information about the new area and helpful advice for settling in. The device then provides this information to the user, supporting them in transitioning to their new environment with confidence.

[0148] (Example 2)

[0149] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0150] In modern times, the procedures associated with moving are often complex and place a significant burden on users. Furthermore, a lack of consideration for users' emotional states during the process and insufficient follow-up can lead to stress and anxiety. Therefore, there is a need for greater user convenience and reduced psychological burden.

[0151] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0152] In this invention, the server includes means for analyzing the user's emotional state, means for sending notifications according to the user's emotional state and requesting approval, and means for notifying the user of the completion status of tasks and providing follow-up information. This enables the user to proceed with the relocation process efficiently and stress-free.

[0153] "Geographic information" refers to information about the place where a user resides or intends to relocate, including addresses and location coordinates.

[0154] "Timing information" refers to information about when a user wants to perform a specific action, and it refers to a specific date or time frame.

[0155] "Business" refers to the practical work and contract processing included in the series of procedures and arrangements related to moving.

[0156] "External mechanisms" refer to external organizations or institutions, including public institutions and service providers with which the system interacts.

[0157] "Emotional state" refers to the psychological or emotional response a user exhibits at a given point in time, and includes stress, a sense of security, tension, and so on.

[0158] "Follow-up information" includes support information and advice provided to users so that they can start their new life with peace of mind after moving.

[0159] "Notification" refers to a means of communicating information to inform users about the progress of procedures, approval requests, etc.

[0160] This invention is an automated moving procedure system that takes user emotions into consideration. It operates in conjunction with a server, terminals, an emotion engine, and external mechanisms. The server is a computing device equipped with a high-performance processor and large-capacity memory, and has a network interface for communicating with external APIs. The terminal has a graphical interface for users to provide input data and has the ability to communicate with the emotion engine in real time. The emotion engine uses a generative AI model to analyze the user's input behavior and identify their emotional state.

[0161] The user first enters basic information about their move (geographical information, timing information) through their device. The device sends the input data to an emotion engine, which analyzes the user's emotional state in real time. The server identifies the necessary tasks based on the entered information and starts processing them automatically.

[0162] The server transmits communications to external mechanisms to efficiently handle procedures related to the move. The user is notified of the progress and follow-up information from the server. During this process, messages are sent that take into account the user's current emotional state, providing reassurance and appropriate advice.

[0163] For example, if a user is feeling anxious about moving to a new area, the server can alleviate their anxiety by sending information about living in the new neighborhood and detailed instructions about the procedures involved. An example of a prompt message to provide to this system would be: "If the system determines that the user is feeling stressed during the moving process, suggest a reassuring support message."

[0164] Thus, the present invention reduces the psychological burden on users and enables smoother service delivery by incorporating emotion recognition technology into the automation of moving procedures.

[0165] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0166] Step 1:

[0167] The user uses the device to enter geographical information, timing, and contact details for their current and new addresses. The device sends this data to the emotion engine. The emotion engine analyzes input speed and word choices to identify the user's emotional state. This result is output as an emotional state the user may be experiencing, such as anxiety or excitement.

[0168] Step 2:

[0169] The server receives geographical and temporal information transmitted from the terminal. Based on this, it initiates a process to identify necessary tasks. The server uses the geographical information to identify, for example, changes in local administrative procedures or essential infrastructure such as electricity and water. As output, it generates a list of tasks to be performed.

[0170] Step 3:

[0171] The server sends communications to an external API to automatically execute a specified task. For example, it might perform a user change procedure via a power company's API. In this case, the progress of the task is generated and recorded as output.

[0172] Step 4:

[0173] The server sends notifications to the user regarding work progress and requests for approval in a way that is optimal based on the user's emotional state. For example, if the server determines that the user is stressed, it will send a notification using reassuring language. Because the content of the notifications changes based on the emotional state, the output is a personalized message.

[0174] Step 5:

[0175] Users review notifications received from the server and approve tasks. They can also request corrections if necessary. User approvals or correction requests are sent to the server and serve as input to proceed to the next step.

[0176] Step 6:

[0177] The server receives user approval or correction instructions and continues or corrects the task. If necessary, it communicates with external mechanisms again to adjust the task details. The output generates a notification indicating the final task completion status or correction completion.

[0178] Step 7:

[0179] The server provides follow-up support to users even after the task is completed. This includes post-migration support information and progress reports. As a final output, users are notified with additional information and advice to provide peace of mind after the migration is complete.

[0180] (Application Example 2)

[0181] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0182] In modern cities, moving to a new residence involves numerous procedures, and the resulting mental burden is a significant problem. Furthermore, the lack of mechanisms to efficiently and emotionally support residents through these moving procedures is a major challenge.

[0183] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0184] In this invention, the server includes a device for acquiring user address information and schedule information, a mechanism for identifying necessary processing based on the acquired address information, and a device for analyzing the user's emotional state and sending an optimal approval notification for the procedure. This not only efficiently automates the procedures associated with moving, but also reduces the emotional burden on the user, allowing them to proceed with the procedures with peace of mind.

[0185] A "user" refers to an individual or organization that uses the system to complete the relocation process.

[0186] "Address information" refers to data used to identify the user's current place of residence or their new place of residence.

[0187] "Schedule information" refers to date information related to the moving date and the procedures involved.

[0188] "Device" refers to the collective term for the hardware or software used to perform each of its functions.

[0189] A "mechanism" refers to the internal processes and procedures of a system configured to achieve a specific function.

[0190] An "external device" is equipment used to transmit information to organizations or systems other than the user.

[0191] "Emotional state" refers to a numerical or qualitative representation of a user's psychological and emotional state.

[0192] A "follow-up notification" is a message sent to provide additional information based on the progress of a procedure or the user's emotional state.

[0193] "Living infrastructure" is a general term for essential infrastructure for daily life, such as electricity and water.

[0194] An "administrative agency" is a public organization operated by the national government or local authorities.

[0195] The system for implementing this invention is realized by combining multiple devices and mechanisms. A server, user terminal, and external devices work together to support the user's relocation process. The specific processing flow is described below.

[0196] First, the user uses the device to enter their moving address and date information. The device then uses an emotion engine that analyzes text input and selected words to determine the user's emotional state. This emotion engine utilizes the Google Cloud Natural Language API to process and analyze the user's emotional data in real time.

[0197] Next, based on the information collected by the server, it identifies the necessary processing and communicates with external devices to execute it. Amazon Web Services (AWS®) AWS Lambda and Amazon API Gateway are used for communication with external devices to automate the process.

[0198] Furthermore, the server sends follow-up notifications regarding the progress of the process in the most appropriate way, depending on the user's emotional state. Firebase Cloud Messaging is used to ensure that users receive the information they need quickly.

[0199] For example, when a user moves to a new city, they may need advice on the procedures involved and how to smoothly adapt to the new environment. In this case, the emotion engine detects the user's anxiety, and the system presents a message such as, "Here are some steps to help you start your life in your new city with confidence. Please try them out."

[0200] Examples of prompts for a generative AI model are as follows:

[0201] "Please suggest ways to alleviate the anxiety users feel when moving to a new city."

[0202] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0203] Step 1:

[0204] The user uses their device to enter their new address and moving date information. The entered data is temporarily stored on the device, and the text content and input speed are sent to the sentiment engine.

[0205] Step 2:

[0206] The device uses the Google Cloud Natural Language API to analyze input data in real time and infer the user's emotional state. It analyzes the input text and speed, and outputs emotions such as stress and anticipation as numerical values.

[0207] Step 3:

[0208] The server receives address and schedule information sent from the terminal. Based on this, it identifies the necessary processing and sends a command to an external device via an API to execute the processing. AWS Lambda and Amazon API Gateway are utilized to automate the process.

[0209] Step 4:

[0210] The server generates a notification requesting user approval at the optimal time, based on the user's sentiment information. This notification is sent to the device using Firebase Cloud Messaging. The message includes reassuring language for the user.

[0211] Step 5:

[0212] The user receives a notification on their device and submits an approval or correction. This data is sent back to the server, where the process is advanced and corrections are made. Specifically, changes to utility contracts, for example, are processed automatically.

[0213] Step 6:

[0214] The server aggregates information about the completion status of the procedures. Based on this, it creates and sends follow-up notifications to the user as needed. These notifications include advice on adjusting to life in the new area.

[0215] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0216] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0217] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0218] [Second Embodiment]

[0219] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0220] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0221] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0222] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0223] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0224] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0225] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0226] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0227] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0228] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0229] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0230] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0231] This invention is a system for efficiently managing procedures related to moving, and a specific embodiment thereof is described below.

[0232] First, the user accesses the system using their device and enters basic information such as their current and new addresses, planned moving date, and contact information. The device receives this data and sends it to the server.

[0233] Based on the received address and schedule information, the server creates a list of procedures necessary for moving. During this process, the server retrieves relevant information from geographic information databases and APIs from various service providers to identify necessary administrative procedures and changes to utility contracts.

[0234] Next, the server sends the necessary communications to external organizations (e.g., online application windows of power companies or local governments) to automatically execute the identified procedures. This process includes sending API requests and automatically filling out online application forms.

[0235] Once the procedure details are finalized, the server sends a notification to the user's device requesting approval. The user reviews the procedure details on their device and grants approval. They can also modify the procedure details as needed.

[0236] Finally, the server receives the user's approval or correction and completes the process. After all procedures are complete, the user is notified of the completion status. This reduces the burden of administrative work for the user, allowing them to smoothly start their new life.

[0237] As a concrete example, consider the case of moving from Tokyo to Osaka. When the user enters their new address and moving date into the system, the server automatically creates the corresponding change of address form and updates the contract details for electricity, gas, internet, etc. The user can complete the process simply by reviewing these procedures and clicking the approval button. Throughout this entire process, the user can effectively manage the procedures and start their new life with peace of mind.

[0238] The following describes the processing flow.

[0239] Step 1:

[0240] The user accesses a dedicated form on their device and enters their current and new addresses, planned moving date, and contact information. The device validates the entered data in real time, checking that all required fields are filled in.

[0241] Step 2:

[0242] The device encrypts the data that has passed validation before sending it to the server. The server securely stores the received data in its database.

[0243] Step 3:

[0244] The server uses the stored information to create a list of necessary administrative procedures and changes to utility contracts. During this process, the server retrieves information from geographic information databases and service provider APIs to proceed with the processing.

[0245] Step 4:

[0246] The server sends communications to various providers' APIs to automatically execute identified procedures. These include procedures for changing contracts for electricity, gas, and internet, as well as filing change-in and change-out notifications.

[0247] Step 5:

[0248] After confirming that each procedure is complete, the server sends a notification to the user's device requesting their approval of the procedure. The device then displays this notification to the user and shows the procedure details on a confirmation screen.

[0249] Step 6:

[0250] The user reviews the procedure details on the device screen and approves or modifies them. The result is sent to the server via the device.

[0251] Step 7:

[0252] The server receives the user's approval or correction and proceeds with the necessary processing. Once it confirms that all procedures are complete, the server sends a completion notification to the user via the terminal, informing them that they are ready to begin their new life.

[0253] (Example 1)

[0254] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0255] The procedures involved in moving are complex and burdensome for users, as they require contacting numerous different agencies, completing administrative procedures, and changing utility contracts. In particular, the need to proceed with each procedure individually presents challenges in managing the progress of the process and the likelihood of omissions.

[0256] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0257] In this invention, the server includes means for acquiring property information and schedule information from the user, means for identifying necessary tasks based on the acquired property information, and means for transmitting communications to an external organization for the automatic execution of the identified tasks. This allows the user to centrally manage all procedures related to moving and start their new life efficiently and quickly.

[0258] A "user" refers to an individual or corporation that uses this system to complete relocation procedures.

[0259] "Property information" refers to basic data necessary for the procedure, including information related to the address of the current and new address.

[0260] "Planned information" refers to information about the specific date and timing of the move, and serves as the basis for planning the procedural schedule.

[0261] "External organizations" refers to all external organizations that a user may need to interact with when moving, such as power companies, gas companies, internet providers, and government agencies.

[0262] "Administrative tasks" refers to the general term for procedures that users need to perform, such as changing utility contracts or filing notifications with the government when moving.

[0263] A "geographic database" refers to a database containing geographical information that is referenced when identifying necessary procedures based on address information.

[0264] A "service provider API" refers to an application programming interface used by an external service provider to facilitate changes to infrastructure, service contracts, and other related processes.

[0265] "Notification" refers to a message that the system sends to the user, such as a request for approval of a procedure or a report on its completion status.

[0266] This invention is a system for efficiently managing a series of procedures associated with moving. The embodiments for carrying out the invention will be described in detail below.

[0267] First, the user accesses the system using their own device and enters their current and new addresses, planned moving date, contact information, and other details. This information forms the basis for initiating all necessary procedures for moving. User operations are performed through a web browser interface.

[0268] The entered data is sent to the server via the terminal. Upon receiving this data, the server first accesses the geographic database and APIs of various service providers to identify the necessary procedures based on the user's old and new address information.

[0269] The server lists the identified procedures and, for those that can be automated, communicates using APIs of external organizations. Specifically, it generates API requests to change contracts with power companies and internet providers, and automatically fills in the necessary information into the external organizations' online forms. This automation significantly reduces the effort required from users.

[0270] The server then notifies the user of the details of the procedure performed and requests their approval. Approval is performed on the user's terminal, and if corrections are needed, the user can make the corrections and then approve again.

[0271] Finally, the server receives user approval and completes all procedures. Once the procedures are finished, the server notifies the user of the completion status, ensuring that all administrative tasks related to the move are completed smoothly.

[0272] As a concrete example, consider a user moving from Tokyo to Osaka. Using this system, all the user needs to do is enter their new address and moving date, and the server will automatically handle the administrative procedures and changes to electricity and gas contracts related to the address change. The user only needs to approve these changes to complete the process. This frees the user from the cumbersome procedures associated with moving, allowing them to smoothly start their new life.

[0273] Example of a prompt:

[0274] "The user is planning to move from Tokyo to Osaka Prefecture. Please enter your new address and moving date into the system. Based on that, the system will list the necessary contract changes and administrative procedures and execute them automatically."

[0275] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0276] Step 1:

[0277] The user accesses the interface on the terminal and enters the addresses of the original and destination moving locations, the scheduled moving date, and contact information. The data to be input includes address information, schedule information, and contact information. These information are prepared to be transmitted by the terminal to the server.

[0278] Step 2:

[0279] The terminal transmits the information received from the user to the server. Specifically, the input address information and schedule information are securely transmitted to the server using the SSL / TLS protocol. The input at this step is the user's basic information, and the output is this information transmitted to the server.

[0280] Step 3:

[0281] Based on the received data, the server starts the necessary processing. First, it accesses the geographical database to collect information required for administrative procedures and lifeline contract changes based on the destination address. The input is the address and schedule information, and the output is a list of the necessary procedures.

[0282] Step 4:

[0283] The server accesses each service provider through the API and conducts communication for automatic execution of the identified procedures. Specifically, requests are sent to the APIs of the power company, gas company, and internet service provider to make the necessary contract changes. The input here is the list of procedures and API information, and the output is the success / failure result of the communication with external organizations.

[0284] Step 5:

[0285] Based on the result of the executed procedures, the server sends a notification requesting approval from the user. The notification includes the details of the procedures performed and instructions for the user to approve or modify. The input is the result of the communication, and the output is the approval request message sent to the user's terminal.

[0286] Step 6:

[0287] The user checks the procedure content displayed on the terminal and gives approval or makes necessary corrections. When approval is given, the result is returned to the server through the terminal. The input is the procedure details sent from the server, and the output is the user's approval or correction feedback.

[0288] Step 7:

[0289] The server receives the user's approval result and confirms that all procedures have been completed. After completion, the server sends a completion notice to the user. The output is the notice of procedure completion, finally informing the user that the entire process has ended.

[0290] (Application Example 1)

[0291] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0292] The various procedures that occur during a move are complicated, and it is difficult for residents to quickly and accurately handle the accompanying administrative procedures and contract changes for lifelines. As a result, there is a problem that the smooth transition to a new life is hindered.

[0293] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0294] In this invention, the server includes means for acquiring spatial information and temporal information from the user, means for specifying the necessary processing content based on the acquired spatial information, and means for using the urban spatial information through a support application for citizens. As a result, residents can simplify the procedures when moving and quickly adapt to the new living environment.

[0295] "Spatial information" refers to data that indicates the location of a user's current address or new address, and includes geographical elements.

[0296] "Time information" refers to date and time data related to a user's plans and schedules, indicating the time when a specific event or action occurs.

[0297] "Processing details" refers to information used to identify a series of procedures or actions required by the user, and includes specific tasks and obligations.

[0298] "Communication" refers to a means of exchanging information with an external organization or system, and includes electronic messages and data.

[0299] "Communication" refers to a means of informing users of necessary information, and is transmitted through notifications and messages.

[0300] "Infrastructure services" refer to basic public and private services that residents use in their daily lives, and include electricity, water, and telecommunications.

[0301] "Public institutions" refer to organizations and facilities operated by the government or local authorities that provide administrative procedures and public services.

[0302] A "support application for citizens" is an application designed to provide residents with the information and services they need on a daily basis, and its purpose is convenience and information provision.

[0303] The system that realizes this invention efficiently manages moving procedures using the user's terminal and a server. The user enters detailed moving information using a smartphone or similar device. This includes spatial and temporal information, and all relevant data related to the user's relocation is entered.

[0304] The server receives this information and identifies the necessary processing content. The processing content includes declarations to public institutions and procedures for changing contracts for basic services. To execute these tasks, the server communicates with external organizations using a Node.js server or a Python backend.

[0305] When the user approves or modifies a procedure, the server sends a notification to the user's terminal via Firebase Cloud Messaging. As a result, the user can check the procedure details on the terminal and approve or modify them as needed.

[0306] For example, when a user moves to a new city, they can use a citizen support application to change their address. This application uses the Google Maps API and local government APIs to efficiently manage the user's moving process.

[0307] The entire process can be streamlined by leveraging a generative AI model. Example prompt texts are as follows:

[0308] "Based on the following information, generate a list of the steps of the procedures necessary for the user to smoothly proceed with the move: The new address is 'West Ward, City, Osaka Prefecture', and the planned moving date is 'December 1, 2023'. Also, create a flowchart for automating the procedures by leveraging the relevant APIs."

[0309] The flow of the specific processing in Application Example 1 will be described using FIG. 12.

[0310] Step 1:

[0311] The user accesses the application using the terminal and enters the spatial and temporal information of the move. The input data includes the new address, planned moving date, etc. This data is processed into an appropriate format within the application and then sent to the server.

[0312] Step 2:

[0313] The server analyzes the data received from the terminal and identifies the necessary processing. Specifically, it uses geographic information data and date / time information to determine whether administrative procedures or changes to utility contracts are required due to relocation, and compiles this information into a list. Geographic information databases and various administrative service APIs are used for this determination.

[0314] Step 3:

[0315] The server initiates communication to convey the identified processing details to the external organization. This involves generating API requests and automatically entering data into various public institution systems and online forms of infrastructure service providers. As a result, the necessary procedures are approved or implemented by the external organization.

[0316] Step 4:

[0317] The server sends a notification to the user via Firebase Cloud Messaging or a similar notification service, requesting confirmation of the procedure. This notification includes the progress and outcome of the procedure.

[0318] Step 5:

[0319] The user receives a notification via their device and reviews the procedure details. They make any necessary corrections and send feedback to the server by pressing the approval button. If the procedure details are modified based on the user's input, the server reprocesses the procedure accordingly.

[0320] Step 6:

[0321] The server notifies the user of the completion status after all procedures are finished. This ensures that the user can complete all the necessary procedures for living at their new address and that they can smoothly transition to their new environment.

[0322] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0323] This invention provides an automated moving procedure system that takes user emotions into consideration. This system incorporates an emotion engine that recognizes the user's emotional state when they input information, and has a function to optimize notifications and responses to the procedure according to the user's emotions.

[0324] First, the user uses the device to enter their current and new addresses, the moving date, and contact information. During this process, the device sends the entered data to an emotion engine in real time to analyze the user's emotional state. For example, it can determine emotions using parameters such as the content and speed of text input and the words selected.

[0325] Next, the server identifies the necessary procedures based on the entered address and schedule information and automatically initiates processing. These procedures include changing utility contracts and filing notifications with government agencies, but these processes are performed automatically via APIs from external organizations.

[0326] Once the progress and details of the procedure have been determined, the server sends a notification requesting approval in the most appropriate way, depending on the user's emotional state. For example, if the user is feeling anxious, the server can provide reassuring messages or additional support information.

[0327] Furthermore, after the user approves the procedure, the server uses an emotion engine to provide follow-up while the user is living away from home and even after the procedure is completed. This includes reassuring notifications about the progress of the procedure and customized support, including advice on moving.

[0328] For example, if a user is feeling anxious about moving from Tokyo to Osaka, the server will clarify the moving procedure and important points, and provide information to alleviate the user's anxiety. This allows the user to proceed with the procedure with peace of mind and adapt to their new living environment. In this way, the present invention aims to make the moving procedure more user-friendly.

[0329] The following describes the processing flow.

[0330] Step 1:

[0331] The user enters their current and new addresses, moving date, and contact information in a form on the device. The device receives the user's input data and sends the speed and keystroke patterns to an emotion engine to analyze the user's emotional state in real time.

[0332] Step 2:

[0333] The device sends the results of its analysis of the user's emotional state to the server. This includes information such as whether the user is stressed or excited. The server stores this data, along with the user's address and schedule information, in a database.

[0334] Step 3:

[0335] The server uses the information received from the user to identify the necessary procedures for moving. This involves generating a list of changes to utility contracts and notifications to government agencies, and accessing APIs of external organizations to retrieve the required information.

[0336] Step 4:

[0337] The server automatically sends procedures to external organizations and manages their progress. It also creates approval requests for procedures that take the user's emotional state into consideration. For example, if the user is feeling anxious, it will generate a notification with reassuring wording.

[0338] Step 5:

[0339] The server sends the generated approval request to the terminal. The terminal displays a notification of the approval request to the user, presenting an emotionally sensitive message along with detailed procedural instructions. The user reviews the content and gives instructions to approve or revise the request.

[0340] Step 6:

[0341] Upon receiving user approval or modification information from the terminal, the server completes the procedure or makes any further necessary modifications based on that information. Once the procedure is finally completed, the server generates a completion notification.

[0342] Step 7:

[0343] The server sends a completion notification to the user's device and simultaneously uses an emotion engine to provide additional support related to the move. This includes local information about the new area and helpful advice for settling in. The device then provides this information to the user, supporting them in transitioning to their new environment with confidence.

[0344] (Example 2)

[0345] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0346] In modern times, the procedures associated with moving are often complex and place a significant burden on users. Furthermore, a lack of consideration for users' emotional states during the process and insufficient follow-up can lead to stress and anxiety. Therefore, there is a need for greater user convenience and reduced psychological burden.

[0347] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0348] In this invention, the server includes means for analyzing the user's emotional state, means for sending notifications according to the user's emotional state and requesting approval, and means for notifying the user of the completion status of tasks and providing follow-up information. This enables the user to proceed with the relocation process efficiently and stress-free.

[0349] "Geographic information" refers to information about the place where a user resides or intends to relocate, including addresses and location coordinates.

[0350] "Timing information" refers to information about when a user wants to perform a specific action, and it refers to a specific date or time frame.

[0351] "Business" refers to the practical work and contract processing included in the series of procedures and arrangements related to moving.

[0352] "External mechanisms" refer to external organizations or institutions, including public institutions and service providers with which the system interacts.

[0353] "Emotional state" refers to the psychological or emotional response a user exhibits at a given point in time, and includes stress, a sense of security, tension, and so on.

[0354] "Follow-up information" includes support information and advice provided to users so that they can start their new life with peace of mind after moving.

[0355] "Notification" refers to a means of communicating information to inform users about the progress of procedures, approval requests, etc.

[0356] This invention is an automated moving procedure system that takes user emotions into consideration. It operates in conjunction with a server, terminals, an emotion engine, and external mechanisms. The server is a computing device equipped with a high-performance processor and large-capacity memory, and has a network interface for communicating with external APIs. The terminal has a graphical interface for users to provide input data and has the ability to communicate with the emotion engine in real time. The emotion engine uses a generative AI model to analyze the user's input behavior and identify their emotional state.

[0357] The user first enters basic information about their move (geographical information, timing information) through their device. The device sends the input data to an emotion engine, which analyzes the user's emotional state in real time. The server identifies the necessary tasks based on the entered information and starts processing them automatically.

[0358] The server transmits communications to external mechanisms to efficiently handle procedures related to the move. The user is notified of the progress and follow-up information from the server. During this process, messages are sent that take into account the user's current emotional state, providing reassurance and appropriate advice.

[0359] For example, if a user is feeling anxious about moving to a new area, the server can alleviate their anxiety by sending information about living in the new neighborhood and detailed instructions about the procedures involved. An example of a prompt message to provide to this system would be: "If the system determines that the user is feeling stressed during the moving process, suggest a reassuring support message."

[0360] Thus, the present invention reduces the psychological burden on users and enables smoother service delivery by incorporating emotion recognition technology into the automation of moving procedures.

[0361] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0362] Step 1:

[0363] The user uses the device to enter geographical information, timing, and contact details for their current and new addresses. The device sends this data to the emotion engine. The emotion engine analyzes input speed and word choices to identify the user's emotional state. This result is output as an emotional state the user may be experiencing, such as anxiety or excitement.

[0364] Step 2:

[0365] The server receives geographical and temporal information transmitted from the terminal. Based on this, it initiates a process to identify necessary tasks. The server uses the geographical information to identify, for example, changes in local administrative procedures or essential infrastructure such as electricity and water. As output, it generates a list of tasks to be performed.

[0366] Step 3:

[0367] The server sends communications to an external API to automatically execute a specified task. For example, it might perform a user change procedure via a power company's API. In this case, the progress of the task is generated and recorded as output.

[0368] Step 4:

[0369] The server sends notifications to the user regarding work progress and requests for approval in a way that is optimal based on the user's emotional state. For example, if the server determines that the user is stressed, it will send a notification using reassuring language. Because the content of the notifications changes based on the emotional state, the output is a personalized message.

[0370] Step 5:

[0371] Users review notifications received from the server and approve tasks. They can also request corrections if necessary. User approvals or correction requests are sent to the server and serve as input to proceed to the next step.

[0372] Step 6:

[0373] The server receives user approval or correction instructions and continues or corrects the task. If necessary, it communicates with external mechanisms again to adjust the task details. The output generates a notification indicating the final task completion status or correction completion.

[0374] Step 7:

[0375] The server provides follow-up support to users even after the task is completed. This includes post-migration support information and progress reports. As a final output, users are notified with additional information and advice to provide peace of mind after the migration is complete.

[0376] (Application Example 2)

[0377] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0378] In modern cities, moving to a new residence involves numerous procedures, and the resulting mental burden is a significant problem. Furthermore, the lack of mechanisms to efficiently and emotionally support residents through these moving procedures is a major challenge.

[0379] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0380] In this invention, the server includes a device for acquiring user address information and schedule information, a mechanism for identifying necessary processing based on the acquired address information, and a device for analyzing the user's emotional state and sending an optimal approval notification for the procedure. This not only efficiently automates the procedures associated with moving, but also reduces the emotional burden on the user, allowing them to proceed with the procedures with peace of mind.

[0381] A "user" refers to an individual or organization that uses the system to complete the relocation process.

[0382] "Address information" refers to data used to identify the user's current place of residence or their new place of residence.

[0383] "Schedule information" refers to date information related to the moving date and the procedures involved.

[0384] "Device" refers to the collective term for the hardware or software used to perform each of its functions.

[0385] A "mechanism" refers to the internal processes and procedures of a system configured to achieve a specific function.

[0386] An "external device" is equipment used to transmit information to organizations or systems other than the user.

[0387] "Emotional state" refers to a numerical or qualitative representation of a user's psychological and emotional state.

[0388] A "follow-up notification" is a message sent to provide additional information based on the progress of a procedure or the user's emotional state.

[0389] "Living infrastructure" is a general term for essential infrastructure for daily life, such as electricity and water.

[0390] An "administrative agency" is a public organization operated by the national government or local authorities.

[0391] The system for implementing this invention is realized by combining multiple devices and mechanisms. A server, user terminal, and external devices work together to support the user's relocation process. The specific processing flow is described below.

[0392] First, the user uses the device to enter their moving address and date information. The device then uses an emotion engine that analyzes text input and selected words to determine the user's emotional state. This emotion engine utilizes the Google Cloud Natural Language API to process and analyze the user's emotional data in real time.

[0393] Next, based on the information collected by the server, it identifies the necessary processing and communicates with external devices to execute it. Amazon Web Services (AWS) AWS Lambda and Amazon API Gateway are used for communication with external devices to automate the process.

[0394] Furthermore, the server sends follow-up notifications regarding the progress of the process in the most appropriate way, depending on the user's emotional state. Firebase Cloud Messaging is used to ensure that users receive the information they need quickly.

[0395] For example, when a user moves to a new city, they may need advice on the procedures involved and how to smoothly adapt to the new environment. In this case, the emotion engine detects the user's anxiety, and the system presents a message such as, "Here are some steps to help you start your life in your new city with confidence. Please try them out."

[0396] Examples of prompts for a generative AI model are as follows:

[0397] "Please suggest ways to alleviate the anxiety users feel when moving to a new city."

[0398] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0399] Step 1:

[0400] The user uses their device to enter their new address and moving date information. The entered data is temporarily stored on the device, and the text content and input speed are sent to the sentiment engine.

[0401] Step 2:

[0402] The device uses the Google Cloud Natural Language API to analyze input data in real time and infer the user's emotional state. It analyzes the input text and speed, and outputs emotions such as stress and anticipation as numerical values.

[0403] Step 3:

[0404] The server receives address and schedule information sent from the terminal. Based on this, it identifies the necessary processing and sends a command to an external device via an API to execute the processing. AWS Lambda and Amazon API Gateway are utilized to automate the process.

[0405] Step 4:

[0406] The server generates a notification requesting user approval at the optimal time, based on the user's sentiment information. This notification is sent to the device using Firebase Cloud Messaging. The message includes reassuring language for the user.

[0407] Step 5:

[0408] The user receives a notification on their device and submits an approval or correction. This data is sent back to the server, where the process is advanced and corrections are made. Specifically, changes to utility contracts, for example, are processed automatically.

[0409] Step 6:

[0410] The server aggregates information about the completion status of the procedures. Based on this, it creates and sends follow-up notifications to the user as needed. These notifications include advice on adjusting to life in the new area.

[0411] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0412] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0413] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0414] [Third Embodiment]

[0415] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0416] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0417] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0418] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0419] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0420] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0421] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0422] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0423] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0424] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0425] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0426] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0427] This invention is a system for efficiently managing procedures related to moving, and a specific embodiment thereof is described below.

[0428] First, the user accesses the system using their device and enters basic information such as their current and new addresses, planned moving date, and contact information. The device receives this data and sends it to the server.

[0429] Based on the received address and schedule information, the server creates a list of procedures necessary for moving. During this process, the server retrieves relevant information from geographic information databases and APIs from various service providers to identify necessary administrative procedures and changes to utility contracts.

[0430] Next, the server sends the necessary communications to external organizations (e.g., online application windows of power companies or local governments) to automatically execute the identified procedures. This process includes sending API requests and automatically filling out online application forms.

[0431] Once the procedure details are finalized, the server sends a notification to the user's device requesting approval. The user reviews the procedure details on their device and grants approval. They can also modify the procedure details as needed.

[0432] Finally, the server receives the user's approval or correction and completes the process. After all procedures are complete, the user is notified of the completion status. This reduces the burden of administrative work for the user, allowing them to smoothly start their new life.

[0433] As a concrete example, consider the case of moving from Tokyo to Osaka. When the user enters their new address and moving date into the system, the server automatically creates the corresponding change of address form and updates the contract details for electricity, gas, internet, etc. The user can complete the process simply by reviewing these procedures and clicking the approval button. Throughout this entire process, the user can effectively manage the procedures and start their new life with peace of mind.

[0434] The following describes the processing flow.

[0435] Step 1:

[0436] The user accesses a dedicated form on their device and enters their current and new addresses, planned moving date, and contact information. The device validates the entered data in real time, checking that all required fields are filled in.

[0437] Step 2:

[0438] The device encrypts the data that has passed validation before sending it to the server. The server securely stores the received data in its database.

[0439] Step 3:

[0440] The server uses the stored information to create a list of necessary administrative procedures and changes to utility contracts. During this process, the server retrieves information from geographic information databases and service provider APIs to proceed with the processing.

[0441] Step 4:

[0442] The server sends communications to various providers' APIs to automatically execute identified procedures. These include procedures for changing contracts for electricity, gas, and internet, as well as filing change-in and change-out notifications.

[0443] Step 5:

[0444] After confirming that each procedure is complete, the server sends a notification to the user's device requesting their approval of the procedure. The device then displays this notification to the user and shows the procedure details on a confirmation screen.

[0445] Step 6:

[0446] The user reviews the procedure details on the device screen and approves or modifies them. The result is sent to the server via the device.

[0447] Step 7:

[0448] The server receives the user's approval or correction and proceeds with the necessary processing. Once it confirms that all procedures are complete, the server sends a completion notification to the user via the terminal, informing them that they are ready to begin their new life.

[0449] (Example 1)

[0450] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0451] The procedures involved in moving are complex and burdensome for users, as they require contacting numerous different agencies, completing administrative procedures, and changing utility contracts. In particular, the need to proceed with each procedure individually presents challenges in managing the progress of the process and the likelihood of omissions.

[0452] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0453] In this invention, the server includes means for acquiring property information and schedule information from the user, means for identifying necessary tasks based on the acquired property information, and means for transmitting communications to an external organization for the automatic execution of the identified tasks. This allows the user to centrally manage all procedures related to moving and start their new life efficiently and quickly.

[0454] A "user" refers to an individual or corporation that uses this system to complete relocation procedures.

[0455] "Property information" refers to basic data necessary for the procedure, including information related to the address of the current and new address.

[0456] "Planned information" refers to information about the specific date and timing of the move, and serves as the basis for planning the procedural schedule.

[0457] "External organizations" refers to all external organizations that a user may need to interact with when moving, such as power companies, gas companies, internet providers, and government agencies.

[0458] "Administrative tasks" refers to the general term for procedures that users need to perform, such as changing utility contracts or filing notifications with the government when moving.

[0459] A "geographic database" refers to a database containing geographical information that is referenced when identifying necessary procedures based on address information.

[0460] A "service provider API" refers to an application programming interface used by an external service provider to facilitate changes to infrastructure, service contracts, and other related processes.

[0461] "Notification" refers to a message that the system sends to the user, such as a request for approval of a procedure or a report on its completion status.

[0462] This invention is a system for efficiently managing a series of procedures associated with moving. The embodiments for carrying out the invention will be described in detail below.

[0463] First, the user accesses the system using their own device and enters their current and new addresses, planned moving date, contact information, and other details. This information forms the basis for initiating all necessary procedures for moving. User operations are performed through a web browser interface.

[0464] The entered data is sent to the server via the terminal. Upon receiving this data, the server first accesses the geographic database and APIs of various service providers to identify the necessary procedures based on the user's old and new address information.

[0465] The server lists the identified procedures and, for those that can be automated, communicates using APIs of external organizations. Specifically, it generates API requests to change contracts with power companies and internet providers, and automatically fills in the necessary information into the external organizations' online forms. This automation significantly reduces the effort required from users.

[0466] The server then notifies the user of the details of the procedure performed and requests their approval. Approval is performed on the user's terminal, and if corrections are needed, the user can make the corrections and then approve again.

[0467] Finally, the server receives user approval and completes all procedures. Once the procedures are finished, the server notifies the user of the completion status, ensuring that all administrative tasks related to the move are completed smoothly.

[0468] As a concrete example, consider a user moving from Tokyo to Osaka. Using this system, all the user needs to do is enter their new address and moving date, and the server will automatically handle the administrative procedures and changes to electricity and gas contracts related to the address change. The user only needs to approve these changes to complete the process. This frees the user from the cumbersome procedures associated with moving, allowing them to smoothly start their new life.

[0469] Example of a prompt:

[0470] "The user is planning to move from Tokyo to Osaka Prefecture. Please enter your new address and moving date into the system. Based on that, the system will list the necessary contract changes and administrative procedures and execute them automatically."

[0471] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0472] Step 1:

[0473] The user accesses an interface on their device and enters their current and new addresses, planned moving date, and contact information. The entered data includes address information, date information, and contact information. This information is then prepared for transmission to the server by the device.

[0474] Step 2:

[0475] The terminal sends the information received from the user to the server. Specifically, it securely transmits the entered address and schedule information to the server using the SSL / TLS protocol. The input in this step is the user's basic information, and the output is this information sent to the server.

[0476] Step 3:

[0477] The server initiates the necessary processing based on the received data. First, it accesses the geographic database to collect information necessary for administrative procedures and changes to utility contracts based on the new address. The input is address and date information, and the output is a list of the necessary procedures.

[0478] Step 4:

[0479] The server accesses each service provider via APIs and communicates to automatically execute identified procedures. Specifically, it sends requests to the APIs of power companies, gas companies, and internet service providers to make necessary contract changes. The inputs here are a list of procedures and API information, and the output is the success / failure result of communication with external organizations.

[0480] Step 5:

[0481] The server sends a notification to the user requesting approval based on the results of the procedure. The notification includes details of the procedure performed and instructions for the user to approve or modify it. The input is the result of the communication, and the output is the approval request message sent to the user's terminal.

[0482] Step 6:

[0483] The user reviews the procedure details displayed on the terminal and approves or makes any necessary corrections. Once approved, the result is returned to the server via the terminal. The input is the procedure details sent from the server, and the output is the user's feedback regarding approval or corrections.

[0484] Step 7:

[0485] The server receives the user's approval and confirms that all procedures are complete. After completion, the server sends a completion notification to the user. The output is a notification of procedure completion, finally informing the user that the entire process is finished.

[0486] (Application Example 1)

[0487] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0488] The numerous procedures involved in moving are complex, making it difficult for residents to quickly and accurately complete the associated administrative procedures and changes to utility contracts. This creates a challenge in ensuring a smooth transition to a new life.

[0489] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0490] In this invention, the server includes means for acquiring spatial and temporal information from a user, means for identifying necessary processing content based on the acquired spatial information, and means for utilizing urban spatial information through a support application for citizens. This allows residents to simplify the procedures when moving and quickly adapt to their new living environment.

[0491] "Spatial information" refers to data that indicates the location of a user's current address or new address, and includes geographical elements.

[0492] "Time information" refers to date and time data related to a user's plans and schedules, indicating the time when a specific event or action occurs.

[0493] "Processing details" refers to information used to identify a series of procedures or actions required by the user, and includes specific tasks and obligations.

[0494] "Communication" refers to a means of exchanging information with an external organization or system, and includes electronic messages and data.

[0495] "Communication" refers to a means of informing users of necessary information, and is transmitted through notifications and messages.

[0496] "Infrastructure services" refer to basic public and private services that residents use in their daily lives, and include electricity, water, and telecommunications.

[0497] "Public institutions" refer to organizations and facilities operated by the government or local authorities that provide administrative procedures and public services.

[0498] A "support application for citizens" is an application designed to provide residents with the information and services they need on a daily basis, and its purpose is convenience and information provision.

[0499] The system that realizes this invention efficiently manages moving procedures using the user's terminal and a server. The user enters detailed moving information using a smartphone or similar device. This includes spatial and temporal information, and all relevant data related to the user's relocation is entered.

[0500] The server receives this information and identifies the necessary actions to be taken. These actions may include reporting to public institutions or changing contracts for underlying services. To perform these tasks, the server communicates with external organizations using a Node.js server and a Python backend.

[0501] When a user approves or modifies a procedure, the server sends a notification to the user's device via Firebase Cloud Messaging. This allows the user to review the procedure on their device and approve or modify it as needed.

[0502] For example, when a user moves to a new city, they can use a citizen support application to change their address. This application uses Google Maps API and local government APIs to efficiently manage the user's relocation process.

[0503] This entire process can be made more efficient by utilizing generative AI models. An example of a prompt would be:

[0504] "Based on the following information, please generate a list of steps necessary for a user to smoothly complete their move: New address is 'Nishi-ku, Osaka Prefecture', and planned moving date is 'December 1, 2023'. Also, please create a flowchart that automates the process using relevant APIs."

[0505] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0506] Step 1:

[0507] Users access the application using their devices and input spatial and temporal information about their move. This input data includes the new address and planned moving date. This data is processed into an appropriate format within the app and then sent to the server.

[0508] Step 2:

[0509] The server analyzes the data received from the terminal and identifies the necessary processing. Specifically, it uses geographic information data and date / time information to determine whether administrative procedures or changes to utility contracts are required due to relocation, and compiles this information into a list. Geographic information databases and various administrative service APIs are used for this determination.

[0510] Step 3:

[0511] The server initiates communication to convey the identified processing details to the external organization. This involves generating API requests and automatically entering data into various public institution systems and online forms of infrastructure service providers. As a result, the necessary procedures are approved or implemented by the external organization.

[0512] Step 4:

[0513] The server sends a notification to the user via Firebase Cloud Messaging or a similar notification service, requesting confirmation of the procedure. This notification includes the progress and outcome of the procedure.

[0514] Step 5:

[0515] The user receives a notification via their device and reviews the procedure details. They make any necessary corrections and send feedback to the server by pressing the approval button. If the procedure details are modified based on the user's input, the server reprocesses the procedure accordingly.

[0516] Step 6:

[0517] The server notifies the user of the completion status after all procedures are finished. This ensures that the user can complete all the necessary procedures for living at their new address and that they can smoothly transition to their new environment.

[0518] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0519] This invention provides an automated moving procedure system that takes user emotions into consideration. This system incorporates an emotion engine that recognizes the user's emotional state when they input information, and has a function to optimize notifications and responses to the procedure according to the user's emotions.

[0520] First, the user uses the device to enter their current and new addresses, the moving date, and contact information. During this process, the device sends the entered data to an emotion engine in real time to analyze the user's emotional state. For example, it can determine emotions using parameters such as the content and speed of text input and the words selected.

[0521] Next, the server identifies the necessary procedures based on the entered address and schedule information and automatically initiates processing. These procedures include changing utility contracts and filing notifications with government agencies, but these processes are performed automatically via APIs from external organizations.

[0522] Once the progress and details of the procedure have been determined, the server sends a notification requesting approval in the most appropriate way, depending on the user's emotional state. For example, if the user is feeling anxious, the server can provide reassuring messages or additional support information.

[0523] Furthermore, after the user approves the procedure, the server uses an emotion engine to provide follow-up while the user is living away from home and even after the procedure is completed. This includes reassuring notifications about the progress of the procedure and customized support, including advice on moving.

[0524] For example, if a user is feeling anxious about moving from Tokyo to Osaka, the server will clarify the moving procedure and important points, and provide information to alleviate the user's anxiety. This allows the user to proceed with the procedure with peace of mind and adapt to their new living environment. In this way, the present invention aims to make the moving procedure more user-friendly.

[0525] The following describes the processing flow.

[0526] Step 1:

[0527] The user enters their current and new addresses, moving date, and contact information in a form on the device. The device receives the user's input data and sends the speed and keystroke patterns to an emotion engine to analyze the user's emotional state in real time.

[0528] Step 2:

[0529] The device sends the results of its analysis of the user's emotional state to the server. This includes information such as whether the user is stressed or excited. The server stores this data, along with the user's address and schedule information, in a database.

[0530] Step 3:

[0531] The server uses the information received from the user to identify the necessary procedures for moving. This involves generating a list of changes to utility contracts and notifications to government agencies, and accessing APIs of external organizations to retrieve the required information.

[0532] Step 4:

[0533] The server automatically sends procedures to external organizations and manages their progress. It also creates approval requests for procedures that take the user's emotional state into consideration. For example, if the user is feeling anxious, it will generate a notification with reassuring wording.

[0534] Step 5:

[0535] The server sends the generated approval request to the terminal. The terminal displays a notification of the approval request to the user, presenting an emotionally sensitive message along with detailed procedural instructions. The user reviews the content and gives instructions to approve or revise the request.

[0536] Step 6:

[0537] Upon receiving user approval or modification information from the terminal, the server completes the procedure or makes any further necessary modifications based on that information. Once the procedure is finally completed, the server generates a completion notification.

[0538] Step 7:

[0539] The server sends a completion notification to the user's device and simultaneously uses an emotion engine to provide additional support related to the move. This includes local information about the new area and helpful advice for settling in. The device then provides this information to the user, supporting them in transitioning to their new environment with confidence.

[0540] (Example 2)

[0541] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0542] In modern times, the procedures associated with moving are often complex and place a significant burden on users. Furthermore, a lack of consideration for users' emotional states during the process and insufficient follow-up can lead to stress and anxiety. Therefore, there is a need for greater user convenience and reduced psychological burden.

[0543] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0544] In this invention, the server includes means for analyzing the user's emotional state, means for sending notifications according to the user's emotional state and requesting approval, and means for notifying the user of the completion status of tasks and providing follow-up information. This enables the user to proceed with the relocation process efficiently and stress-free.

[0545] "Geographic information" refers to information about the place where a user resides or intends to relocate, including addresses and location coordinates.

[0546] "Timing information" refers to information about when a user wants to perform a specific action, and it refers to a specific date or time frame.

[0547] "Business" refers to the practical work and contract processing included in the series of procedures and arrangements related to moving.

[0548] "External mechanisms" refer to external organizations or institutions, including public institutions and service providers with which the system interacts.

[0549] "Emotional state" refers to the psychological or emotional response a user exhibits at a given point in time, and includes stress, a sense of security, tension, and so on.

[0550] "Follow-up information" includes support information and advice provided to users so that they can start their new life with peace of mind after moving.

[0551] "Notification" refers to a means of communicating information to inform users about the progress of procedures, approval requests, etc.

[0552] This invention is an automated moving procedure system that takes user emotions into consideration. It operates in conjunction with a server, terminals, an emotion engine, and external mechanisms. The server is a computing device equipped with a high-performance processor and large-capacity memory, and has a network interface for communicating with external APIs. The terminal has a graphical interface for users to provide input data and has the ability to communicate with the emotion engine in real time. The emotion engine uses a generative AI model to analyze the user's input behavior and identify their emotional state.

[0553] The user first enters basic information about their move (geographical information, timing information) through their device. The device sends the input data to an emotion engine, which analyzes the user's emotional state in real time. The server identifies the necessary tasks based on the entered information and starts processing them automatically.

[0554] The server transmits communications to external mechanisms to efficiently handle procedures related to the move. The user is notified of the progress and follow-up information from the server. During this process, messages are sent that take into account the user's current emotional state, providing reassurance and appropriate advice.

[0555] For example, if a user is feeling anxious about moving to a new area, the server can alleviate their anxiety by sending information about living in the new neighborhood and detailed instructions about the procedures involved. An example of a prompt message to provide to this system would be: "If the system determines that the user is feeling stressed during the moving process, suggest a reassuring support message."

[0556] Thus, the present invention reduces the psychological burden on users and enables smoother service delivery by incorporating emotion recognition technology into the automation of moving procedures.

[0557] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0558] Step 1:

[0559] The user uses the device to enter geographical information, timing, and contact details for their current and new addresses. The device sends this data to the emotion engine. The emotion engine analyzes input speed and word choices to identify the user's emotional state. This result is output as an emotional state the user may be experiencing, such as anxiety or excitement.

[0560] Step 2:

[0561] The server receives geographical and temporal information transmitted from the terminal. Based on this, it initiates a process to identify necessary tasks. The server uses the geographical information to identify, for example, changes in local administrative procedures or essential infrastructure such as electricity and water. As output, it generates a list of tasks to be performed.

[0562] Step 3:

[0563] The server sends communications to an external API to automatically execute a specified task. For example, it might perform a user change procedure via a power company's API. In this case, the progress of the task is generated and recorded as output.

[0564] Step 4:

[0565] The server sends notifications to the user regarding work progress and requests for approval in a way that is optimal based on the user's emotional state. For example, if the server determines that the user is stressed, it will send a notification using reassuring language. Because the content of the notifications changes based on the emotional state, the output is a personalized message.

[0566] Step 5:

[0567] Users review notifications received from the server and approve tasks. They can also request corrections if necessary. User approvals or correction requests are sent to the server and serve as input to proceed to the next step.

[0568] Step 6:

[0569] The server receives user approval or correction instructions and continues or corrects the task. If necessary, it communicates with external mechanisms again to adjust the task details. The output generates a notification indicating the final task completion status or correction completion.

[0570] Step 7:

[0571] The server provides follow-up support to users even after the task is completed. This includes post-migration support information and progress reports. As a final output, users are notified with additional information and advice to provide peace of mind after the migration is complete.

[0572] (Application Example 2)

[0573] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0574] In modern cities, moving to a new residence involves numerous procedures, and the resulting mental burden is a significant problem. Furthermore, the lack of mechanisms to efficiently and emotionally support residents through these moving procedures is a major challenge.

[0575] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0576] In this invention, the server includes a device for acquiring user address information and schedule information, a mechanism for identifying necessary processing based on the acquired address information, and a device for analyzing the user's emotional state and sending an optimal approval notification for the procedure. This not only efficiently automates the procedures associated with moving, but also reduces the emotional burden on the user, allowing them to proceed with the procedures with peace of mind.

[0577] A "user" refers to an individual or organization that uses the system to complete the relocation process.

[0578] "Address information" refers to data used to identify the user's current place of residence or their new place of residence.

[0579] "Schedule information" refers to date information related to the moving date and the procedures involved.

[0580] "Device" refers to the collective term for the hardware or software used to perform each of its functions.

[0581] A "mechanism" refers to the internal processes and procedures of a system configured to achieve a specific function.

[0582] An "external device" is equipment used to transmit information to organizations or systems other than the user.

[0583] "Emotional state" refers to a numerical or qualitative representation of a user's psychological and emotional state.

[0584] A "follow-up notification" is a message sent to provide additional information based on the progress of a procedure or the user's emotional state.

[0585] "Living infrastructure" is a general term for essential infrastructure for daily life, such as electricity and water.

[0586] An "administrative agency" is a public organization operated by the national government or local authorities.

[0587] The system for implementing this invention is realized by combining multiple devices and mechanisms. A server, user terminal, and external devices work together to support the user's relocation process. The specific processing flow is described below.

[0588] First, the user uses the device to enter their moving address and date information. The device then uses an emotion engine that analyzes text input and selected words to determine the user's emotional state. This emotion engine utilizes the Google Cloud Natural Language API to process and analyze the user's emotional data in real time.

[0589] Next, based on the information collected by the server, it identifies the necessary processing and communicates with external devices to execute it. Amazon Web Services (AWS) AWS Lambda and Amazon API Gateway are used for communication with external devices to automate the process.

[0590] Furthermore, the server sends follow-up notifications regarding the progress of the process in the most appropriate way, depending on the user's emotional state. Firebase Cloud Messaging is used to ensure that users receive the information they need quickly.

[0591] For example, when a user moves to a new city, they may need advice on the procedures involved and how to smoothly adapt to the new environment. In this case, the emotion engine detects the user's anxiety, and the system presents a message such as, "Here are some steps to help you start your life in your new city with confidence. Please try them out."

[0592] Examples of prompts for a generative AI model are as follows:

[0593] "Please suggest ways to alleviate the anxiety users feel when moving to a new city."

[0594] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0595] Step 1:

[0596] The user uses their device to enter their new address and moving date information. The entered data is temporarily stored on the device, and the text content and input speed are sent to the sentiment engine.

[0597] Step 2:

[0598] The device uses the Google Cloud Natural Language API to analyze input data in real time and infer the user's emotional state. It analyzes the input text and speed, and outputs emotions such as stress and anticipation as numerical values.

[0599] Step 3:

[0600] The server receives address and schedule information sent from the terminal. Based on this, it identifies the necessary processing and sends a command to an external device via an API to execute the processing. AWS Lambda and Amazon API Gateway are utilized to automate the process.

[0601] Step 4:

[0602] The server generates a notification requesting user approval at the optimal time, based on the user's sentiment information. This notification is sent to the device using Firebase Cloud Messaging. The message includes reassuring language for the user.

[0603] Step 5:

[0604] The user receives a notification on their device and submits an approval or correction. This data is sent back to the server, where the process is advanced and corrections are made. Specifically, changes to utility contracts, for example, are processed automatically.

[0605] Step 6:

[0606] The server aggregates information about the completion status of the procedures. Based on this, it creates and sends follow-up notifications to the user as needed. These notifications include advice on adjusting to life in the new area.

[0607] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0608] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0609] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0610] [Fourth Embodiment]

[0611] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0612] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0613] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0614] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0615] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0616] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0617] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0618] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0619] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0620] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0621] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0622] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0623] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0624] This invention is a system for efficiently managing procedures related to moving, and a specific embodiment thereof is described below.

[0625] First, the user accesses the system using their device and enters basic information such as their current and new addresses, planned moving date, and contact information. The device receives this data and sends it to the server.

[0626] Based on the received address and schedule information, the server creates a list of procedures necessary for moving. During this process, the server retrieves relevant information from geographic information databases and APIs from various service providers to identify necessary administrative procedures and changes to utility contracts.

[0627] Next, the server sends the necessary communications to external organizations (e.g., online application windows of power companies or local governments) to automatically execute the identified procedures. This process includes sending API requests and automatically filling out online application forms.

[0628] Once the procedure details are finalized, the server sends a notification to the user's device requesting approval. The user reviews the procedure details on their device and grants approval. They can also modify the procedure details as needed.

[0629] Finally, the server receives the user's approval or correction and completes the process. After all procedures are complete, the user is notified of the completion status. This reduces the burden of administrative work for the user, allowing them to smoothly start their new life.

[0630] As a concrete example, consider the case of moving from Tokyo to Osaka. When the user enters their new address and moving date into the system, the server automatically creates the corresponding change of address form and updates the contract details for electricity, gas, internet, etc. The user can complete the process simply by reviewing these procedures and clicking the approval button. Throughout this entire process, the user can effectively manage the procedures and start their new life with peace of mind.

[0631] The following describes the processing flow.

[0632] Step 1:

[0633] The user accesses a dedicated form on their device and enters their current and new addresses, planned moving date, and contact information. The device validates the entered data in real time, checking that all required fields are filled in.

[0634] Step 2:

[0635] The device encrypts the data that has passed validation before sending it to the server. The server securely stores the received data in its database.

[0636] Step 3:

[0637] The server uses the stored information to create a list of necessary administrative procedures and changes to utility contracts. During this process, the server retrieves information from geographic information databases and service provider APIs to proceed with the processing.

[0638] Step 4:

[0639] The server sends communications to various providers' APIs to automatically execute identified procedures. These include procedures for changing contracts for electricity, gas, and internet, as well as filing change-in and change-out notifications.

[0640] Step 5:

[0641] After confirming that each procedure is complete, the server sends a notification to the user's device requesting their approval of the procedure. The device then displays this notification to the user and shows the procedure details on a confirmation screen.

[0642] Step 6:

[0643] The user reviews the procedure details on the device screen and approves or modifies them. The result is sent to the server via the device.

[0644] Step 7:

[0645] The server receives the user's approval or correction and proceeds with the necessary processing. Once it confirms that all procedures are complete, the server sends a completion notification to the user via the terminal, informing them that they are ready to begin their new life.

[0646] (Example 1)

[0647] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0648] The procedures involved in moving are complex and burdensome for users, as they require contacting numerous different agencies, completing administrative procedures, and changing utility contracts. In particular, the need to proceed with each procedure individually presents challenges in managing the progress of the process and the likelihood of omissions.

[0649] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0650] In this invention, the server includes means for acquiring property information and schedule information from the user, means for identifying necessary tasks based on the acquired property information, and means for transmitting communications to an external organization for the automatic execution of the identified tasks. This allows the user to centrally manage all procedures related to moving and start their new life efficiently and quickly.

[0651] A "user" refers to an individual or corporation that uses this system to complete relocation procedures.

[0652] "Property information" refers to basic data necessary for the procedure, including information related to the address of the current and new address.

[0653] "Planned information" refers to information about the specific date and timing of the move, and serves as the basis for planning the procedural schedule.

[0654] "External organizations" refers to all external organizations that a user may need to interact with when moving, such as power companies, gas companies, internet providers, and government agencies.

[0655] "Administrative tasks" refers to the general term for procedures that users need to perform, such as changing utility contracts or filing notifications with the government when moving.

[0656] A "geographic database" refers to a database containing geographical information that is referenced when identifying necessary procedures based on address information.

[0657] A "service provider API" refers to an application programming interface used by an external service provider to facilitate changes to infrastructure, service contracts, and other related processes.

[0658] "Notification" refers to a message that the system sends to the user, such as a request for approval of a procedure or a report on its completion status.

[0659] This invention is a system for efficiently managing a series of procedures associated with moving. The embodiments for carrying out the invention will be described in detail below.

[0660] First, the user accesses the system using their own device and enters their current and new addresses, planned moving date, contact information, and other details. This information forms the basis for initiating all necessary procedures for moving. User operations are performed through a web browser interface.

[0661] The entered data is sent to the server via the terminal. Upon receiving this data, the server first accesses the geographic database and APIs of various service providers to identify the necessary procedures based on the user's old and new address information.

[0662] The server lists the identified procedures and, for those that can be automated, communicates using APIs of external organizations. Specifically, it generates API requests to change contracts with power companies and internet providers, and automatically fills in the necessary information into the external organizations' online forms. This automation significantly reduces the effort required from users.

[0663] The server then notifies the user of the details of the procedure performed and requests their approval. Approval is performed on the user's terminal, and if corrections are needed, the user can make the corrections and then approve again.

[0664] Finally, the server receives user approval and completes all procedures. Once the procedures are finished, the server notifies the user of the completion status, ensuring that all administrative tasks related to the move are completed smoothly.

[0665] As a concrete example, consider a user moving from Tokyo to Osaka. Using this system, all the user needs to do is enter their new address and moving date, and the server will automatically handle the administrative procedures and changes to electricity and gas contracts related to the address change. The user only needs to approve these changes to complete the process. This frees the user from the cumbersome procedures associated with moving, allowing them to smoothly start their new life.

[0666] Example of a prompt:

[0667] "The user is planning to move from Tokyo to Osaka Prefecture. Please enter your new address and moving date into the system. Based on that, the system will list the necessary contract changes and administrative procedures and execute them automatically."

[0668] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0669] Step 1:

[0670] The user accesses an interface on their device and enters their current and new addresses, planned moving date, and contact information. The entered data includes address information, date information, and contact information. This information is then prepared for transmission to the server by the device.

[0671] Step 2:

[0672] The terminal sends the information received from the user to the server. Specifically, it securely transmits the entered address and schedule information to the server using the SSL / TLS protocol. The input in this step is the user's basic information, and the output is this information sent to the server.

[0673] Step 3:

[0674] The server initiates the necessary processing based on the received data. First, it accesses the geographic database to collect information necessary for administrative procedures and changes to utility contracts based on the new address. The input is address and date information, and the output is a list of the necessary procedures.

[0675] Step 4:

[0676] The server accesses each service provider via APIs and communicates to automatically execute identified procedures. Specifically, it sends requests to the APIs of power companies, gas companies, and internet service providers to make necessary contract changes. The inputs here are a list of procedures and API information, and the output is the success / failure result of communication with external organizations.

[0677] Step 5:

[0678] The server sends a notification to the user requesting approval based on the results of the procedure. The notification includes details of the procedure performed and instructions for the user to approve or modify it. The input is the result of the communication, and the output is the approval request message sent to the user's terminal.

[0679] Step 6:

[0680] The user reviews the procedure details displayed on the terminal and approves or makes any necessary corrections. Once approved, the result is returned to the server via the terminal. The input is the procedure details sent from the server, and the output is the user's feedback regarding approval or corrections.

[0681] Step 7:

[0682] The server receives the user's approval and confirms that all procedures are complete. After completion, the server sends a completion notification to the user. The output is a notification of procedure completion, finally informing the user that the entire process is finished.

[0683] (Application Example 1)

[0684] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0685] The numerous procedures involved in moving are complex, making it difficult for residents to quickly and accurately complete the associated administrative procedures and changes to utility contracts. This creates a challenge in ensuring a smooth transition to a new life.

[0686] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0687] In this invention, the server includes means for acquiring spatial and temporal information from a user, means for identifying necessary processing content based on the acquired spatial information, and means for utilizing urban spatial information through a support application for citizens. This allows residents to simplify the procedures when moving and quickly adapt to their new living environment.

[0688] "Spatial information" refers to data that indicates the location of a user's current address or new address, and includes geographical elements.

[0689] "Time information" refers to date and time data related to a user's plans and schedules, indicating the time when a specific event or action occurs.

[0690] "Processing details" refers to information used to identify a series of procedures or actions required by the user, and includes specific tasks and obligations.

[0691] "Communication" refers to a means of exchanging information with an external organization or system, and includes electronic messages and data.

[0692] "Communication" refers to a means of informing users of necessary information, and is transmitted through notifications and messages.

[0693] "Infrastructure services" refer to basic public and private services that residents use in their daily lives, and include electricity, water, and telecommunications.

[0694] "Public institutions" refer to organizations and facilities operated by the government or local authorities that provide administrative procedures and public services.

[0695] A "support application for citizens" is an application designed to provide residents with the information and services they need on a daily basis, and its purpose is convenience and information provision.

[0696] The system that realizes this invention efficiently manages moving procedures using the user's terminal and a server. The user enters detailed moving information using a smartphone or similar device. This includes spatial and temporal information, and all relevant data related to the user's relocation is entered.

[0697] The server receives this information and identifies the necessary actions to be taken. These actions may include reporting to public institutions or changing contracts for underlying services. To perform these tasks, the server communicates with external organizations using a Node.js server and a Python backend.

[0698] When a user approves or modifies a procedure, the server sends a notification to the user's device via Firebase Cloud Messaging. This allows the user to review the procedure on their device and approve or modify it as needed.

[0699] For example, when a user moves to a new city, they can use a citizen support application to change their address. This application uses Google Maps API and local government APIs to efficiently manage the user's relocation process.

[0700] This entire process can be made more efficient by utilizing generative AI models. An example of a prompt would be:

[0701] "Based on the following information, please generate a list of steps necessary for a user to smoothly complete their move: New address is 'Nishi-ku, Osaka Prefecture', and planned moving date is 'December 1, 2023'. Also, please create a flowchart that automates the process using relevant APIs."

[0702] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0703] Step 1:

[0704] Users access the application using their devices and input spatial and temporal information about their move. This input data includes the new address and planned moving date. This data is processed into an appropriate format within the app and then sent to the server.

[0705] Step 2:

[0706] The server analyzes the data received from the terminal and identifies the necessary processing. Specifically, it uses geographic information data and date / time information to determine whether administrative procedures or changes to utility contracts are required due to relocation, and compiles this information into a list. Geographic information databases and various administrative service APIs are used for this determination.

[0707] Step 3:

[0708] The server initiates communication to convey the identified processing details to the external organization. This involves generating API requests and automatically entering data into various public institution systems and online forms of infrastructure service providers. As a result, the necessary procedures are approved or implemented by the external organization.

[0709] Step 4:

[0710] The server sends a notification to the user via Firebase Cloud Messaging or a similar notification service, requesting confirmation of the procedure. This notification includes the progress and outcome of the procedure.

[0711] Step 5:

[0712] The user receives a notification via their device and reviews the procedure details. They make any necessary corrections and send feedback to the server by pressing the approval button. If the procedure details are modified based on the user's input, the server reprocesses the procedure accordingly.

[0713] Step 6:

[0714] The server notifies the user of the completion status after all procedures are finished. This ensures that the user can complete all the necessary procedures for living at their new address and that they can smoothly transition to their new environment.

[0715] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0716] This invention provides an automated moving procedure system that takes user emotions into consideration. This system incorporates an emotion engine that recognizes the user's emotional state when they input information, and has a function to optimize notifications and responses to the procedure according to the user's emotions.

[0717] First, the user uses the device to enter their current and new addresses, the moving date, and contact information. During this process, the device sends the entered data to an emotion engine in real time to analyze the user's emotional state. For example, it can determine emotions using parameters such as the content and speed of text input and the words selected.

[0718] Next, the server identifies the necessary procedures based on the entered address and schedule information and automatically initiates processing. These procedures include changing utility contracts and filing notifications with government agencies, but these processes are performed automatically via APIs from external organizations.

[0719] Once the progress and details of the procedure have been determined, the server sends a notification requesting approval in the most appropriate way, depending on the user's emotional state. For example, if the user is feeling anxious, the server can provide reassuring messages or additional support information.

[0720] Furthermore, after the user approves the procedure, the server uses an emotion engine to provide follow-up while the user is living away from home and even after the procedure is completed. This includes reassuring notifications about the progress of the procedure and customized support, including advice on moving.

[0721] For example, if a user is feeling anxious about moving from Tokyo to Osaka, the server will clarify the moving procedure and important points, and provide information to alleviate the user's anxiety. This allows the user to proceed with the procedure with peace of mind and adapt to their new living environment. In this way, the present invention aims to make the moving procedure more user-friendly.

[0722] The following describes the processing flow.

[0723] Step 1:

[0724] The user enters their current and new addresses, moving date, and contact information in a form on the device. The device receives the user's input data and sends the speed and keystroke patterns to an emotion engine to analyze the user's emotional state in real time.

[0725] Step 2:

[0726] The device sends the results of its analysis of the user's emotional state to the server. This includes information such as whether the user is stressed or excited. The server stores this data, along with the user's address and schedule information, in a database.

[0727] Step 3:

[0728] The server uses the information received from the user to identify the necessary procedures for moving. This involves generating a list of changes to utility contracts and notifications to government agencies, and accessing APIs of external organizations to retrieve the required information.

[0729] Step 4:

[0730] The server automatically sends procedures to external organizations and manages their progress. It also creates approval requests for procedures that take the user's emotional state into consideration. For example, if the user is feeling anxious, it will generate a notification with reassuring wording.

[0731] Step 5:

[0732] The server sends the generated approval request to the terminal. The terminal displays a notification of the approval request to the user, presenting an emotionally sensitive message along with detailed procedural instructions. The user reviews the content and gives instructions to approve or revise the request.

[0733] Step 6:

[0734] Upon receiving user approval or modification information from the terminal, the server completes the procedure or makes any further necessary modifications based on that information. Once the procedure is finally completed, the server generates a completion notification.

[0735] Step 7:

[0736] The server sends a completion notification to the user's device and simultaneously uses an emotion engine to provide additional support related to the move. This includes local information about the new area and helpful advice for settling in. The device then provides this information to the user, supporting them in transitioning to their new environment with confidence.

[0737] (Example 2)

[0738] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0739] In modern times, the procedures associated with moving are often complex and place a significant burden on users. Furthermore, a lack of consideration for users' emotional states during the process and insufficient follow-up can lead to stress and anxiety. Therefore, there is a need for greater user convenience and reduced psychological burden.

[0740] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0741] In this invention, the server includes means for analyzing the user's emotional state, means for sending notifications according to the user's emotional state and requesting approval, and means for notifying the user of the completion status of tasks and providing follow-up information. This enables the user to proceed with the relocation process efficiently and stress-free.

[0742] "Geographic information" refers to information about the place where a user resides or intends to relocate, including addresses and location coordinates.

[0743] "Timing information" refers to information about when a user wants to perform a specific action, and it refers to a specific date or time frame.

[0744] "Business" refers to the practical work and contract processing included in the series of procedures and arrangements related to moving.

[0745] "External mechanisms" refer to external organizations or institutions, including public institutions and service providers with which the system interacts.

[0746] "Emotional state" refers to the psychological or emotional response a user exhibits at a given point in time, and includes stress, a sense of security, tension, and so on.

[0747] "Follow-up information" includes support information and advice provided to users so that they can start their new life with peace of mind after moving.

[0748] "Notification" refers to a means of communicating information to inform users about the progress of procedures, approval requests, etc.

[0749] This invention is an automated moving procedure system that takes user emotions into consideration. It operates in conjunction with a server, terminals, an emotion engine, and external mechanisms. The server is a computing device equipped with a high-performance processor and large-capacity memory, and has a network interface for communicating with external APIs. The terminal has a graphical interface for users to provide input data and has the ability to communicate with the emotion engine in real time. The emotion engine uses a generative AI model to analyze the user's input behavior and identify their emotional state.

[0750] The user first enters basic information about their move (geographical information, timing information) through their device. The device sends the input data to an emotion engine, which analyzes the user's emotional state in real time. The server identifies the necessary tasks based on the entered information and starts processing them automatically.

[0751] The server transmits communications to external mechanisms to efficiently handle procedures related to the move. The user is notified of the progress and follow-up information from the server. During this process, messages are sent that take into account the user's current emotional state, providing reassurance and appropriate advice.

[0752] For example, if a user is feeling anxious about moving to a new area, the server can alleviate their anxiety by sending information about living in the new neighborhood and detailed instructions about the procedures involved. An example of a prompt message to provide to this system would be: "If the system determines that the user is feeling stressed during the moving process, suggest a reassuring support message."

[0753] Thus, the present invention reduces the psychological burden on users and enables smoother service delivery by incorporating emotion recognition technology into the automation of moving procedures.

[0754] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0755] Step 1:

[0756] The user uses the device to enter geographical information, timing, and contact details for their current and new addresses. The device sends this data to the emotion engine. The emotion engine analyzes input speed and word choices to identify the user's emotional state. This result is output as an emotional state the user may be experiencing, such as anxiety or excitement.

[0757] Step 2:

[0758] The server receives geographical and temporal information transmitted from the terminal. Based on this, it initiates a process to identify necessary tasks. The server uses the geographical information to identify, for example, changes in local administrative procedures or essential infrastructure such as electricity and water. As output, it generates a list of tasks to be performed.

[0759] Step 3:

[0760] The server sends communications to an external API to automatically execute a specified task. For example, it might perform a user change procedure via a power company's API. In this case, the progress of the task is generated and recorded as output.

[0761] Step 4:

[0762] The server sends notifications to the user regarding work progress and requests for approval in a way that is optimal based on the user's emotional state. For example, if the server determines that the user is stressed, it will send a notification using reassuring language. Because the content of the notifications changes based on the emotional state, the output is a personalized message.

[0763] Step 5:

[0764] Users review notifications received from the server and approve tasks. They can also request corrections if necessary. User approvals or correction requests are sent to the server and serve as input to proceed to the next step.

[0765] Step 6:

[0766] The server receives user approval or correction instructions and continues or corrects the task. If necessary, it communicates with external mechanisms again to adjust the task details. The output generates a notification indicating the final task completion status or correction completion.

[0767] Step 7:

[0768] The server provides follow-up support to users even after the task is completed. This includes post-migration support information and progress reports. As a final output, users are notified with additional information and advice to provide peace of mind after the migration is complete.

[0769] (Application Example 2)

[0770] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0771] In modern cities, moving to a new residence involves numerous procedures, and the resulting mental burden is a significant problem. Furthermore, the lack of mechanisms to efficiently and emotionally support residents through these moving procedures is a major challenge.

[0772] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0773] In this invention, the server includes a device for acquiring user address information and schedule information, a mechanism for identifying necessary processing based on the acquired address information, and a device for analyzing the user's emotional state and sending an optimal approval notification for the procedure. This not only efficiently automates the procedures associated with moving, but also reduces the emotional burden on the user, allowing them to proceed with the procedures with peace of mind.

[0774] A "user" refers to an individual or organization that uses the system to complete the relocation process.

[0775] "Address information" refers to data used to identify the user's current place of residence or their new place of residence.

[0776] "Schedule information" refers to date information related to the moving date and the procedures involved.

[0777] "Device" refers to the collective term for the hardware or software used to perform each of its functions.

[0778] A "mechanism" refers to the internal processes and procedures of a system configured to achieve a specific function.

[0779] An "external device" is equipment used to transmit information to organizations or systems other than the user.

[0780] "Emotional state" refers to a numerical or qualitative representation of a user's psychological and emotional state.

[0781] A "follow-up notification" is a message sent to provide additional information based on the progress of a procedure or the user's emotional state.

[0782] "Living infrastructure" is a general term for essential infrastructure for daily life, such as electricity and water.

[0783] An "administrative agency" is a public organization operated by the national government or local authorities.

[0784] The system for implementing this invention is realized by combining multiple devices and mechanisms. A server, user terminal, and external devices work together to support the user's relocation process. The specific processing flow is described below.

[0785] First, the user uses the device to enter their moving address and date information. The device then uses an emotion engine that analyzes text input and selected words to determine the user's emotional state. This emotion engine utilizes the Google Cloud Natural Language API to process and analyze the user's emotional data in real time.

[0786] Next, based on the information collected by the server, it identifies the necessary processing and communicates with external devices to execute it. Amazon Web Services (AWS) AWS Lambda and Amazon API Gateway are used for communication with external devices to automate the process.

[0787] Furthermore, the server sends follow-up notifications regarding the progress of the process in the most appropriate way, depending on the user's emotional state. Firebase Cloud Messaging is used to ensure that users receive the information they need quickly.

[0788] For example, when a user moves to a new city, they may need advice on the procedures involved and how to smoothly adapt to the new environment. In this case, the emotion engine detects the user's anxiety, and the system presents a message such as, "Here are some steps to help you start your life in your new city with confidence. Please try them out."

[0789] Examples of prompts for a generative AI model are as follows:

[0790] "Please suggest ways to alleviate the anxiety users feel when moving to a new city."

[0791] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0792] Step 1:

[0793] The user uses their device to enter their new address and moving date information. The entered data is temporarily stored on the device, and the text content and input speed are sent to the sentiment engine.

[0794] Step 2:

[0795] The device uses the Google Cloud Natural Language API to analyze input data in real time and infer the user's emotional state. It analyzes the input text and speed, and outputs emotions such as stress and anticipation as numerical values.

[0796] Step 3:

[0797] The server receives address and schedule information sent from the terminal. Based on this, it identifies the necessary processing and sends a command to an external device via an API to execute the processing. AWS Lambda and Amazon API Gateway are utilized to automate the process.

[0798] Step 4:

[0799] The server generates a notification requesting user approval at the optimal time, based on the user's sentiment information. This notification is sent to the device using Firebase Cloud Messaging. The message includes reassuring language for the user.

[0800] Step 5:

[0801] The user receives a notification on their device and submits an approval or correction. This data is sent back to the server, where the process is advanced and corrections are made. Specifically, changes to utility contracts, for example, are processed automatically.

[0802] Step 6:

[0803] The server aggregates information about the completion status of the procedures. Based on this, it creates and sends follow-up notifications to the user as needed. These notifications include advice on adjusting to life in the new area.

[0804] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0805] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0806] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0807] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0808] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0809] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0810] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0811] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0812] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0813] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0814] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0815] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0816] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0817] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0818] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0819] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0820] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0821] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0822] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0823] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0824] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0825] The following is further disclosed regarding the embodiments described above.

[0826] (Claim 1)

[0827] A means of obtaining address information and schedule information from the user,

[0828] A means of identifying the necessary procedures based on the acquired address information,

[0829] A means of sending communications to an external organization to automatically execute the identified procedures,

[0830] A means of sending a notification to the user to request approval of the procedure,

[0831] A means of receiving user approval or correction results and continuing or modifying the procedure,

[0832] A means of notifying the user of the completion status of the procedure,

[0833] A system that includes this.

[0834] (Claim 2)

[0835] The system according to claim 1, wherein the specified procedure includes changing a lifeline contract.

[0836] (Claim 3)

[0837] The system according to claim 1, wherein the specified procedure includes filing a notification with the government.

[0838] "Example 1"

[0839] (Claim 1)

[0840] A means of obtaining property information and schedule information from users,

[0841] A means of identifying the necessary administrative tasks based on the acquired property information,

[0842] A means of sending communications to an external organization to automatically execute specified tasks,

[0843] A means of sending a notification to the user requesting approval for administrative tasks,

[0844] A means of receiving user approval or correction results and continuing or correcting administrative processing,

[0845] A means of notifying the user of the completion status of administrative processing,

[0846] Means for obtaining relevant information from geographic databases and service provider APIs,

[0847] Methods for automatically filling out online forms of external organizations,

[0848] A means of managing the success or failure of a request and attempting retries,

[0849] A system that includes this.

[0850] (Claim 2)

[0851] The system according to claim 1, wherein the specified administrative tasks include changing contracts for essential services.

[0852] (Claim 3)

[0853] The system according to claim 1, wherein the specified tasks include applications to public institutions.

[0854] "Application Example 1"

[0855] (Claim 1)

[0856] Means for obtaining spatial and temporal information from the user,

[0857] A means for identifying the necessary processing content based on acquired spatial information,

[0858] A means of sending communications to an external organization to automatically execute the identified processing content,

[0859] A means of sending a message to the user to request their approval for processing,

[0860] A means of receiving user approval or correction results and continuing or correcting the process,

[0861] A means of informing the user of the completion status of the process,

[0862] A means of utilizing urban spatial information through support applications for citizens,

[0863] A system that includes this.

[0864] (Claim 2)

[0865] The system according to claim 1, wherein the identified process includes a change in the contract for the underlying service.

[0866] (Claim 3)

[0867] The system according to claim 1, wherein the identified process includes reporting to a public authority.

[0868] "Example 2 of combining an emotion engine"

[0869] (Claim 1)

[0870] A means of obtaining geographical and temporal information from the user,

[0871] A means of identifying necessary tasks based on acquired geographic information,

[0872] A means for transmitting communications to an external mechanism to automatically execute a specified task,

[0873] A means of analyzing the emotional state of users,

[0874] A means of sending notifications that respond to the user's emotional state and requesting their approval,

[0875] A means of receiving user approval or correction results and continuing or correcting operations,

[0876] A means of notifying users of the completion status of tasks and providing follow-up information,

[0877] A system that includes this.

[0878] (Claim 2)

[0879] The system according to claim 1, wherein the specified operations include changing contracts for essential services.

[0880] (Claim 3)

[0881] The system according to claim 1, wherein the specified tasks include filing notifications with the government.

[0882] "Application example 2 when combining with an emotional engine"

[0883] (Claim 1)

[0884] A device for acquiring user address information and schedule information,

[0885] A mechanism that identifies the necessary processing based on the acquired address information,

[0886] A mechanism that transmits communications to an external device in order to automate the identified process,

[0887] A device that analyzes the user's emotional state and sends the most appropriate approval notification for the procedure,

[0888] A mechanism that receives user approval or correction results and executes or corrects procedures,

[0889] A device that notifies the user of the completion status of the procedure,

[0890] A device that sends follow-up notifications according to the user's emotions,

[0891] A system that includes this.

[0892] (Claim 2)

[0893] The system according to claim 1, wherein the identified process includes changing the contract for the basic living services.

[0894] (Claim 3)

[0895] The system according to claim 1, wherein the identified process includes reporting to an administrative agency. [Explanation of symbols]

[0896] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of obtaining address information and schedule information from the user, A means of identifying the necessary procedures based on the acquired address information, A means of sending communications to an external organization to automatically execute the identified procedures, A means of sending a notification to the user to request approval of the procedure, A means of receiving user approval or correction results and continuing or modifying the procedure, A means of notifying the user of the completion status of the procedure, A system that includes this.

2. The system according to claim 1, wherein the specified procedure includes changing a lifeline contract.

3. The system according to claim 1, wherein the specified procedure includes filing a notification with the government.

Images