system

Abstract

Provide a system. 【Solution means】 The identification information of a specific information processing service, A function for monitoring the non-response period set by the user, A function for notifying the user when a non-response is detected, A function for notifying a pre-specified proxy when there is no response from the user, A function for canceling the account of the information processing service or erasing numerical information based on the recorded identification information after obtaining the proxy's approval, A function for notifying after all procedures are completed, Installed on a mobile information terminal, a function for automating operations during the non-response period, A function for periodically communicating with the proxy via a cloud environment, A system including the above.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, with the spread of digital services, the number of accounts and data managed by individuals has tended to increase enormously. In the event of an unexpected situation, the arrangement of these digital legacy items becomes a heavy burden for the user's family members and relatives. Also, from the perspective of privacy protection, there is a lack of means to implement data deletion and account cancellation in the form desired by the parties concerned. In order to solve such problems, it is necessary to provide a system that automatically arranges and cancels digital assets based on a certain non-response period set by the user.

Means for Solving the Problems

[0005] This invention provides means for monitoring the identification information of a specific digital service and the user-set period of no response, means for notifying the user when no response is detected, and means for notifying an agent if there is no response from the user. It also includes means for terminating the digital service account or deleting data based on the recorded identification information, with the agent's consent. Furthermore, by providing notification after all procedures are completed and by including encryption means for securely storing the registered identification information, this invention provides a system that offers reliable and secure digital estate management to the user.

[0006] "Digital services" is a general term for online platforms that enable the management of accounts and data provided via the internet.

[0007] "Identification information" refers to information necessary to identify a user's account in each digital service, and includes account IDs and login information.

[0008] "No response period" refers to a specific period of time during which a user does not access their account for each digital service, as specified by the user.

[0009] An "agent" is a person or entity authorized to agree to and direct the organization of digital assets on behalf of a user in unforeseen circumstances.

[0010] "Cancellation" refers to the procedure of ending a user account contract for a digital service and ceasing the provision of related services.

[0011] "Data deletion" means completely erasing information and files stored on a digital service, making them inaccessible to third parties.

[0012] "Encryption methods" refer to technologies and methods for encrypting data in order to securely protect user identification information and privacy information. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, when an emotion engine is combined. [Figure 14]It is a sequence diagram showing the processing flow of a data processing system in Application Example 2 when a sentiment engine is combined.

Mode for Carrying Out the Invention

[0014] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] The digital legacy management system of the present invention manages multiple digital services used by users and automatically performs account cancellation and data deletion procedures. This system is composed of three main actors: the user, the server, and the terminal.

[0035] First, the user accesses the system and registers the identification information of the digital services they are using, as well as the settings for the non-response period for each service and the desired content of the procedures. This completes the basic information regarding the organization of the user's account and data.

[0036] Next, the server receives this information and has a mechanism to periodically check whether there is access to the accounts of each digital service during the specified non-response period. The server uses the APIs and protocols of each service to obtain the date and time of the last access without necessarily going through the user's operations for this purpose.

[0037] If the server determines that it has exceeded the non-response period specified by the user, the server sends a notification to the user through the registered contact means (e.g., email or SMS). The content of this communication is a list of accounts in the non-response state and a request for continued confirmation.

[0038] If there is no response within the response time specified by the user, the server sends a notification to the contact information of a previously registered agent (usually a family member or a close person) to obtain consent for account organization or data deletion. After obtaining consent, the terminal automatically attempts to access each digital service and executes the specified procedures. This includes procedures for canceling the accounts of digital services and completely deleting the data.

[0039] After all procedures are completed, the server notifies the family members or agents of the results. Specifically, it reports in detail which accounts have been canceled and which data has been deleted.

[0040] Furthermore, if the user so desires, the system itself can be deactivated, and all data stored on the server will be completely erased. Throughout this entire process, the present invention provides an environment in which a user's digital assets can be organized in the event of an unexpected incident, and an agent can respond quickly and reliably.

[0041] As a concrete example, consider a user who uses social media, email, and video streaming services. The user sets a three-month inactivity period for each service and chooses to delete all accounts. The server periodically checks access information and initiates the process if there is no activity for more than three months. If the user does not respond, a notification is sent to an agent, and after obtaining their consent, the process of automatically deleting the accounts is executed.

[0042] The following describes the processing flow.

[0043] Step 1:

[0044] Users register identification information for the digital services they access and use within the system. This includes the service name, account ID, password, and API key. Users also set a no-response period and desired action (deletion or cancellation) for each service.

[0045] Step 2:

[0046] The server receives and securely stores the user's identification information. During this process, measures are taken to encrypt the data and prevent unauthorized access by third parties.

[0047] Step 3:

[0048] The server attempts to access each account for registered digital services at a configured frequency (e.g., weekly) and retrieves the last access date and time. This is done using the APIs or protocols provided by each service.

[0049] Step 4:

[0050] The server monitors each account based on the retrieved last access time to ensure that it has not exceeded the user-specified inactivity period. It then updates the list of accounts that have been found to be inactive.

[0051] Step 5:

[0052] If the server detects a lack of response, it will send a notification to the user via the registered contact method (e.g., email, SMS). The notification will include details of the account that was found to be unresponsive and a request for verification.

[0053] Step 6:

[0054] If a response from the user is not received within the specified period, the server will send a notification to the registered agent requesting their consent regarding the unresponsive account and how to handle it.

[0055] Step 7:

[0056] After confirming the agent's consent, the server accesses each designated digital service through the terminal and automatically initiates the registration process. This includes account cancellation or data deletion.

[0057] Step 8:

[0058] The terminal reports the progress of the procedure to the server in real time and verifies that all processing has been completed.

[0059] Step 9:

[0060] The server will notify the agent of the results after all procedures are complete. The notification will include details of which accounts were terminated and which data was deleted.

[0061] Step 10:

[0062] Based on the user's request, the device will deactivate the system account itself and completely delete all user-related data stored on the server.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] In today's world, users have increasing opportunities to access a wide variety of information resources, and in the event of unforeseen circumstances, managing and organizing these resources and access rights becomes extremely difficult. In such situations, organizing information resources based on user decision-making is essential, and as a result, efficient and rapid countermeasures by a representative are required. However, current technology does not adequately provide a mechanism to fully automate this process and execute it safely and effectively.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes identification information for a specific information resource, a device for monitoring the unresponsive period set by the user, a device for notifying the user when unresponsiveness is detected, and a device for notifying a pre-designated agent when there is no response from the user. This makes it possible to quickly organize information resources and user qualifications and create an environment in which the agent can respond appropriately.

[0068] "Information resources" is a general term for data and accounts that users can access or use in a digital environment.

[0069] "Identifying information" refers to unique information or data used to distinguish a particular information resource from other information resources.

[0070] The "non-response period" is a period set by the user, during which no access or response from the user is confirmed.

[0071] The "device" refers to a component designed to perform a specific function or a part within a system.

[0072] The "eligibility to use" refers to the right or access privilege for the user to use specific information resources.

[0073] The "agent" refers to a third party who is recognized to perform specific actions or make decisions on behalf of the user.

[0074] The "information conversion" refers to the modification of data by encryption or other methods performed to securely hold information or data.

[0075] This invention provides a digital legacy management system for efficiently organizing and managing a plurality of information resources managed by users.

[0076] System Configuration

[0077] This system is mainly composed of three entities: the server, the terminal, and the user. The server is a device that comprehensively manages digital information and is responsible for monitoring and notifying the non-response period. The terminal is a device for automatically executing the cancellation of information resources and the deletion of data. The user is the entity that organizes information resources, registers their own information in the system, and sets the desired procedures.

[0078] Technologies Used

[0079] The server uses a cloud-based platform for information processing and an API to access each information resource. Specifically, based on the identification information of the information resources set by the user, it periodically checks the access status during the non-response period and sends an email or text message to the user or agent as needed. To ensure data security, the server manages the information resources using information conversion technology. The terminal uses automation technology based on scripts to execute the cancellation process of each information resource.

[0080] Usage example

[0081] As a specific example, suppose a user registers for SNS, email, and distribution services and sets a three-month non-response period. In this case, the server periodically monitors access to these services and sends a notification to the user if no access can be confirmed for three months. If the user does not respond, the server sends the same notification to a pre-set agent, and after obtaining approval, the terminal automatically executes the cancellation of the information resource and data deletion.

[0082] Example of prompt text

[0083] As an example of the prompt text when using the generative AI model, a format such as "Please explain the process of setting the non-response period and automatic cancellation procedure for SNS accounts using the digital legacy arrangement system." can be considered. By using this prompt, the user can obtain a detailed explanation of the overview and specific procedures of the system.

[0084] Through this system, the user can efficiently manage digital information resources, and an environment is prepared for the agent to take prompt and appropriate actions.

[0085] The flow of the specific process in Example 1 will be described using FIG. 11.

[0086] Step 1:

[0087] Users access the system and enter identification information for the information resources they use, their desired unresponsiveness period, and the details of the procedure on the registration screen.

[0088] Input: User information resource identification and configuration information

[0089] Data processing: The system stores user input in a database and applies information transformation technologies to securely manage identification information.

[0090] Output: User registration information is securely stored.

[0091] Step 2:

[0092] The server periodically checks the last access date and time to each information resource based on the registered identification information and the period of no response.

[0093] Input: User-registered unresponsive period and information resource identification information

[0094] Data Processing: The server calls the API for each information resource to obtain access status. The retrieved data is analyzed to determine whether the unresponsive period has been exceeded.

[0095] Output: List of unresponsive information resources

[0096] Step 3:

[0097] The server will notify users via email or SMS about information resources that have exceeded the unresponsive period.

[0098] Input: List of unresponsive information resources

[0099] Data processing: Automatically generate notification messages about the relevant information resources and send them to the user.

[0100] Output: Notification message sent to the user

[0101] Step 4:

[0102] If the user does not respond, the server will send a notification to a pre-registered proxy.

[0103] Input: Status of no response from the user and contact information of the representative.

[0104] Data processing: Generate and automatically send notification messages to the agent.

[0105] Output: Notification message sent to the agent

[0106] Step 5:

[0107] After obtaining consent from the agent, the terminal uses a script to access each information resource and perform actions such as canceling the service or deleting data related to that resource.

[0108] Input: Procedural consent from the agent and identification information of the information resource.

[0109] Data processing: An automated script calls the API of the information resource to perform cancellation procedures and data deletion.

[0110] Output: Status of information resources that have been canceled or deleted.

[0111] Step 6:

[0112] After all procedures are completed, the server reports the results to the agent.

[0113] Input: Data of completed procedures

[0114] Data processing: Generate a report summarizing the results of the procedure and send it to the agent.

[0115] Output: Report sent to agent

[0116] By processing information in this order, the user's information resources are efficiently organized, and the agent can respond quickly.

[0117] (Application Example 1)

[0118] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0119] With the widespread use of digital information, managing personal belongings and bank accounts that individual users of information processing services can no longer control has become a challenge. Furthermore, deficiencies in automated management procedures during periods of no response could lead to information leaks and unauthorized access. Therefore, it is essential to establish an environment where a representative can reliably carry out appropriate procedures while the user is still alive.

[0120] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0121] In this invention, the server is installed on a mobile information terminal and includes means for automating operations during periods of no response, means for periodically communicating with an agent via a cloud environment, and means for notifying the user when no response is detected. As a result, even after the user-set period of no response has elapsed, account and numerical information is automatically and securely organized, and appropriate contact and organization procedures can be carried out with the agent.

[0122] "Information processing services" refer to services that collect, process, store, and provide data, and are accessed through online platforms.

[0123] A "user" is a person who uses information processing services and manages their personal information and settings.

[0124] "No response period" refers to a period during which a user does not access the service, and it is the criterion for when special procedures are taken if that period has elapsed.

[0125] An "agent" is a third party authorized to manage accounts and data related to information processing services on behalf of the user.

[0126] An "account" refers to an account based on an individual's identification information within an information processing service.

[0127] "Numerical information" refers to data that is stored and managed within an information processing service.

[0128] A "portable information terminal" is a device that a user can carry with them and is used to perform information processing services.

[0129] A "cloud environment" is the foundation for virtualized information services provided via the internet, and is used for data storage and processing.

[0130] The system for realizing this invention is primarily implemented using servers, mobile information terminals, and a cloud environment.

[0131] The server runs a program that periodically monitors access to specific information processing services based on the unresponsive period set by the user. For this purpose, the server utilizes the API of each information processing service to obtain and record the user's last access date and time, and determines whether the user has not responded based on that information. If an unresponsiveness is detected, the server automatically sends a notification to the proxy via the cloud environment and requests the proxy's confirmation.

[0132] The personal digital assistant (PDCA) provides a user-friendly interface for configuring settings and entering information such as response times and the identity of a proxy. The PDCA also has the capability to securely manage identification information using encryption technology.

[0133] As a concrete example, consider a case where a user manages accounts for social networking services and email services. If the user does not access these accounts for three months, the server will check the situation and automatically notify a designated representative via email or SMS. Once the representative approves, the server will proceed with the account cancellation process and deletion of numerical data.

[0134] An example of a prompt for a generative AI model could be: "A user has set a 6-month no-response period for social networking services and email services. Please explain how the proxy will be notified after the no-response period has elapsed, and how the services will clean up the account and data."

[0135] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0136] Step 1:

[0137] The user uses an application installed on their mobile device to input information about the information processing service, the unresponsive period, and the information of the agent. This input data is encrypted by the device and securely transmitted to the server. On the server, the input data is registered as identification information.

[0138] Step 2:

[0139] The server periodically checks access status via the APIs of each information processing service, based on registered identification information. The input is an API request linked to the identification information, and the output is the last access date and time. From this data, the server calculates whether the user-defined no-response period has been exceeded.

[0140] Step 3:

[0141] If the server exceeds the non-response period, it sends a confirmation notice to the user using a pre-set notification means. While waiting for a response from the user, it determines whether the non-response continues. The input for this step is the non-response determination result, and the output is the status of sending the confirmation notice.

[0142] Step 4:

[0143] If there is no response from the user, the server automatically sends a notice to the proxy. The notice includes the account information in the non-response state. The input is the confirmation information of user non-response, and the output is the sending of a notice to the proxy.

[0144] Step 5:

[0145] When the server accepts the approval from the proxy, the server uses the API of the information processing service to execute the procedure for canceling the account or deleting numerical information. The input is the proxy approval information, and the output is the completion report of the procedure. As a specific operation, it executes an API call and waits for a confirmation response.

[0146] Step 6:

[0147] When all procedures are completed, the server notifies the proxy and the user of the results. The final output is a notice including the detailed results of the procedure. As a prompt sentence for the generation AI model, it includes a text that explains the procedure flow through the specific cases that occurred and details the usage method of the procedure results.

[0148] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion recognition model 59 and perform specific processing using the user's emotion.

[0149] The present invention enables data processing that takes into account the user's emotional state by combining an emotion recognition engine with a digital legacy sorting system. This system operates with the cooperation of the user, the server, and the terminal to achieve more personalized notifications and processing.

[0150] First, users register the identification information of the digital services they use in the system, and set the unresponsiveness period and the desired processing method for each service (e.g., data deletion, account termination). This establishes basic digital asset management information.

[0151] The newly integrated emotion recognition engine analyzes the user's emotions when they connect to the system and when they send notifications. Emotional data is determined using a specific algorithm based on the user's input information and interaction history.

[0152] The server periodically monitors each digital service during the configured unresponsive period, retrieves the last access date and time, and sends a notification to the user if unresponsiveness is detected. Using data from the emotion recognition engine, the notification is tailored to the user's emotional state. For example, if the server detects that the user is experiencing high stress, it adjusts the frequency and content of the notification.

[0153] If no response is received from the user for a certain period, the server will notify a pre-designated agent, and upon obtaining the agent's consent, it will automatically terminate the digital service or delete the data via the terminal. The history of emotional activity is stored encrypted to ensure data security.

[0154] As a concrete example of this system, suppose a user manages accounts for social media, email, and video streaming services. If there is no access to the account within a period set by the user, the server sends a notification that balances urgency and consideration, taking into account the user's emotional state. In this way, the system provides more considerate non-response notifications and an appropriate data management process.

[0155] The following describes the processing flow.

[0156] Step 1:

[0157] Users access the system and register identification information for the digital services they manage. During this process, they also configure response time limits and desired processing options.

[0158] Step 2:

[0159] Upon receiving the registered identification information, the server simultaneously analyzes the user's emotions using an emotion recognition engine. Based on the analysis results, the user's emotional state is recorded in the database.

[0160] Step 3:

[0161] The server accesses each digital service account at a configured frequency and retrieves the last access date and time. This access uses the API or specific protocol of each service.

[0162] Step 4:

[0163] The server checks whether the retrieved last access time exceeds the unresponsive period set by the user. If an unresponsive state is detected, the information is added to the update list.

[0164] Step 5:

[0165] If the server detects no response, it will consider the emotional state analyzed by the emotion recognition engine and send a notification to the user. The content and tone of the notification will be adjusted according to the detected emotion.

[0166] Step 6:

[0167] If no response is received from the user for a certain period, the server will send a notification to a pre-registered agent. This notification will also be as considerate as possible.

[0168] Step 7:

[0169] After confirming that the agent's consent has been obtained, the server will automatically cancel the account or delete the data for each registered digital service via the terminal.

[0170] Step 8:

[0171] The terminal reports the completion of actions performed on each service to the server, and the server notifies the agent of the result.

[0172] Step 9:

[0173] After all procedures are completed, the server encrypts and stores the user's emotional data and related information to ensure security.

[0174] (Example 2)

[0175] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0176] Managing user accounts and data remaining on digital platforms, especially when users haven't accessed them for extended periods, presents a significant challenge. Furthermore, it's necessary to consider users' emotional states when sending notifications to ensure a more considerate approach. Additionally, ensuring data security throughout these processes while implementing appropriate automation is crucial.

[0177] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0178] In this invention, the server includes an identifier for a specific digital platform, a mechanism for monitoring the unresponsive period set by the user, an emotion recognition mechanism for analyzing the user's emotional state, and a mechanism for adjusting notification content based on the results of emotion recognition. This makes it possible to automatically and securely manage digital accounts and data while taking the user's emotional state into consideration, and to respond more effectively to unresponsive situations.

[0179] A "digital platform" refers to an underlying system that includes various services and accounts provided online.

[0180] An "identifier" refers to information used to identify and manage accounts and data on a specific digital platform.

[0181] "No response period" refers to a time frame in which a user does not access a digital platform for a certain period of time.

[0182] A "system" refers to a method or process designed to achieve a specific function or purpose.

[0183] "Emotion recognition" refers to technology that analyzes and determines a user's emotional state based on data and input information.

[0184] "Adjusting notification content" refers to changing the content and wording of messages sent according to the user's emotional state and circumstances.

[0185] This invention is a system that automates account and data management on digital platforms and is capable of responding while considering the user's emotional state. The system operates primarily through server, terminal, and user interaction.

[0186] First, users register the identifiers of the digital platforms they use with the system. This is done using a dedicated application or web interface, where users can enter their IDs and access information for each platform. This allows users to pre-configure their unresponsiveness period and preferred data processing methods (e.g., data deletion, account termination).

[0187] The server periodically monitors each digital platform using registered identifiers. During periods of inactivity, the server accesses the digital platform and calls an API to retrieve the last login date and time. This monitoring activity utilizes specialized software for data processing and retrieval.

[0188] The user's emotional state is analyzed using a generative AI model. Various user input information and interaction history are used as input data, and the emotion recognition engine determines the user's stress level and degree of relaxation. Based on this, the server sends notifications to the user using prompt messages. An example of a prompt message that utilizes the generative AI model is, "Your SNS account hasn't been accessed for a long time; is there anything we can do to help?"

[0189] If the user does not respond for a certain period, the server will notify a pre-designated representative. After obtaining the representative's consent, the account will be automatically terminated and the data deleted via the user's device. Encryption technology is used throughout this process to ensure the security of communications. Finally, there is a mechanism to confirm and report that all procedures have been completed.

[0190] In this way, the entire system works together to provide a considerate data management process that takes user emotions into account.

[0191] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0192] Step 1:

[0193] Users register the identifiers of the digital platforms they use with the system through a dedicated application or web interface. Users input their ID and access information for each platform. Based on this input, the system generates identifier data and allows users to set the unresponsiveness period and their preferred data processing method (such as data deletion or account termination). This allows the user's information to be stored in the database.

[0194] Step 2:

[0195] The server performs the task of periodically monitoring the digital platform. The server accesses the target platform's API using a registered identifier and retrieves the last login date and time. The input consists of the identifier and the period of inactivity; the retrieved login date and time is saved and updated as output. This monitoring ensures that user access information remains up-to-date.

[0196] Step 3:

[0197] The user's emotional state is analyzed by an emotion recognition engine on the server. User input information and interaction history are used as input data, and a generative AI model calculates emotional data. The output is the user's emotional state, including their stress level and degree of relaxation. The results of the emotion recognition are used to adjust the content of notifications.

[0198] Step 4:

[0199] When the server detects a lack of response, it notifies the user based on analyzed sentiment data. The inputs include the user's emotional state and the lack of response status, and a notification message using a prompt is output. Specifically, if the user is experiencing high stress levels, measures are taken to soften the tone of the notification. For example, a prompt message such as "You haven't accessed your social media account for a long time; is there anything we can do to help?" might be sent.

[0200] Step 5:

[0201] If there is no response from the user for a certain period, the server sends a notification to a pre-designated proxy. The input is the user's unresponsive status and the proxy's information, and the output is a notification message to the proxy. The server generates a message that includes all the information necessary to obtain consent from the proxy.

[0202] Step 6:

[0203] After obtaining the agent's consent, the system automatically cancels the account or deletes the data via the terminal. Inputs are the agent's consent and the user's identification information, and output is the status of account cancellation or data deletion completion. The terminal triggers a script, which then executes the cancellation procedure through the API of each service.

[0204] This processing flow enables appropriate account management and automated data processing while taking user sentiment into consideration.

[0205] (Application Example 2)

[0206] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0207] Traditional digital estate management systems often issue uniform notifications without considering the user's emotional state, which can cause stress and anxiety. Furthermore, there is a risk that users may miss particularly important notifications or procedures requiring confirmation, highlighting the need for personalized notifications. Additionally, ensuring the secure management of data and guaranteeing appropriate notification to a representative in the event of a user's unresponsiveness are also challenges.

[0208] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0209] In this invention, the server includes means for generating notifications corresponding to emotional states using an emotion recognition device, a device for monitoring periods of inactivity set by the individual, and a device for terminating a data service account or deleting data based on recorded identification information after obtaining the consent of the agent. This enables flexible notifications that take into account the user's emotional state, ensures that individuals receive important information, and improves the security of data management.

[0210] "Data services" refer to various platforms that utilize information and functions provided to users via the internet.

[0211] "Identification information" refers to data used to distinguish a particular user or account from others.

[0212] "No response period" refers to the range of time during which a user remains in a state of not taking a specific action.

[0213] "Device" refers to a component of hardware or software designed to perform a specific function.

[0214] An "agent" refers to a person who is authorized by a user to perform specific actions on their behalf.

[0215] An "emotion recognition device" refers to a device or software that analyzes a user's emotional state using a specific algorithm.

[0216] "Notification" refers to a means of communication used to inform a user or their representative of specific information.

[0217] An "encryption device" refers to a system that uses technology to transform data for security purposes and protect it from unauthorized access.

[0218] The system implementing this invention is for data service management, and the server, terminal, and user elements work in conjunction with each other.

[0219] The server monitors the unresponsiveness period setting, and if no response is received from the user within the set period, it uses an emotion recognition device to analyze the user's emotional state and then generates a notification. Software such as Affectiva or Amazon Rekognition is used as the emotion recognition device, which allows for real-time analysis of the user's emotions.

[0220] This notification's content and tone are adjusted according to the user's emotional state, and measures such as reducing the frequency of notifications can be taken if the user is experiencing high stress levels. Furthermore, if the user remains unresponsive, a notification will be sent to their representative, and if the representative consents, the server will terminate the data service account or delete the data.

[0221] The device functions as the user's interface device, serving as a medium for users to view settings and notifications. Users can use it to customize settings such as response time limits and how they receive notifications based on their emotions.

[0222] For example, if a user manages their personal information for an online banking service, and there is no access for a certain period, stress or busyness could be the cause. The server can detect this situation and send a notification in a gentle tone saying, "Please check back when you have time."

[0223] An example of a prompt message generated using an AI model is, "Generate a notification message that is likely to be received when the user's stress level is high." This allows the system to provide personalized data management that takes the user's needs into consideration.

[0224] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0225] Step 1:

[0226] The server receives user identification information and a period of inactivity as input. Based on this information, the server monitors whether there has been any access from the user within the specified period and detects inactivity.

[0227] Step 2:

[0228] If no response is detected, the server analyzes the user's emotional state using an emotion recognition device. It takes in the user's input data and interaction history and evaluates the user's emotional level using a specific algorithm. Based on these results, it determines the content and frequency of notifications.

[0229] Step 3:

[0230] The server generates appropriate notifications based on the analysis results. It selects expressions and content that match the user's emotional state and prepares the notification accordingly. For example, if the stress level is high, the notification content is designed to be gentler and less frequent.

[0231] Step 4:

[0232] The server sends the generated notification to the device. The device displays the received notification in its user interface, allowing the user to confirm it.

[0233] Step 5:

[0234] If the user does not respond to the notification, the server prepares to notify a pre-designated representative. It retrieves the representative's contact information from the database and sends an approval request.

[0235] Step 6:

[0236] If consent is obtained from the agent, the server will execute instructions to terminate the data service account or delete the data based on the user's identification information. This process ensures that the data is managed in accordance with the user's instructions.

[0237] Step 7:

[0238] Once all procedures are complete, the server sends a notification to the terminal, allowing the user or their representative to confirm the completion of the process.

[0239] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0240] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0241] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0242] [Second Embodiment]

[0243] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0244] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0245] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0246] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0247] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0248] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0249] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0250] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0251] The specific processing program 56 is an example of the "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by operating as the specific processing unit 290 according to the specific processing program 56 executed by the processor 28 on the RAM 30.

[0252] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the specific processing unit 290.

[0253] In the smart glasses 214, the reception and output processing is performed by the processor 46. The storage 50 stores a reception and output program 60. The processor 46 reads the reception and output program 60 from the storage 50 and executes the read reception and output program 60 on the RAM 48. The reception and output processing is realized by operating as the control unit 46A according to the reception and output program 60 executed by the processor 46 on the RAM 48.

[0254] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0255] The digital legacy sorting system of the present invention manages a plurality of digital services used by users and automatically performs procedures for account cancellation and data deletion. This system is composed of three main actors: the user, the server, and the terminal.

[0256] First, the user accesses the system and registers the identification information of the digital services he / she is using, as well as the settings for the non-response period for each service and the desired content of the procedures. Thus, the basic information regarding the sorting of the user's account and data is completed.

[0257] Next, the server receives this information and periodically checks whether there has been any access to each digital service account during the specified inactivity period. To do this, the server uses the APIs and protocols of each service to obtain the date and time of the last access, without necessarily requiring user interaction.

[0258] If the server determines that the user has exceeded the specified period of inactivity, it will send a notification to the user via the registered contact method (e.g., email or SMS). This notification will contain a list of accounts that are inactive and a request for continued verification.

[0259] If the user does not respond within the specified response time, the server will send a notification to a pre-registered representative (usually a family member or close friend) to obtain their consent to close the account or delete the data. After consent is obtained, the device will automatically attempt to access each digital service and perform the specified procedures. This includes canceling the digital service account and completely deleting the data.

[0260] Once all procedures are complete, the server will notify the family or their representative of the results. Specifically, it will provide a detailed report of which accounts were closed and which data was deleted.

[0261] Furthermore, if the user so desires, the system itself can be deactivated, and all data stored on the server will be completely erased. Throughout this entire process, the present invention provides an environment in which a user's digital assets can be organized in the event of an unexpected incident, and an agent can respond quickly and reliably.

[0262] As a concrete example, consider a user who uses social media, email, and video streaming services. The user sets a three-month inactivity period for each service and chooses to delete all accounts. The server periodically checks access information and initiates the process if there is no activity for more than three months. If the user does not respond, a notification is sent to an agent, and after obtaining their consent, the process of automatically deleting the accounts is executed.

[0263] The following describes the processing flow.

[0264] Step 1:

[0265] Users register identification information for the digital services they access and use within the system. This includes the service name, account ID, password, and API key. Users also set a no-response period and desired action (deletion or cancellation) for each service.

[0266] Step 2:

[0267] The server receives and securely stores the user's identification information. During this process, measures are taken to encrypt the data and prevent unauthorized access by third parties.

[0268] Step 3:

[0269] The server attempts to access each account for registered digital services at a configured frequency (e.g., weekly) and retrieves the last access date and time. This is done using the APIs or protocols provided by each service.

[0270] Step 4:

[0271] The server monitors each account based on the retrieved last access time to ensure that it has not exceeded the user-specified inactivity period. It then updates the list of accounts that have been found to be inactive.

[0272] Step 5:

[0273] If no response is detected, the server sends a notification to the user through the registered communication means (e.g., email, SMS). The notification includes details of the account for which no response was detected and a request for confirmation.

[0274] Step 6:

[0275] If a response from the user is not obtained within the set period, the server sends a notification to the registered agent, asking for approval regarding the account in a non-response state and its handling.

[0276] Step 7:

[0277] After confirming the agent's approval, the server accesses each specified digital service through the terminal and automatically starts the registered procedure. This includes canceling the account or deleting data.

[0278] Step 8:

[0279] The terminal reports the progress of the procedure to the server at any time and checks whether all processes are completed.

[0280] Step 9:

[0281] After all procedures are completed, the server notifies the agent of the result. The notification includes details of which accounts were canceled and which data was deleted.

[0282] Step 10:

[0283] Based on the user's wish, the terminal cancels the system account itself and completely deletes the user-related data stored on the server.

[0284] (Example 1)

[0285] Next, Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0286] In modern times, the opportunities for users to utilize a variety of information resources have increased. In the event of an unexpected situation, it becomes extremely difficult to manage and organize the accompanying information resources and usage qualifications. In such a situation, it is essential to organize information resources based on the user's decision-making, and as a result, efficient and prompt measures by an agent are required. However, the current technology does not fully provide a mechanism to automate this and execute it safely and effectively.

[0287] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0288] In this invention, the server includes identification information of specific information resources, a device for monitoring the non-response period set by the user, a device for notifying the user when a non-response is detected, and a device for notifying a pre-specified agent when there is no response from the user. This enables the rapid organization of information resources and usage qualifications and creates an environment in which the agent can respond appropriately.

[0289] "Information resources" is a general term for data and accounts that a user can access or utilize in a digital environment.

[0290] "Identification information" refers to unique information or data for distinguishing a specific information resource from other information resources.

[0291] "Non-response period" is a period set by the user, during which no access or response from the user is confirmed.

[0292] "Device" refers to a component designed to perform a specific function or a part within a system.

[0293] "Usage eligibility" refers to the right or access for a user to utilize specific information resources.

[0294] "Agent" refers to a third party who is authorized to perform specific actions or make decisions on behalf of a user.

[0295] "Information conversion" refers to the modification of data through encryption or other methods performed to securely store information and data.

[0296] This invention provides a digital legacy arrangement system for efficiently organizing and managing multiple information resources managed by users.

[0297] System Configuration

[0298] This system is mainly composed of three entities: a server, a terminal, and a user. The server is a device that comprehensively manages digital information and is responsible for monitoring and notifying during unresponsive periods. The terminal is a device for automatically executing the termination of information resources and the deletion of data. The user is the entity that organizes information resources, registers their own information in the system, and sets desired procedures.

[0299] Technologies Used

[0300] The server uses a cloud-based platform for information processing and an API to access each information resource. Specifically, based on the identification information of the information resources set by the user, it regularly checks the access status during unresponsive periods and sends emails or text messages to the user or agent as needed. To ensure data security, the server manages information resources using information conversion technology. The terminal uses automation technology by scripts to execute the termination process of each information resource.

[0301] Usage Examples

[0302] As a specific example, assume that a certain user registers for SNS, email, and distribution services and sets three months as the non-response period. In this case, the server periodically monitors access to these services and sends a notification to the user if access cannot be confirmed for three months. If the user does not respond, the server sends a similar notification to a pre-set agent, and after obtaining approval, the terminal automatically executes the cancellation of information resources and data deletion.

[0303] Example of a prompt sentence

[0304] As an example of a prompt sentence when using a generative AI model, a format such as "Please explain the process of setting the non-response period and automatic cancellation procedure of SNS accounts using a digital legacy arrangement system." can be considered. By using this prompt, the user can obtain a detailed explanation of the overview and specific procedures of the system.

[0305] Through this system, users can efficiently manage digital information resources, and an environment is prepared for agents to take prompt and appropriate actions.

[0306] The flow of the specific process in Example 1 will be described using FIG. 11.

[0307] Step 1:

[0308] The user accesses the system and enters the identification information of the information resources they are using, the desired non-response period, and the content of the procedure from the registration screen.

[0309] Input: Identification information and setting information of the user's information resources

[0310] Data processing: The system saves the user's input in the database and applies information conversion technology to securely manage the identification information.

[0311] Output: The state where the user's registration information is securely saved

[0312] Step 2:

[0313] The server periodically checks the last access date and time to each information resource based on the registered identification information and the period of no response.

[0314] Input: User-registered unresponsive period and information resource identification information

[0315] Data Processing: The server calls the API for each information resource to obtain access status. The retrieved data is analyzed to determine whether the unresponsive period has been exceeded.

[0316] Output: List of unresponsive information resources

[0317] Step 3:

[0318] The server will notify users via email or SMS about information resources that have exceeded the unresponsive period.

[0319] Input: List of unresponsive information resources

[0320] Data processing: Automatically generate notification messages about the relevant information resources and send them to the user.

[0321] Output: Notification message sent to the user

[0322] Step 4:

[0323] If the user does not respond, the server will send a notification to a pre-registered proxy.

[0324] Input: Status of no response from the user and contact information of the representative.

[0325] Data processing: Generate and automatically send notification messages to the agent.

[0326] Output: Notification message sent to the agent

[0327] Step 5:

[0328] After obtaining consent from the agent, the terminal uses a script to access each information resource and perform actions such as canceling the service or deleting data related to that resource.

[0329] Input: Procedural consent from the agent and identification information of the information resource.

[0330] Data processing: An automated script calls the API of the information resource to perform cancellation procedures and data deletion.

[0331] Output: Status of information resources that have been canceled or deleted.

[0332] Step 6:

[0333] After all procedures are completed, the server reports the results to the agent.

[0334] Input: Data of completed procedures

[0335] Data processing: Generate a report summarizing the results of the procedure and send it to the agent.

[0336] Output: Report sent to agent

[0337] By processing information in this order, the user's information resources are efficiently organized, and the agent can respond quickly.

[0338] (Application Example 1)

[0339] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0340] With the widespread use of digital information, managing personal belongings and bank accounts that individual users of information processing services can no longer control has become a challenge. Furthermore, deficiencies in automated management procedures during periods of no response could lead to information leaks and unauthorized access. Therefore, it is essential to establish an environment where a representative can reliably carry out appropriate procedures while the user is still alive.

[0341] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0342] In this invention, the server is installed on a mobile information terminal and includes means for automating operations during periods of no response, means for periodically communicating with an agent via a cloud environment, and means for notifying the user when no response is detected. As a result, even after the user-set period of no response has elapsed, account and numerical information is automatically and securely organized, and appropriate contact and organization procedures can be carried out with the agent.

[0343] "Information processing services" refer to services that collect, process, store, and provide data, and are accessed through online platforms.

[0344] A "user" is a person who uses information processing services and manages their personal information and settings.

[0345] "No response period" refers to a period during which a user does not access the service, and it is the criterion for when special procedures are taken if that period has elapsed.

[0346] An "agent" is a third party authorized to manage accounts and data related to information processing services on behalf of the user.

[0347] An "account" refers to an account based on an individual's identification information within an information processing service.

[0348] "Numerical information" refers to data that is stored and managed within an information processing service.

[0349] A "portable information terminal" is a device that a user can carry with them and is used to perform information processing services.

[0350] A "cloud environment" is the foundation for virtualized information services provided via the internet, and is used for data storage and processing.

[0351] The system for realizing this invention is primarily implemented using servers, mobile information terminals, and a cloud environment.

[0352] The server runs a program that periodically monitors access to specific information processing services based on the unresponsive period set by the user. For this purpose, the server utilizes the API of each information processing service to obtain and record the user's last access date and time, and determines whether the user has not responded based on that information. If an unresponsiveness is detected, the server automatically sends a notification to the proxy via the cloud environment and requests the proxy's confirmation.

[0353] The personal digital assistant (PDCA) provides a user-friendly interface for configuring settings and entering information such as response times and the identity of a proxy. The PDCA also has the capability to securely manage identification information using encryption technology.

[0354] As a concrete example, consider a case where a user manages accounts for social networking services and email services. If the user does not access these accounts for three months, the server will check the situation and automatically notify a designated representative via email or SMS. Once the representative approves, the server will proceed with the account cancellation process and deletion of numerical data.

[0355] An example of a prompt for a generative AI model could be: "A user has set a 6-month no-response period for social networking services and email services. Please explain how the proxy will be notified after the no-response period has elapsed, and how the services will clean up the account and data."

[0356] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0357] Step 1:

[0358] The user uses an application installed on their mobile device to input information about the information processing service, the unresponsive period, and the information of the agent. This input data is encrypted by the device and securely transmitted to the server. On the server, the input data is registered as identification information.

[0359] Step 2:

[0360] The server periodically checks access status via the APIs of each information processing service, based on registered identification information. The input is an API request linked to the identification information, and the output is the last access date and time. From this data, the server calculates whether the user-defined no-response period has been exceeded.

[0361] Step 3:

[0362] If the server fails to respond for an extended period, it sends a confirmation notice to the user using a pre-configured notification method. While waiting for a response from the user, it determines whether the lack of response has continued. The input for this step is the result of the no-response determination, and the output is the status of sending the confirmation notice.

[0363] Step 4:

[0364] If there is no response from the user, the server automatically sends a notification to the proxy. The notification includes the account information in the non-response state. The input is the confirmation information of the user's non-response, and the output is the sending of the notification to the proxy.

[0365] Step 5:

[0366] When the server accepts the approval from the proxy, the server uses the API of the information processing service to execute the account cancellation or numerical information deletion procedure. The input is the proxy approval information, and the output is the procedure completion report. Specifically, execute an API call and wait for a confirmation response.

[0367] Step 6:

[0368] When all procedures are completed, the server notifies the proxy and the user of the result. The final output is a notification including the detailed results of the procedure. As the prompt text for the generative AI model, it includes a text that explains the procedure flow through the specific cases that occurred and details the usage method of the procedure results.

[0369] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion recognition model 59 and perform specific processing using the user's emotion.

[0370] The present invention enables data processing that takes into account the user's emotional state by combining an emotion recognition engine with a digital legacy sorting system. This system operates in cooperation with the user, the server, and the terminal to achieve more personalized notifications and processing.

[0371] First, the user registers the identification information of the digital service they use with the system and sets the non-response period and the processing method desired for each service (e.g., data deletion, account cancellation). Thereby, the basic management information of digital assets is prepared.

[0372] The newly integrated emotion recognition engine analyzes the user's emotions when they connect to the system and when they send notifications. Emotional data is determined using a specific algorithm based on the user's input information and interaction history.

[0373] The server periodically monitors each digital service during the configured unresponsive period, retrieves the last access date and time, and sends a notification to the user if unresponsiveness is detected. Using data from the emotion recognition engine, the notification is tailored to the user's emotional state. For example, if the server detects that the user is experiencing high stress, it adjusts the frequency and content of the notification.

[0374] If no response is received from the user for a certain period, the server will notify a pre-designated agent, and upon obtaining the agent's consent, it will automatically terminate the digital service or delete the data via the terminal. The history of emotional activity is stored encrypted to ensure data security.

[0375] As a concrete example of this system, suppose a user manages accounts for social media, email, and video streaming services. If there is no access to the account within a period set by the user, the server sends a notification that balances urgency and consideration, taking into account the user's emotional state. In this way, the system provides more considerate non-response notifications and an appropriate data management process.

[0376] The following describes the processing flow.

[0377] Step 1:

[0378] Users access the system and register identification information for the digital services they manage. During this process, they also configure response time limits and desired processing options.

[0379] Step 2:

[0380] Upon receiving the registered identification information, the server simultaneously analyzes the user's emotions using an emotion recognition engine. Based on the analysis results, the user's emotional state is recorded in the database.

[0381] Step 3:

[0382] The server accesses each digital service account at a configured frequency and retrieves the last access date and time. This access uses the API or specific protocol of each service.

[0383] Step 4:

[0384] The server checks whether the retrieved last access time exceeds the unresponsive period set by the user. If an unresponsive state is detected, the information is added to the update list.

[0385] Step 5:

[0386] If the server detects no response, it will consider the emotional state analyzed by the emotion recognition engine and send a notification to the user. The content and tone of the notification will be adjusted according to the detected emotion.

[0387] Step 6:

[0388] If no response is received from the user for a certain period, the server will send a notification to a pre-registered agent. This notification will also be as considerate as possible.

[0389] Step 7:

[0390] After confirming that the agent's consent has been obtained, the server will automatically cancel the account or delete the data for each registered digital service via the terminal.

[0391] Step 8:

[0392] The terminal reports the completion of actions performed on each service to the server, and the server notifies the agent of the result.

[0393] Step 9:

[0394] After all procedures are completed, the server encrypts and stores the user's emotional data and related information to ensure security.

[0395] (Example 2)

[0396] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0397] Managing user accounts and data remaining on digital platforms, especially when users haven't accessed them for extended periods, presents a significant challenge. Furthermore, it's necessary to consider users' emotional states when sending notifications to ensure a more considerate approach. Additionally, ensuring data security throughout these processes while implementing appropriate automation is crucial.

[0398] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0399] In this invention, the server includes an identifier for a specific digital platform, a mechanism for monitoring the unresponsive period set by the user, an emotion recognition mechanism for analyzing the user's emotional state, and a mechanism for adjusting notification content based on the results of emotion recognition. This makes it possible to automatically and securely manage digital accounts and data while taking the user's emotional state into consideration, and to respond more effectively to unresponsive situations.

[0400] A "digital platform" refers to an underlying system that includes various services and accounts provided online.

[0401] An "identifier" refers to information used to identify and manage accounts and data on a specific digital platform.

[0402] "No response period" refers to a time frame in which a user does not access a digital platform for a certain period of time.

[0403] A "system" refers to a method or process designed to achieve a specific function or purpose.

[0404] "Emotion recognition" refers to technology that analyzes and determines a user's emotional state based on data and input information.

[0405] "Adjusting notification content" refers to changing the content and wording of messages sent according to the user's emotional state and circumstances.

[0406] This invention is a system that automates account and data management on digital platforms and is capable of responding while considering the user's emotional state. The system operates primarily through server, terminal, and user interaction.

[0407] First, users register the identifiers of the digital platforms they use with the system. This is done using a dedicated application or web interface, where users can enter their IDs and access information for each platform. This allows users to pre-configure their unresponsiveness period and preferred data processing methods (e.g., data deletion, account termination).

[0408] The server periodically monitors each digital platform using registered identifiers. During periods of inactivity, the server accesses the digital platform and calls an API to retrieve the last login date and time. This monitoring activity utilizes specialized software for data processing and retrieval.

[0409] The user's emotional state is analyzed using a generative AI model. Various user input information and interaction history are used as input data, and the emotion recognition engine determines the user's stress level and degree of relaxation. Based on this, the server sends notifications to the user using prompt messages. An example of a prompt message that utilizes the generative AI model is, "Your SNS account hasn't been accessed for a long time; is there anything we can do to help?"

[0410] If the user does not respond for a certain period, the server will notify a pre-designated representative. After obtaining the representative's consent, the account will be automatically terminated and the data deleted via the user's device. Encryption technology is used throughout this process to ensure the security of communications. Finally, there is a mechanism to confirm and report that all procedures have been completed.

[0411] In this way, the entire system works together to provide a considerate data management process that takes user emotions into account.

[0412] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0413] Step 1:

[0414] Users register the identifiers of the digital platforms they use with the system through a dedicated application or web interface. Users input their ID and access information for each platform. Based on this input, the system generates identifier data and allows users to set the unresponsiveness period and their preferred data processing method (such as data deletion or account termination). This allows the user's information to be stored in the database.

[0415] Step 2:

[0416] The server performs the task of periodically monitoring the digital platform. The server accesses the target platform's API using a registered identifier and retrieves the last login date and time. The input consists of the identifier and the period of inactivity; the retrieved login date and time is saved and updated as output. This monitoring ensures that user access information remains up-to-date.

[0417] Step 3:

[0418] The user's emotional state is analyzed by an emotion recognition engine on the server. User input information and interaction history are used as input data, and a generative AI model calculates emotional data. The output is the user's emotional state, including their stress level and degree of relaxation. The results of the emotion recognition are used to adjust the content of notifications.

[0419] Step 4:

[0420] When the server detects a lack of response, it notifies the user based on analyzed sentiment data. The inputs include the user's emotional state and the lack of response status, and a notification message using a prompt is output. Specifically, if the user is experiencing high stress levels, measures are taken to soften the tone of the notification. For example, a prompt message such as "You haven't accessed your social media account for a long time; is there anything we can do to help?" might be sent.

[0421] Step 5:

[0422] If there is no response from the user for a certain period, the server sends a notification to a pre-designated proxy. The input is the user's unresponsive status and the proxy's information, and the output is a notification message to the proxy. The server generates a message that includes all the information necessary to obtain consent from the proxy.

[0423] Step 6:

[0424] After obtaining the agent's consent, the system automatically cancels the account or deletes the data via the terminal. Inputs are the agent's consent and the user's identification information, and output is the status of account cancellation or data deletion completion. The terminal triggers a script, which then executes the cancellation procedure through the API of each service.

[0425] This processing flow enables appropriate account management and automated data processing while taking user sentiment into consideration.

[0426] (Application Example 2)

[0427] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0428] Traditional digital estate management systems often issue uniform notifications without considering the user's emotional state, which can cause stress and anxiety. Furthermore, there is a risk that users may miss particularly important notifications or procedures requiring confirmation, highlighting the need for personalized notifications. Additionally, ensuring the secure management of data and guaranteeing appropriate notification to a representative in the event of a user's unresponsiveness are also challenges.

[0429] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0430] In this invention, the server includes means for generating notifications corresponding to emotional states using an emotion recognition device, a device for monitoring periods of inactivity set by the individual, and a device for terminating a data service account or deleting data based on recorded identification information after obtaining the consent of the agent. This enables flexible notifications that take into account the user's emotional state, ensures that individuals receive important information, and improves the security of data management.

[0431] "Data services" refer to various platforms that utilize information and functions provided to users via the internet.

[0432] "Identification information" refers to data used to distinguish a particular user or account from others.

[0433] "No response period" refers to the range of time during which a user remains in a state of not taking a specific action.

[0434] "Device" refers to a component of hardware or software designed to perform a specific function.

[0435] An "agent" refers to a person who is authorized by a user to perform specific actions on their behalf.

[0436] An "emotion recognition device" refers to a device or software that analyzes a user's emotional state using a specific algorithm.

[0437] "Notification" refers to a means of communication used to inform a user or their representative of specific information.

[0438] An "encryption device" refers to a system that uses technology to transform data for security purposes and protect it from unauthorized access.

[0439] The system implementing this invention is for data service management, and the server, terminal, and user elements work in conjunction with each other.

[0440] The server monitors the unresponsiveness period setting, and if no response is received from the user within the set period, it uses an emotion recognition device to analyze the user's emotional state and then generates a notification. Software such as Affectiva or Amazon Rekognition is used as the emotion recognition device, which allows for real-time analysis of the user's emotions.

[0441] This notification's content and tone are adjusted according to the user's emotional state, and measures such as reducing the frequency of notifications can be taken if the user is experiencing high stress levels. Furthermore, if the user remains unresponsive, a notification will be sent to their representative, and if the representative consents, the server will terminate the data service account or delete the data.

[0442] The device functions as the user's interface device, serving as a medium for users to view settings and notifications. Users can use it to customize settings such as response time limits and how they receive notifications based on their emotions.

[0443] For example, if a user manages their personal information for an online banking service, and there is no access for a certain period, stress or busyness could be the cause. The server can detect this situation and send a notification in a gentle tone saying, "Please check back when you have time."

[0444] An example of a prompt message generated using an AI model is, "Generate a notification message that is likely to be received when the user's stress level is high." This allows the system to provide personalized data management that takes the user's needs into consideration.

[0445] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0446] Step 1:

[0447] The server receives user identification information and a period of inactivity as input. Based on this information, the server monitors whether there has been any access from the user within the specified period and detects inactivity.

[0448] Step 2:

[0449] If no response is detected, the server analyzes the user's emotional state using an emotion recognition device. It takes in the user's input data and interaction history and evaluates the user's emotional level using a specific algorithm. Based on these results, it determines the content and frequency of notifications.

[0450] Step 3:

[0451] The server generates appropriate notifications based on the analysis results. It selects expressions and content that match the user's emotional state and prepares the notification accordingly. For example, if the stress level is high, the notification content is designed to be gentler and less frequent.

[0452] Step 4:

[0453] The server sends the generated notification to the device. The device displays the received notification in its user interface, allowing the user to confirm it.

[0454] Step 5:

[0455] If the user does not respond to the notification, the server prepares to notify a pre-designated representative. It retrieves the representative's contact information from the database and sends an approval request.

[0456] Step 6:

[0457] If consent is obtained from the agent, the server will execute instructions to terminate the data service account or delete the data based on the user's identification information. This process ensures that the data is managed in accordance with the user's instructions.

[0458] Step 7:

[0459] Once all procedures are complete, the server sends a notification to the terminal, allowing the user or their representative to confirm the completion of the process.

[0460] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0461] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0462] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0463] [Third Embodiment]

[0464] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0465] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0466] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0467] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0468] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0469] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0470] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0471] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0472] The specific processing program 56 is an example of the "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by operating as the specific processing unit 290 according to the specific processing program 56 executed by the processor 28 on the RAM 30.

[0473] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the specific processing unit 290.

[0474] In the headset-type terminal 314, input / output processing for reception and transmission is performed by the processor 46. The storage 50 stores a reception / transmission program 60. The processor 46 reads the reception / transmission program 60 from the storage 50 and executes the read reception / transmission program 60 on the RAM 48. The input / output processing for reception and transmission is realized by operating as the control unit 46A according to the reception / transmission program 60 executed by the processor 46 on the RAM 48.

[0475] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 is referred to as a "server", and the headset-type terminal 314 is referred to as a "terminal".

[0476] The digital legacy arrangement system of the present invention manages a plurality of digital services used by users and automatically performs procedures for account cancellation and data deletion. This system is composed of three main actors: a user, a server, and a terminal.

[0477] First, the user accesses the system and registers the identification information of the digital services he / she is using, as well as the settings for the non-response period for each service and the desired content of the procedures. Thus, the basic information regarding the arrangement of the user's account and data is completed.

[0478] Next, the server receives this information and periodically checks whether there has been any access to each digital service account during the specified inactivity period. To do this, the server uses the APIs and protocols of each service to obtain the date and time of the last access, without necessarily requiring user interaction.

[0479] If the server determines that the user has exceeded the specified period of inactivity, it will send a notification to the user via the registered contact method (e.g., email or SMS). This notification will contain a list of accounts that are inactive and a request for continued verification.

[0480] If the user does not respond within the specified response time, the server will send a notification to a pre-registered representative (usually a family member or close friend) to obtain their consent to close the account or delete the data. After consent is obtained, the device will automatically attempt to access each digital service and perform the specified procedures. This includes canceling the digital service account and completely deleting the data.

[0481] Once all procedures are complete, the server will notify the family or their representative of the results. Specifically, it will provide a detailed report of which accounts were closed and which data was deleted.

[0482] Furthermore, if the user so desires, the system itself can be deactivated, and all data stored on the server will be completely erased. Throughout this entire process, the present invention provides an environment in which a user's digital assets can be organized in the event of an unexpected incident, and an agent can respond quickly and reliably.

[0483] As a concrete example, consider a user who uses social media, email, and video streaming services. The user sets a three-month inactivity period for each service and chooses to delete all accounts. The server periodically checks access information and initiates the process if there is no activity for more than three months. If the user does not respond, a notification is sent to an agent, and after obtaining their consent, the process of automatically deleting the accounts is executed.

[0484] The following describes the processing flow.

[0485] Step 1:

[0486] Users register identification information for the digital services they access and use within the system. This includes the service name, account ID, password, and API key. Users also set a no-response period and desired action (deletion or cancellation) for each service.

[0487] Step 2:

[0488] The server receives and securely stores the user's identification information. During this process, measures are taken to encrypt the data and prevent unauthorized access by third parties.

[0489] Step 3:

[0490] The server attempts to access each account for registered digital services at a configured frequency (e.g., weekly) and retrieves the last access date and time. This is done using the APIs or protocols provided by each service.

[0491] Step 4:

[0492] The server monitors each account based on the retrieved last access time to ensure that it has not exceeded the user-specified inactivity period. It then updates the list of accounts that have been found to be inactive.

[0493] Step 5:

[0494] If the server detects a lack of response, it will send a notification to the user via the registered contact method (e.g., email, SMS). The notification will include details of the account that was found to be unresponsive and a request for verification.

[0495] Step 6:

[0496] If a response from the user is not received within the specified period, the server will send a notification to the registered agent requesting their consent regarding the unresponsive account and how to handle it.

[0497] Step 7:

[0498] After confirming the agent's consent, the server accesses each designated digital service through the terminal and automatically initiates the registration process. This includes account cancellation or data deletion.

[0499] Step 8:

[0500] The terminal reports the progress of the procedure to the server in real time and verifies that all processing has been completed.

[0501] Step 9:

[0502] The server will notify the agent of the results after all procedures are complete. The notification will include details of which accounts were terminated and which data was deleted.

[0503] Step 10:

[0504] Based on the user's request, the device will deactivate the system account itself and completely delete all user-related data stored on the server.

[0505] (Example 1)

[0506] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0507] In today's world, users have increasing opportunities to access a wide variety of information resources, and in the event of unforeseen circumstances, managing and organizing these resources and access rights becomes extremely difficult. In such situations, organizing information resources based on user decision-making is essential, and as a result, efficient and rapid countermeasures by a representative are required. However, current technology does not adequately provide a mechanism to fully automate this process and execute it safely and effectively.

[0508] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0509] In this invention, the server includes identification information for a specific information resource, a device for monitoring the unresponsive period set by the user, a device for notifying the user when unresponsiveness is detected, and a device for notifying a pre-designated agent when there is no response from the user. This makes it possible to quickly organize information resources and user qualifications and create an environment in which the agent can respond appropriately.

[0510] "Information resources" is a general term for data and accounts that users can access or use in a digital environment.

[0511] "Identifying information" refers to unique information or data used to distinguish a particular information resource from other information resources.

[0512] "No response period" refers to a period set by the user during which no access or response from the user is detected.

[0513] "Device" refers to a component or part of a system designed to perform a specific function.

[0514] "Eligibility" refers to the right or access for a user to utilize specific information resources.

[0515] "Agent" refers to a third party who is authorized to perform specific actions or make decisions on behalf of a user.

[0516] "Information conversion" refers to the modification of data through encryption or other methods performed to securely store information and data.

[0517] This invention provides a digital legacy management system for efficiently organizing and managing multiple information resources managed by users.

[0518] System Configuration

[0519] This system is mainly composed of three entities: a server, a terminal, and a user. The server is a device that comprehensively manages digital information and is responsible for monitoring and notifying during unresponsive periods. The terminal is a device for automatically executing the cancellation of information resources and the deletion of data. The user is the entity that organizes information resources, registers their own information in the system, and sets desired procedures.

[0520] Technologies Used

[0521] The server uses a cloud-based platform for information processing and an API to access each information resource. Specifically, based on the identification information of the information resources set by the user, it periodically checks the access status during the unresponsive period and sends emails or text messages to the user or agent as needed. To ensure data security, the server manages information resources using information conversion technology. The terminal uses automation technology by scripts to execute the cancellation process of each information resource.

[0522] Usage Example

[0523] As a specific example, suppose a user registers for SNS, email, and distribution services and sets a three-month non-response period. In this case, the server periodically monitors access to these services and sends a notification to the user if no access can be confirmed for three months. If the user does not respond, the server sends a similar notification to a pre-set proxy, and after obtaining approval, the terminal automatically executes the cancellation of the information resource and data deletion.

[0524] Example of prompt text

[0525] As an example of a prompt text when using a generative AI model, a format such as "Please explain the process of setting a non-response period and automatic cancellation procedure for an SNS account using a digital legacy management system." can be considered. By using this prompt, the user can obtain a detailed explanation of the system overview and specific procedures.

[0526] Through this system, users can efficiently manage digital information resources, and an environment is prepared for the proxy to take prompt and appropriate actions.

[0527] The flow of the specific process in Example 1 will be described using FIG. 11.

[0528] Step 1:

[0529] The user accesses the system and enters the identification information of the information resources they are using, the desired non-response period, and the procedure details from the registration screen.

[0530] Input: Identification information and setting information of the user's information resources

[0531] Data processing: The system saves the user's input in the database and applies information conversion technology to securely manage the identification information.

[0532] Output: The state where the user's registration information is securely saved

[0533] Step 2:

[0534] The server periodically checks the last access date and time to each information resource based on the registered identification information and the period of no response.

[0535] Input: User-registered unresponsive period and information resource identification information

[0536] Data Processing: The server calls the API for each information resource to obtain access status. The retrieved data is analyzed to determine whether the unresponsive period has been exceeded.

[0537] Output: List of unresponsive information resources

[0538] Step 3:

[0539] The server will notify users via email or SMS about information resources that have exceeded the unresponsive period.

[0540] Input: List of unresponsive information resources

[0541] Data processing: Automatically generate notification messages about the relevant information resources and send them to the user.

[0542] Output: Notification message sent to the user

[0543] Step 4:

[0544] If the user does not respond, the server will send a notification to a pre-registered proxy.

[0545] Input: Status of no response from the user and contact information of the representative.

[0546] Data processing: Generate and automatically send notification messages to the agent.

[0547] Output: Notification message sent to the agent

[0548] Step 5:

[0549] After obtaining consent from the agent, the terminal uses a script to access each information resource and perform actions such as canceling the service or deleting data related to that resource.

[0550] Input: Procedural consent from the agent and identification information of the information resource.

[0551] Data processing: An automated script calls the API of the information resource to perform cancellation procedures and data deletion.

[0552] Output: Status of information resources that have been canceled or deleted.

[0553] Step 6:

[0554] After all procedures are completed, the server reports the results to the agent.

[0555] Input: Data of completed procedures

[0556] Data processing: Generate a report summarizing the results of the procedure and send it to the agent.

[0557] Output: Report sent to agent

[0558] By processing information in this order, the user's information resources are efficiently organized, and the agent can respond quickly.

[0559] (Application Example 1)

[0560] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0561] With the widespread use of digital information, managing personal belongings and bank accounts that individual users of information processing services can no longer control has become a challenge. Furthermore, deficiencies in automated management procedures during periods of no response could lead to information leaks and unauthorized access. Therefore, it is essential to establish an environment where a representative can reliably carry out appropriate procedures while the user is still alive.

[0562] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0563] In this invention, the server is installed on a mobile information terminal and includes means for automating operations during periods of no response, means for periodically communicating with an agent via a cloud environment, and means for notifying the user when no response is detected. As a result, even after the user-set period of no response has elapsed, account and numerical information is automatically and securely organized, and appropriate contact and organization procedures can be carried out with the agent.

[0564] "Information processing services" refer to services that collect, process, store, and provide data, and are accessed through online platforms.

[0565] A "user" is a person who uses information processing services and manages their personal information and settings.

[0566] "No response period" refers to a period during which a user does not access the service, and it is the criterion for when special procedures are taken if that period has elapsed.

[0567] An "agent" is a third party authorized to manage accounts and data related to information processing services on behalf of the user.

[0568] An "account" refers to an account based on an individual's identification information within an information processing service.

[0569] "Numerical information" refers to data that is stored and managed within an information processing service.

[0570] A "portable information terminal" is a device that a user can carry with them and is used to perform information processing services.

[0571] A "cloud environment" is the foundation for virtualized information services provided via the internet, and is used for data storage and processing.

[0572] The system for realizing this invention is primarily implemented using servers, mobile information terminals, and a cloud environment.

[0573] The server runs a program that periodically monitors access to specific information processing services based on the unresponsive period set by the user. For this purpose, the server utilizes the API of each information processing service to obtain and record the user's last access date and time, and determines whether the user has not responded based on that information. If an unresponsiveness is detected, the server automatically sends a notification to the proxy via the cloud environment and requests the proxy's confirmation.

[0574] The personal digital assistant (PDCA) provides a user-friendly interface for configuring settings and entering information such as response times and the identity of a proxy. The PDCA also has the capability to securely manage identification information using encryption technology.

[0575] As a concrete example, consider a case where a user manages accounts for social networking services and email services. If the user does not access these accounts for three months, the server will check the situation and automatically notify a designated representative via email or SMS. Once the representative approves, the server will proceed with the account cancellation process and deletion of numerical data.

[0576] An example of a prompt for a generative AI model could be: "A user has set a 6-month no-response period for social networking services and email services. Please explain how the proxy will be notified after the no-response period has elapsed, and how the services will clean up the account and data."

[0577] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0578] Step 1:

[0579] The user uses an application installed on their mobile device to input information about the information processing service, the unresponsive period, and the information of the agent. This input data is encrypted by the device and securely transmitted to the server. On the server, the input data is registered as identification information.

[0580] Step 2:

[0581] The server periodically checks access status via the APIs of each information processing service, based on registered identification information. The input is an API request linked to the identification information, and the output is the last access date and time. From this data, the server calculates whether the user-defined no-response period has been exceeded.

[0582] Step 3:

[0583] If the server fails to respond for an extended period, it sends a confirmation notice to the user using a pre-configured notification method. While waiting for a response from the user, it determines whether the lack of response has continued. The input for this step is the result of the no-response determination, and the output is the status of sending the confirmation notice.

[0584] Step 4:

[0585] If there is no response from the user, the server automatically sends a notification to the proxy. The notification includes the account information in the non-response state. The input is the confirmation information of the user's non-response, and the output is the sending of the notification to the proxy.

[0586] Step 5:

[0587] When the server accepts the approval from the proxy, the server uses the API of the information processing service to execute the account cancellation or numerical information deletion procedure. The input is the proxy approval information, and the output is the procedure completion report. As a specific operation, execute an API call and wait for a confirmation response.

[0588] Step 6:

[0589] When all procedures are completed, the server notifies the proxy and the user of the results. The final output is a notification including the detailed results of the procedure. As the prompt text for the generation AI model, it includes a text that explains the procedure flow through the specific cases that occurred and details the usage method of the procedure results.

[0590] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion recognition model 59 and perform specific processing using the user's emotion.

[0591] The present invention enables data processing that takes into account the user's emotional state by combining an emotion recognition engine with a digital legacy management system. This system operates with the cooperation of the user, the server, and the terminal to achieve more personalized notifications and processing.

[0592] First, the user registers the identification information of the digital service they use with the system and sets the non-response period and the processing method (e.g., data deletion, account cancellation) desired for each service. Thereby, the basic management information of digital assets is prepared.

[0593] The newly integrated emotion recognition engine analyzes the user's emotions when they connect to the system and when they send notifications. Emotional data is determined using a specific algorithm based on the user's input information and interaction history.

[0594] The server periodically monitors each digital service during the configured unresponsive period, retrieves the last access date and time, and sends a notification to the user if unresponsiveness is detected. Using data from the emotion recognition engine, the notification is tailored to the user's emotional state. For example, if the server detects that the user is experiencing high stress, it adjusts the frequency and content of the notification.

[0595] If no response is received from the user for a certain period, the server will notify a pre-designated agent, and upon obtaining the agent's consent, it will automatically terminate the digital service or delete the data via the terminal. The history of emotional activity is stored encrypted to ensure data security.

[0596] As a concrete example of this system, suppose a user manages accounts for social media, email, and video streaming services. If there is no access to the account within a period set by the user, the server sends a notification that balances urgency and consideration, taking into account the user's emotional state. In this way, the system provides more considerate non-response notifications and an appropriate data management process.

[0597] The following describes the processing flow.

[0598] Step 1:

[0599] Users access the system and register identification information for the digital services they manage. During this process, they also configure response time limits and desired processing options.

[0600] Step 2:

[0601] Upon receiving the registered identification information, the server simultaneously analyzes the user's emotions using an emotion recognition engine. Based on the analysis results, the user's emotional state is recorded in the database.

[0602] Step 3:

[0603] The server accesses each digital service account at a configured frequency and retrieves the last access date and time. This access uses the API or specific protocol of each service.

[0604] Step 4:

[0605] The server checks whether the retrieved last access time exceeds the unresponsive period set by the user. If an unresponsive state is detected, the information is added to the update list.

[0606] Step 5:

[0607] If the server detects no response, it will consider the emotional state analyzed by the emotion recognition engine and send a notification to the user. The content and tone of the notification will be adjusted according to the detected emotion.

[0608] Step 6:

[0609] If no response is received from the user for a certain period, the server will send a notification to a pre-registered agent. This notification will also be as considerate as possible.

[0610] Step 7:

[0611] After confirming that the agent's consent has been obtained, the server will automatically cancel the account or delete the data for each registered digital service via the terminal.

[0612] Step 8:

[0613] The terminal reports the completion of actions performed on each service to the server, and the server notifies the agent of the result.

[0614] Step 9:

[0615] After all procedures are completed, the server encrypts and stores the user's emotional data and related information to ensure security.

[0616] (Example 2)

[0617] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0618] Managing user accounts and data remaining on digital platforms, especially when users haven't accessed them for extended periods, presents a significant challenge. Furthermore, it's necessary to consider users' emotional states when sending notifications to ensure a more considerate approach. Additionally, ensuring data security throughout these processes while implementing appropriate automation is crucial.

[0619] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0620] In this invention, the server includes an identifier for a specific digital platform, a mechanism for monitoring the unresponsive period set by the user, an emotion recognition mechanism for analyzing the user's emotional state, and a mechanism for adjusting notification content based on the results of emotion recognition. This makes it possible to automatically and securely manage digital accounts and data while taking the user's emotional state into consideration, and to respond more effectively to unresponsive situations.

[0621] A "digital platform" refers to an underlying system that includes various services and accounts provided online.

[0622] An "identifier" refers to information used to identify and manage accounts and data on a specific digital platform.

[0623] "No response period" refers to a time frame in which a user does not access a digital platform for a certain period of time.

[0624] A "system" refers to a method or process designed to achieve a specific function or purpose.

[0625] "Emotion recognition" refers to technology that analyzes and determines a user's emotional state based on data and input information.

[0626] "Adjusting notification content" refers to changing the content and wording of messages sent according to the user's emotional state and circumstances.

[0627] This invention is a system that automates account and data management on digital platforms and is capable of responding while considering the user's emotional state. The system operates primarily through server, terminal, and user interaction.

[0628] First, users register the identifiers of the digital platforms they use with the system. This is done using a dedicated application or web interface, where users can enter their IDs and access information for each platform. This allows users to pre-configure their unresponsiveness period and preferred data processing methods (e.g., data deletion, account termination).

[0629] The server periodically monitors each digital platform using registered identifiers. During periods of inactivity, the server accesses the digital platform and calls an API to retrieve the last login date and time. This monitoring activity utilizes specialized software for data processing and retrieval.

[0630] The user's emotional state is analyzed using a generative AI model. Various user input information and interaction history are used as input data, and the emotion recognition engine determines the user's stress level and degree of relaxation. Based on this, the server sends notifications to the user using prompt messages. An example of a prompt message that utilizes the generative AI model is, "Your SNS account hasn't been accessed for a long time; is there anything we can do to help?"

[0631] If the user does not respond for a certain period, the server will notify a pre-designated representative. After obtaining the representative's consent, the account will be automatically terminated and the data deleted via the user's device. Encryption technology is used throughout this process to ensure the security of communications. Finally, there is a mechanism to confirm and report that all procedures have been completed.

[0632] In this way, the entire system works together to provide a considerate data management process that takes user emotions into account.

[0633] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0634] Step 1:

[0635] Users register the identifiers of the digital platforms they use with the system through a dedicated application or web interface. Users input their ID and access information for each platform. Based on this input, the system generates identifier data and allows users to set the unresponsiveness period and their preferred data processing method (such as data deletion or account termination). This allows the user's information to be stored in the database.

[0636] Step 2:

[0637] The server performs the task of periodically monitoring the digital platform. The server accesses the target platform's API using a registered identifier and retrieves the last login date and time. The input consists of the identifier and the period of inactivity; the retrieved login date and time is saved and updated as output. This monitoring ensures that user access information remains up-to-date.

[0638] Step 3:

[0639] The user's emotional state is analyzed by an emotion recognition engine on the server. User input information and interaction history are used as input data, and a generative AI model calculates emotional data. The output is the user's emotional state, including their stress level and degree of relaxation. The results of the emotion recognition are used to adjust the content of notifications.

[0640] Step 4:

[0641] When the server detects a lack of response, it notifies the user based on analyzed sentiment data. The inputs include the user's emotional state and the lack of response status, and a notification message using a prompt is output. Specifically, if the user is experiencing high stress levels, measures are taken to soften the tone of the notification. For example, a prompt message such as "You haven't accessed your social media account for a long time; is there anything we can do to help?" might be sent.

[0642] Step 5:

[0643] If there is no response from the user for a certain period, the server sends a notification to a pre-designated proxy. The input is the user's unresponsive status and the proxy's information, and the output is a notification message to the proxy. The server generates a message that includes all the information necessary to obtain consent from the proxy.

[0644] Step 6:

[0645] After obtaining the agent's consent, the system automatically cancels the account or deletes the data via the terminal. Inputs are the agent's consent and the user's identification information, and output is the status of account cancellation or data deletion completion. The terminal triggers a script, which then executes the cancellation procedure through the API of each service.

[0646] This processing flow enables appropriate account management and automated data processing while taking user sentiment into consideration.

[0647] (Application Example 2)

[0648] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0649] Traditional digital estate management systems often issue uniform notifications without considering the user's emotional state, which can cause stress and anxiety. Furthermore, there is a risk that users may miss particularly important notifications or procedures requiring confirmation, highlighting the need for personalized notifications. Additionally, ensuring the secure management of data and guaranteeing appropriate notification to a representative in the event of a user's unresponsiveness are also challenges.

[0650] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0651] In this invention, the server includes means for generating notifications corresponding to emotional states using an emotion recognition device, a device for monitoring periods of inactivity set by the individual, and a device for terminating a data service account or deleting data based on recorded identification information after obtaining the consent of the agent. This enables flexible notifications that take into account the user's emotional state, ensures that individuals receive important information, and improves the security of data management.

[0652] "Data services" refer to various platforms that utilize information and functions provided to users via the internet.

[0653] "Identification information" refers to data used to distinguish a particular user or account from others.

[0654] "No response period" refers to the range of time during which a user remains in a state of not taking a specific action.

[0655] "Device" refers to a component of hardware or software designed to perform a specific function.

[0656] An "agent" refers to a person who is authorized by a user to perform specific actions on their behalf.

[0657] An "emotion recognition device" refers to a device or software that analyzes a user's emotional state using a specific algorithm.

[0658] "Notification" refers to a means of communication used to inform a user or their representative of specific information.

[0659] An "encryption device" refers to a system that uses technology to transform data for security purposes and protect it from unauthorized access.

[0660] The system implementing this invention is for data service management, and the server, terminal, and user elements work in conjunction with each other.

[0661] The server monitors the unresponsiveness period setting, and if no response is received from the user within the set period, it uses an emotion recognition device to analyze the user's emotional state and then generates a notification. Software such as Affectiva or Amazon Rekognition is used as the emotion recognition device, which allows for real-time analysis of the user's emotions.

[0662] This notification's content and tone are adjusted according to the user's emotional state, and measures such as reducing the frequency of notifications can be taken if the user is experiencing high stress levels. Furthermore, if the user remains unresponsive, a notification will be sent to their representative, and if the representative consents, the server will terminate the data service account or delete the data.

[0663] The device functions as the user's interface device, serving as a medium for users to view settings and notifications. Users can use it to customize settings such as response time limits and how they receive notifications based on their emotions.

[0664] For example, if a user manages their personal information for an online banking service, and there is no access for a certain period, stress or busyness could be the cause. The server can detect this situation and send a notification in a gentle tone saying, "Please check back when you have time."

[0665] An example of a prompt message generated using an AI model is, "Generate a notification message that is likely to be received when the user's stress level is high." This allows the system to provide personalized data management that takes the user's needs into consideration.

[0666] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0667] Step 1:

[0668] The server receives user identification information and a period of inactivity as input. Based on this information, the server monitors whether there has been any access from the user within the specified period and detects inactivity.

[0669] Step 2:

[0670] If no response is detected, the server analyzes the user's emotional state using an emotion recognition device. It takes in the user's input data and interaction history and evaluates the user's emotional level using a specific algorithm. Based on these results, it determines the content and frequency of notifications.

[0671] Step 3:

[0672] The server generates appropriate notifications based on the analysis results. It selects expressions and content that match the user's emotional state and prepares the notification accordingly. For example, if the stress level is high, the notification content is designed to be gentler and less frequent.

[0673] Step 4:

[0674] The server sends the generated notification to the device. The device displays the received notification in its user interface, allowing the user to confirm it.

[0675] Step 5:

[0676] If the user does not respond to the notification, the server prepares to notify a pre-designated representative. It retrieves the representative's contact information from the database and sends an approval request.

[0677] Step 6:

[0678] If consent is obtained from the agent, the server will execute instructions to terminate the data service account or delete the data based on the user's identification information. This process ensures that the data is managed in accordance with the user's instructions.

[0679] Step 7:

[0680] Once all procedures are complete, the server sends a notification to the terminal, allowing the user or their representative to confirm the completion of the process.

[0681] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0682] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0683] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0684] [Fourth Embodiment]

[0685] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0686] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0687] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0688] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0689] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0690] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0691] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0692] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0693] FIG. 8 shows an example of the main functional parts of the data processing apparatus 12 and the robot 414. As shown in FIG. 8, in the data processing apparatus 12, specific processing is performed by the processor 28. The storage 32 stores a specific processing program 56.

[0694] The specific processing program 56 is an example of the "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by operating as a specific processing unit 290 according to the specific processing program 56 executed by the processor 28 on the RAM 30.

[0695] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the specific processing unit 290.

[0696] In the robot 414, reception / output processing is performed by the processor 46. The storage 50 stores a reception / output program 60. The processor 46 reads the reception / output program 60 from the storage 50 and executes the read reception / output program 60 on the RAM 48. The reception / output processing is realized by operating as a control unit 46A according to the reception / output program 60 executed by the processor 46 on the RAM 48.

[0697] Next, the specific processing by the specific processing unit 290 of the data processing apparatus 12 will be described. In the following description, the data processing apparatus 12 is referred to as a "server", and the robot 414 is referred to as a "terminal".

[0698] The digital legacy arrangement system of the present invention manages a plurality of digital services used by users and automatically performs procedures for account cancellation and data deletion. This system is composed of three main actors: the user, the server, and the terminal.

[0699] First, users access the system and register the identification information of the digital services they use, as well as their preferred response time limits and procedures for each service. This provides the basic information necessary for organizing the user's account and data.

[0700] Next, the server receives this information and periodically checks whether there has been any access to each digital service account during the specified inactivity period. To do this, the server uses the APIs and protocols of each service to obtain the date and time of the last access, without necessarily requiring user interaction.

[0701] If the server determines that the user has exceeded the unresponsive period specified by the user, the server will send a notification to the user via the registered contact method (e.g., email or SMS). This notification will contain a list of accounts that are unresponsive and a request for continued verification.

[0702] If the user does not respond within the specified response time, the server will send a notification to a pre-registered representative (usually a family member or close friend) to obtain their consent to close the account or delete the data. After consent is obtained, the device will automatically attempt to access each digital service and perform the specified procedures. This includes canceling the digital service account and completely deleting the data.

[0703] Once all procedures are complete, the server will notify the family or their representative of the results. Specifically, it will provide a detailed report of which accounts were closed and which data was deleted.

[0704] Furthermore, if the user so desires, the system itself can be deactivated, and all data stored on the server will be completely erased. Throughout this entire process, the present invention provides an environment in which a user's digital assets can be organized in the event of an unexpected incident, and an agent can respond quickly and reliably.

[0705] As a concrete example, consider a user who uses social media, email, and video streaming services. The user sets a three-month inactivity period for each service and chooses to delete all accounts. The server periodically checks access information and initiates the process if there is no activity for more than three months. If the user does not respond, a notification is sent to an agent, and after obtaining their consent, the process of automatically deleting the accounts is executed.

[0706] The following describes the processing flow.

[0707] Step 1:

[0708] Users register identification information for the digital services they access and use within the system. This includes the service name, account ID, password, and API key. Users also set a no-response period and desired action (deletion or cancellation) for each service.

[0709] Step 2:

[0710] The server receives and securely stores the user's identification information. During this process, measures are taken to encrypt the data and prevent unauthorized access by third parties.

[0711] Step 3:

[0712] The server attempts to access each account for registered digital services at a configured frequency (e.g., weekly) and retrieves the last access date and time. This is done using the APIs or protocols provided by each service.

[0713] Step 4:

[0714] The server monitors each account based on the retrieved last access time to ensure that it has not exceeded the user-specified inactivity period. It then updates the list of accounts that have been found to be inactive.

[0715] Step 5:

[0716] If the server detects a lack of response, it will send a notification to the user via the registered contact method (e.g., email, SMS). The notification will include details of the account that was found to be unresponsive and a request for verification.

[0717] Step 6:

[0718] If a response from the user is not received within the specified period, the server will send a notification to the registered agent requesting their consent regarding the unresponsive account and how to handle it.

[0719] Step 7:

[0720] After confirming the agent's consent, the server accesses each designated digital service through the terminal and automatically initiates the registration process. This includes account cancellation or data deletion.

[0721] Step 8:

[0722] The terminal reports the progress of the procedure to the server in real time and verifies that all processing has been completed.

[0723] Step 9:

[0724] The server will notify the agent of the results after all procedures are complete. The notification will include details of which accounts were terminated and which data was deleted.

[0725] Step 10:

[0726] Based on the user's request, the device will deactivate the system account itself and completely delete all user-related data stored on the server.

[0727] (Example 1)

[0728] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0729] In today's world, users have increasing opportunities to access a wide variety of information resources, and in the event of unforeseen circumstances, managing and organizing these resources and access rights becomes extremely difficult. In such situations, organizing information resources based on user decision-making is essential, and as a result, efficient and rapid countermeasures by a representative are required. However, current technology does not adequately provide a mechanism to fully automate this process and execute it safely and effectively.

[0730] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0731] In this invention, the server includes identification information for a specific information resource, a device for monitoring the unresponsive period set by the user, a device for notifying the user when unresponsiveness is detected, and a device for notifying a pre-designated agent when there is no response from the user. This makes it possible to quickly organize information resources and user qualifications and create an environment in which the agent can respond appropriately.

[0732] "Information resources" is a general term for data and accounts that users can access or use in a digital environment.

[0733] "Identifying information" refers to unique information or data used to distinguish a particular information resource from other information resources.

[0734] "No response period" refers to a period set by the user during which no access or response from the user is detected.

[0735] "Device" refers to a component or part of a system designed to perform a specific function.

[0736] "Usage eligibility" refers to the right or access for a user to utilize specific information resources.

[0737] "Agent" refers to a third party who is authorized to perform specific actions or make decisions on behalf of a user.

[0738] "Information conversion" refers to the modification of data through encryption or other methods performed to securely store information and data.

[0739] This invention provides a digital legacy organization system for efficiently organizing and managing multiple information resources managed by users.

[0740] System Configuration

[0741] This system is mainly composed of three entities: a server, a terminal, and a user. The server is a device that comprehensively manages digital information and is responsible for monitoring and notifying during unresponsive periods. The terminal is a device for automatically executing the cancellation of information resources and the deletion of data. The user is the entity that organizes information resources, registers their own information in the system, and sets desired procedures.

[0742] Technologies Used

[0743] The server uses a cloud-based platform for information processing and an API to access each information resource. Specifically, based on the identification information of the information resources set by the user, it regularly checks the access status during the unresponsive period and sends emails or text messages to the user or agent as needed. To ensure data security, the server manages information resources using information conversion technology. The terminal uses automation technology by scripts to execute the cancellation process of each information resource.

[0744] Usage Examples <从这里开始,原内容中没有新的英文翻译内容,所以保持原样不变>

[0745] As a specific example, assume that a certain user registers for SNS, email, and distribution services and sets a three-month non-response period. In this case, the server regularly monitors access to these services and sends a notification to the user if no access can be confirmed for three months. If the user does not respond, the server sends a similar notification to a pre-set agent, and after obtaining approval, the terminal automatically executes the cancellation of the information resource and data deletion.

[0746] Example of prompt text

[0747] As an example of a prompt text when using a generative AI model, a format such as "Please explain the process of setting a non-response period and automatic cancellation procedure for SNS accounts using a digital legacy arrangement system." can be considered. By using this prompt, the user can obtain a detailed explanation of the overview and specific procedures of the system.

[0748] Through this system, the user can efficiently manage digital information resources, and an environment is prepared for the agent to take prompt and appropriate actions.

[0749] The flow of the specific process in Example 1 will be described using FIG. 11.

[0750] Step 1:

[0751] The user accesses the system and enters, from the registration screen, the identification information of the information resources they are using, the desired non-response period, and the content of the procedure.

[0752] Input: Identification information and setting information of the user's information resources

[0753] Data processing: The system saves the user's input in the database and applies information conversion technology to securely manage the identification information.

[0754] Output: The state where the user's registration information is securely saved

[0755] Step 2:

[0756] The server periodically checks the last access date and time to each information resource based on the registered identification information and the period of no response.

[0757] Input: User-registered unresponsive period and information resource identification information

[0758] Data Processing: The server calls the API for each information resource to obtain access status. The retrieved data is analyzed to determine whether the unresponsive period has been exceeded.

[0759] Output: List of unresponsive information resources

[0760] Step 3:

[0761] The server will notify users via email or SMS about information resources that have exceeded the unresponsive period.

[0762] Input: List of unresponsive information resources

[0763] Data processing: Automatically generate notification messages about the relevant information resources and send them to the user.

[0764] Output: Notification message sent to the user

[0765] Step 4:

[0766] If the user does not respond, the server will send a notification to a pre-registered proxy.

[0767] Input: Status of no response from the user and contact information of the representative.

[0768] Data processing: Generate and automatically send notification messages to the agent.

[0769] Output: Notification message sent to the agent

[0770] Step 5:

[0771] After obtaining consent from the agent, the terminal uses a script to access each information resource and perform actions such as canceling the service or deleting data related to that resource.

[0772] Input: Procedural consent from the agent and identification information of the information resource.

[0773] Data processing: An automated script calls the API of the information resource to perform cancellation procedures and data deletion.

[0774] Output: Status of information resources that have been canceled or deleted.

[0775] Step 6:

[0776] After all procedures are completed, the server reports the results to the agent.

[0777] Input: Data of completed procedures

[0778] Data processing: Generate a report summarizing the results of the procedure and send it to the agent.

[0779] Output: Report sent to agent

[0780] By processing information in this order, the user's information resources are efficiently organized, and the agent can respond quickly.

[0781] (Application Example 1)

[0782] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0783] With the widespread use of digital information, managing personal belongings and bank accounts that individual users of information processing services can no longer control has become a challenge. Furthermore, deficiencies in automated management procedures during periods of no response could lead to information leaks and unauthorized access. Therefore, it is essential to establish an environment where a representative can reliably carry out appropriate procedures while the user is still alive.

[0784] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0785] In this invention, the server is installed on a mobile information terminal and includes means for automating operations during periods of no response, means for periodically communicating with an agent via a cloud environment, and means for notifying the user when no response is detected. As a result, even after the user-set period of no response has elapsed, account and numerical information is automatically and securely organized, and appropriate contact and organization procedures can be carried out with the agent.

[0786] "Information processing services" refer to services that collect, process, store, and provide data, and are accessed through online platforms.

[0787] A "user" is a person who uses information processing services and manages their personal information and settings.

[0788] "No response period" refers to a period during which a user does not access the service, and it is the criterion for when special procedures are taken if that period has elapsed.

[0789] An "agent" is a third party authorized to manage accounts and data related to information processing services on behalf of the user.

[0790] An "account" refers to an account based on an individual's identification information within an information processing service.

[0791] "Numerical information" refers to data that is stored and managed within an information processing service.

[0792] A "portable information terminal" is a device that a user can carry with them and is used to perform information processing services.

[0793] A "cloud environment" is the foundation for virtualized information services provided via the internet, and is used for data storage and processing.

[0794] The system for realizing this invention is primarily implemented using servers, mobile information terminals, and a cloud environment.

[0795] The server runs a program that periodically monitors access to specific information processing services based on the unresponsive period set by the user. For this purpose, the server utilizes the API of each information processing service to obtain and record the user's last access date and time, and determines whether the user has not responded based on that information. If an unresponsiveness is detected, the server automatically sends a notification to the proxy via the cloud environment and requests the proxy's confirmation.

[0796] The personal digital assistant (PDCA) provides a user-friendly interface for configuring settings and entering information such as response times and the identity of a proxy. The PDCA also has the capability to securely manage identification information using encryption technology.

[0797] As a concrete example, consider a case where a user manages accounts for social networking services and email services. If the user does not access these accounts for three months, the server will check the situation and automatically notify a designated representative via email or SMS. Once the representative approves, the server will proceed with the account cancellation process and deletion of numerical data.

[0798] An example of a prompt for a generative AI model could be: "A user has set a 6-month no-response period for social networking services and email services. Please explain how the proxy will be notified after the no-response period has elapsed, and how the services will clean up the account and data."

[0799] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0800] Step 1:

[0801] The user uses an application installed on their mobile device to input information about the information processing service, the unresponsive period, and the information of the agent. This input data is encrypted by the device and securely transmitted to the server. On the server, the input data is registered as identification information.

[0802] Step 2:

[0803] The server periodically checks access status via the APIs of each information processing service, based on registered identification information. The input is an API request linked to the identification information, and the output is the last access date and time. From this data, the server calculates whether the user-defined no-response period has been exceeded.

[0804] Step 3:

[0805] If the server fails to respond for an extended period, it sends a confirmation notice to the user using a pre-configured notification method. While waiting for a response from the user, it determines whether the lack of response has continued. The input for this step is the result of the no-response determination, and the output is the status of sending the confirmation notice.

[0806] Step 4:

[0807] If there is no response from the user, the server automatically sends a notification to the proxy. The notification includes the account information in the non-response state. The input is the confirmation information of the user's non-response, and the output is the sending of the notification to the proxy.

[0808] Step 5:

[0809] When the server accepts the approval from the proxy, the server uses the API of the information processing service to execute the account cancellation or numerical information deletion procedure. The input is the proxy approval information, and the output is the procedure completion report. Specifically, execute an API call and wait for a confirmation response.

[0810] Step 6:

[0811] When all procedures are completed, the server notifies the proxy and the user of the results. The final output is a notification including the detailed results of the procedure. As the prompt text for the generation AI model, it includes a text description that explains the procedure flow through the specific cases that occurred and details the usage method of the procedure results.

[0812] Furthermore, an emotion engine for estimating the user's emotion may be combined. That is, the specific processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform specific processing using the user's emotion.

[0813] The present invention enables data processing that takes into account the user's emotional state by combining an emotion recognition engine with a digital legacy sorting system. This system operates with the cooperation of the user, the server, and the terminal to achieve more personalized notifications and processing.

[0814] First, the user registers the identification information of the digital service they use with the system and sets the non-response period and the processing method (e.g., data deletion, account cancellation) desired for each service. Thereby, the basic management information of digital assets is prepared.

[0815] The newly integrated emotion recognition engine analyzes the user's emotions when they connect to the system and when they send notifications. Emotional data is determined using a specific algorithm based on the user's input information and interaction history.

[0816] The server periodically monitors each digital service during the configured unresponsive period, retrieves the last access date and time, and sends a notification to the user if unresponsiveness is detected. Using data from the emotion recognition engine, the notification is tailored to the user's emotional state. For example, if the server detects that the user is experiencing high stress, it adjusts the frequency and content of the notification.

[0817] If no response is received from the user for a certain period, the server will notify a pre-designated agent, and upon obtaining the agent's consent, it will automatically terminate the digital service or delete the data via the terminal. The history of emotional activity is stored encrypted to ensure data security.

[0818] As a concrete example of this system, suppose a user manages accounts for social media, email, and video streaming services. If there is no access to the account within a period set by the user, the server sends a notification that balances urgency and consideration, taking into account the user's emotional state. In this way, the system provides more considerate non-response notifications and an appropriate data management process.

[0819] The following describes the processing flow.

[0820] Step 1:

[0821] Users access the system and register identification information for the digital services they manage. During this process, they also configure response time limits and desired processing options.

[0822] Step 2:

[0823] Upon receiving the registered identification information, the server simultaneously analyzes the user's emotions using an emotion recognition engine. Based on the analysis results, the user's emotional state is recorded in the database.

[0824] Step 3:

[0825] The server accesses each digital service account at a configured frequency and retrieves the last access date and time. This access uses the API or specific protocol of each service.

[0826] Step 4:

[0827] The server checks whether the retrieved last access time exceeds the unresponsive period set by the user. If an unresponsive state is detected, the information is added to the update list.

[0828] Step 5:

[0829] If the server detects no response, it will consider the emotional state analyzed by the emotion recognition engine and send a notification to the user. The content and tone of the notification will be adjusted according to the detected emotion.

[0830] Step 6:

[0831] If no response is received from the user for a certain period, the server will send a notification to a pre-registered agent. This notification will also be as considerate as possible.

[0832] Step 7:

[0833] After confirming that the agent's consent has been obtained, the server will automatically cancel the account or delete the data for each registered digital service via the terminal.

[0834] Step 8:

[0835] The terminal reports the completion of actions performed on each service to the server, and the server notifies the agent of the result.

[0836] Step 9:

[0837] After all procedures are completed, the server encrypts and stores the user's emotional data and related information to ensure security.

[0838] (Example 2)

[0839] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0840] Managing user accounts and data remaining on digital platforms, especially when users haven't accessed them for extended periods, presents a significant challenge. Furthermore, it's necessary to consider users' emotional states when sending notifications to ensure a more considerate approach. Additionally, ensuring data security throughout these processes while implementing appropriate automation is crucial.

[0841] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0842] In this invention, the server includes an identifier for a specific digital platform, a mechanism for monitoring the unresponsive period set by the user, an emotion recognition mechanism for analyzing the user's emotional state, and a mechanism for adjusting notification content based on the results of emotion recognition. This makes it possible to automatically and securely manage digital accounts and data while taking the user's emotional state into consideration, and to respond more effectively to unresponsive situations.

[0843] A "digital platform" refers to an underlying system that includes various services and accounts provided online.

[0844] An "identifier" refers to information used to identify and manage accounts and data on a specific digital platform.

[0845] "No response period" refers to a time frame in which a user does not access a digital platform for a certain period of time.

[0846] A "system" refers to a method or process designed to achieve a specific function or purpose.

[0847] "Emotion recognition" refers to technology that analyzes and determines a user's emotional state based on data and input information.

[0848] "Adjusting notification content" refers to changing the content and wording of messages sent according to the user's emotional state and circumstances.

[0849] This invention is a system that automates account and data management on digital platforms and is capable of responding while considering the user's emotional state. The system operates primarily through server, terminal, and user interaction.

[0850] First, users register the identifiers of the digital platforms they use with the system. This is done using a dedicated application or web interface, where users can enter their IDs and access information for each platform. This allows users to pre-configure their unresponsiveness period and preferred data processing methods (e.g., data deletion, account termination).

[0851] The server periodically monitors each digital platform using registered identifiers. During periods of inactivity, the server accesses the digital platform and calls an API to retrieve the last login date and time. This monitoring activity utilizes specialized software for data processing and retrieval.

[0852] The user's emotional state is analyzed using a generative AI model. Various user input information and interaction history are used as input data, and the emotion recognition engine determines the user's stress level and degree of relaxation. Based on this, the server sends notifications to the user using prompt messages. An example of a prompt message that utilizes the generative AI model is, "Your SNS account hasn't been accessed for a long time; is there anything we can do to help?"

[0853] If the user does not respond for a certain period, the server will notify a pre-designated representative. After obtaining the representative's consent, the account will be automatically terminated and the data deleted via the user's device. Encryption technology is used throughout this process to ensure the security of communications. Finally, there is a mechanism to confirm and report that all procedures have been completed.

[0854] In this way, the entire system works together to provide a considerate data management process that takes user emotions into account.

[0855] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0856] Step 1:

[0857] Users register the identifiers of the digital platforms they use with the system through a dedicated application or web interface. Users input their ID and access information for each platform. Based on this input, the system generates identifier data and allows users to set the unresponsiveness period and their preferred data processing method (such as data deletion or account termination). This allows the user's information to be stored in the database.

[0858] Step 2:

[0859] The server performs the task of periodically monitoring the digital platform. The server accesses the target platform's API using a registered identifier and retrieves the last login date and time. The input consists of the identifier and the period of inactivity; the retrieved login date and time is saved and updated as output. This monitoring ensures that user access information remains up-to-date.

[0860] Step 3:

[0861] The user's emotional state is analyzed by an emotion recognition engine on the server. User input information and interaction history are used as input data, and a generative AI model calculates emotional data. The output is the user's emotional state, including their stress level and degree of relaxation. The results of the emotion recognition are used to adjust the content of notifications.

[0862] Step 4:

[0863] When the server detects a lack of response, it notifies the user based on analyzed sentiment data. The inputs include the user's emotional state and the lack of response status, and a notification message using a prompt is output. Specifically, if the user is experiencing high stress levels, measures are taken to soften the tone of the notification. For example, a prompt message such as "You haven't accessed your social media account for a long time; is there anything we can do to help?" might be sent.

[0864] Step 5:

[0865] If there is no response from the user for a certain period, the server sends a notification to a pre-designated proxy. The input is the user's unresponsive status and the proxy's information, and the output is a notification message to the proxy. The server generates a message that includes all the information necessary to obtain consent from the proxy.

[0866] Step 6:

[0867] After obtaining the agent's consent, the system automatically cancels the account or deletes the data via the terminal. Inputs are the agent's consent and the user's identification information, and output is the status of account cancellation or data deletion completion. The terminal triggers a script, which then executes the cancellation procedure through the API of each service.

[0868] This processing flow enables appropriate account management and automated data processing while taking user sentiment into consideration.

[0869] (Application Example 2)

[0870] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0871] Traditional digital estate management systems often issue uniform notifications without considering the user's emotional state, which can cause stress and anxiety. Furthermore, there is a risk that users may miss particularly important notifications or procedures requiring confirmation, highlighting the need for personalized notifications. Additionally, ensuring the secure management of data and guaranteeing appropriate notification to a representative in the event of a user's unresponsiveness are also challenges.

[0872] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0873] In this invention, the server includes means for generating notifications corresponding to emotional states using an emotion recognition device, a device for monitoring periods of inactivity set by the individual, and a device for terminating a data service account or deleting data based on recorded identification information after obtaining the consent of the agent. This enables flexible notifications that take into account the user's emotional state, ensures that individuals receive important information, and improves the security of data management.

[0874] "Data services" refer to various platforms that utilize information and functions provided to users via the internet.

[0875] "Identification information" refers to data used to distinguish a particular user or account from others.

[0876] "No response period" refers to the range of time during which a user remains in a state of not taking a specific action.

[0877] "Device" refers to a component of hardware or software designed to perform a specific function.

[0878] An "agent" refers to a person who is authorized by a user to perform specific actions on their behalf.

[0879] An "emotion recognition device" refers to a device or software that analyzes a user's emotional state using a specific algorithm.

[0880] "Notification" refers to a means of communication used to inform a user or their representative of specific information.

[0881] An "encryption device" refers to a system that uses technology to transform data for security purposes and protect it from unauthorized access.

[0882] The system implementing this invention is for data service management, and the server, terminal, and user elements work in conjunction with each other.

[0883] The server monitors the unresponsiveness period setting, and if no response is received from the user within the set period, it uses an emotion recognition device to analyze the user's emotional state and then generates a notification. Software such as Affectiva or Amazon Rekognition is used as the emotion recognition device, which allows for real-time analysis of the user's emotions.

[0884] This notification's content and tone are adjusted according to the user's emotional state, and measures such as reducing the frequency of notifications can be taken if the user is experiencing high stress levels. Furthermore, if the user remains unresponsive, a notification will be sent to their representative, and if the representative consents, the server will terminate the data service account or delete the data.

[0885] The device functions as the user's interface device, serving as a medium for users to view settings and notifications. Users can use it to customize settings such as response time limits and how they receive notifications based on their emotions.

[0886] For example, if a user manages their personal information for an online banking service, and there is no access for a certain period, stress or busyness could be the cause. The server can detect this situation and send a notification in a gentle tone saying, "Please check back when you have time."

[0887] An example of a prompt message generated using an AI model is, "Generate a notification message that is likely to be received when the user's stress level is high." This allows the system to provide personalized data management that takes the user's needs into consideration.

[0888] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0889] Step 1:

[0890] The server receives user identification information and a period of inactivity as input. Based on this information, the server monitors whether there has been any access from the user within the specified period and detects inactivity.

[0891] Step 2:

[0892] If no response is detected, the server analyzes the user's emotional state using an emotion recognition device. It takes in the user's input data and interaction history and evaluates the user's emotional level using a specific algorithm. Based on these results, it determines the content and frequency of notifications.

[0893] Step 3:

[0894] The server generates appropriate notifications based on the analysis results. It selects expressions and content that match the user's emotional state and prepares the notification accordingly. For example, if the stress level is high, the notification content is designed to be gentler and less frequent.

[0895] Step 4:

[0896] The server sends the generated notification to the device. The device displays the received notification in its user interface, allowing the user to confirm it.

[0897] Step 5:

[0898] If the user does not respond to the notification, the server prepares to notify a pre-designated representative. It retrieves the representative's contact information from the database and sends an approval request.

[0899] Step 6:

[0900] If consent is obtained from the agent, the server will execute instructions to terminate the data service account or delete the data based on the user's identification information. This process ensures that the data is managed in accordance with the user's instructions.

[0901] Step 7:

[0902] Once all procedures are complete, the server sends a notification to the terminal, allowing the user or their representative to confirm the completion of the process.

[0903] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0904] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0905] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0906] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0907] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0908] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0909] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0910] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0911] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0912] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0913] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0914] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0915] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0916] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0917] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0918] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0919] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0920] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0921] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0922] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0923] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0924] The following is further disclosed regarding the embodiments described above.

[0925] (Claim 1)

[0926] Identification information for a specific digital service,

[0927] A means for monitoring the unresponsive period set by the user,

[0928] A means of notifying the user when no response is detected,

[0929] A means of notifying a pre-designated agent if there is no response from the user,

[0930] After obtaining the agent's consent, means to terminate the digital service account or delete data based on the recorded identification information,

[0931] A means of notification after all procedures are completed,

[0932] A system that includes this.

[0933] (Claim 2)

[0934] The system according to claim 1, comprising encryption means for securely storing registered identification information.

[0935] (Claim 3)

[0936] The system according to claim 1, further comprising means for deactivating the system itself in response to a user's request.

[0937] "Example 1"

[0938] (Claim 1)

[0939] Identification information for a specific information resource,

[0940] A device for monitoring the unresponsive period set by the user,

[0941] A device that notifies the user when no response is detected,

[0942] A device that notifies a pre-designated representative if there is no response from the user,

[0943] A device that, after obtaining the consent of the agent, terminates the access rights to information resources or deletes the information based on the recorded identification information,

[0944] A device that provides notification after all procedures are completed,

[0945] A device that automatically checks the last access date and time of an information resource during a user-defined unresponsive period, and periodically checks using the information resource's contact method.

[0946] A system that includes this.

[0947] (Claim 2)

[0948] The system according to claim 1, further comprising an information conversion device for securely storing recorded identification information.

[0949] (Claim 3)

[0950] The system according to claim 1, further comprising a device for deactivating the system itself in response to a user's request.

[0951] "Application Example 1"

[0952] (Claim 1)

[0953] Identification information for a specific information processing service,

[0954] A function to monitor the unresponsive period set by the user,

[0955] A function that notifies the user if no response is detected,

[0956] A function that notifies a pre-designated representative if there is no response from the user,

[0957] After obtaining the consent of the agent, the system has a function to close the information processing service account or delete numerical information based on the recorded identification information,

[0958] A function to send a notification after all procedures are completed,

[0959] It is installed on mobile devices and has a function to automate operations during periods of unresponsiveness,

[0960] A function to periodically communicate with the proxy via the cloud environment,

[0961] A system that includes this.

[0962] (Claim 2)

[0963] The system according to claim 1, comprising cryptographic technology for securely storing registered identification information.

[0964] (Claim 3)

[0965] The system according to claim 1, further comprising a function to deactivate the system itself in response to a user's request.

[0966] "Example 2 of combining an emotion engine"

[0967] (Claim 1)

[0968] Identifiers for specific digital platforms,

[0969] A mechanism for monitoring the unresponsive period set by the user,

[0970] A mechanism to notify the user if no response is detected,

[0971] A system that notifies a pre-designated representative if there is no response from the user,

[0972] A mechanism to terminate a digital platform account or delete information based on a recorded identifier after obtaining permission from the agent,

[0973] A mechanism for analyzing the emotional state of users,

[0974] A mechanism that adjusts notification content based on the results of emotion recognition,

[0975] A system to notify after all procedures are completed,

[0976] A system that includes this.

[0977] (Claim 2)

[0978] The system according to claim 1, comprising coding technology for securely storing recorded identifiers.

[0979] (Claim 3)

[0980] The system according to claim 1, further comprising a function for deactivating the system itself in response to a user's request.

[0981] "Application example 2 when combining with an emotional engine"

[0982] (Claim 1)

[0983] Identification information for a specific data service,

[0984] A device for monitoring the unresponsive period set by an individual,

[0985] A device that notifies an individual if no response is detected,

[0986] A device that notifies a pre-designated representative if there is no response from the individual,

[0987] A device that, after obtaining the consent of the agent, terminates a data service account or deletes data based on recorded identification information,

[0988] A device that uses an emotion recognition device to generate notifications according to the emotional state,

[0989] A device that provides notification after all procedures are completed,

[0990] A system that includes this.

[0991] (Claim 2)

[0992] The system according to claim 1, comprising an encryption device for securely storing registered identification information.

[0993] (Claim 3)

[0994] The system according to claim 1, further comprising a device for deactivating the system itself in response to an individual's request. [Explanation of Symbols]

[0995] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. Identification information for a specific information processing service, A function to monitor the unresponsive period set by the user, A function that notifies the user if no response is detected, A function that notifies a pre-designated representative if there is no response from the user, After obtaining the consent of the agent, the system has a function to close the information processing service account or delete numerical information based on the recorded identification information, A function to send a notification after all procedures are completed, It is installed on mobile devices and has a function to automate operations during periods of unresponsiveness, A function to periodically communicate with the proxy via the cloud environment, A system that includes this.

2. The system according to claim 1, comprising encryption technology for securely storing registered identification information.

3. The system according to claim 1, further comprising a function to deactivate the system itself in response to a user's request.

Images