system
A system autonomously manages digital assets by monitoring access and using generative AI for cancellation and deletion, addressing the burden and risk of manual handling, ensuring secure and efficient management.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-05
- Publication Date
- 2026-06-17
AI Technical Summary
The management of digital recording assets after an individual's death poses a mental burden and risk of information leakage due to the need for manual cancellation and deletion by family members or agents, lacking efficient and secure management systems.
A system that collects user-specified digital asset information, monitors access status, and autonomously performs cancellation and data deletion using generative artificial intelligence, with notification and approval processes to ensure secure and efficient management.
Reduces the mental burden on users and their agents by automating the management of digital assets, ensuring secure and efficient handling of digital record assets.
Smart Images

Figure 2026098717000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In recent years, with the spread of information technology, digital recording assets that an individual used during their lifetime have become diverse, and appropriate management and organization of these are required in unexpected situations. In the conventional method, after the user's death, family members or agents need to individually cancel contracts and delete data, which has the problem of increased mental burden and risk of information leakage. The purpose of the present invention is to provide a system that can reduce such burdens and enable secure management of digital recording assets.
Means for Solving the Problems
[0005] This invention provides a system that collects information on digital record assets specified in advance by the user and continuously monitors the user's access status. If user access is not confirmed within the set period, the system includes means to autonomously perform cancellation procedures and data deletion using generative artificial intelligence, and reports the results to the user's agent, thereby enabling efficient management of digital record assets. Furthermore, it provides a method for obtaining reliable approval by notifying the agent using a predetermined communication means.
[0006] "User" refers to an individual who uses the system to manage their own digital record assets.
[0007] "Pre-configuration" refers to the setting operation that includes account information and cancellation conditions specified by the user to the system in advance.
[0008] "Digital record assets" refer to user information assets related to online services such as social media accounts, email accounts, and subscription services.
[0009] "Generative artificial intelligence" refers to artificial intelligence technology used to analyze web pages and automate necessary procedures.
[0010] An "agent" refers to a person designated by the user who has the authority to approve account management and verify procedures on their behalf.
[0011] "Cancellation procedures" refer to the series of procedures necessary to terminate a usage agreement for digital recording assets.
[0012] "Data erasure" refers to the procedure for completely deleting information contained in a user's digital record assets.
[0013] "Monitoring" refers to the process by which a system periodically checks user access logs and account status.
[0014] "Notice" refers to a message that informs the user or the agent of the system status and necessary actions.
[0015] "Communication means" refers to information transmission methods such as e-mail and SMS used by the system when sending notices and confirmations.
Brief Description of Drawings
[0016] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13]It is a sequence diagram showing the processing flow of the data processing system in Embodiment 2 when the emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when the emotion engine is combined.
Embodiments for Carrying Out the Invention
[0017] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0020] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0021] <000011"0>In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.
[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0024] [First Embodiment]
[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, input / output processing is performed by the processor 46. The input / output program 60 is stored in the storage 50. The input / output program 60 is used in combination with the specific processing program 56 by the data processing system 10. The processor 46 reads out the input / output program 60 from the storage 50 and executes the read input / output program 60 on the RAM 48. The input / output processing is realized by operating as the control unit 46A according to the input / output program 60 that the processor 46 executes on the RAM 48.
[0036] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart device 14 is referred to as a "terminal".
[0037] The digital legacy management system of the present invention is a system that enables users to appropriately manage their personal digital recording assets and prepare for unexpected situations. This system coordinates the server and the terminal to monitor accounts, automatically cancel contracts, and delete data based on the user's specifications.
[0038] The user first accesses the system using the terminal and registers information regarding their digital recording assets as pre-settings. This setting includes account information of the target SNS, email address, the number of days elapsed from the final usage date as the cancellation criterion, and contact information of the agent, etc. The user also specifies a policy regarding how to manage and delete data.
[0039] Based on the setting information, the server continuously monitors the usage status of each account. This is realized by using API access and web scraping technologies, and when the specified access period is exceeded, a notification prompting the user is automatically sent according to the pre-setting. The server waits for the user's response to the notification, and if there is no response, it proceeds with the approval request to the agent.
[0040] Upon approval from the agent, the server uses generative artificial intelligence to automatically perform the cancellation procedures and data erasure for each digital record asset. This AI crawls the website and performs operations that do not require user intervention, such as filling out necessary forms or selecting options. As a result, the user's digital record assets are organized according to specified criteria, and unnecessary data is quickly erased.
[0041] Specific example: Suppose a user registers their music streaming service with this system and sets it to automatically cancel 60 days after their last login. The server sends a notification to the user when there is no login activity for 60 days. If the user does not respond, it requests approval from their agent, and after approval, the subscription is automatically canceled. As a result, the effort required from both the user and their agent is significantly reduced, and the management of digital record assets is simplified.
[0042] This invention provides an embodiment that comprehensively manages digital record assets used by users on a daily basis and enables rapid processing as needed. This system reduces the burden on users and their families and enables safe and efficient asset management in the digital age.
[0043] The following describes the processing flow.
[0044] Step 1:
[0045] Users log in to the system using their terminal. Users enter information about the digital record assets they wish to manage and set conditions for cancellation / deletion, as well as information about their agent.
[0046] Step 2:
[0047] The server stores configuration information received from the user in a database. This stored information includes the account information to be monitored, the configured termination conditions, and the agent information.
[0048] Step 3:
[0049] The server periodically checks access logs for monitored digital record assets using API access and web scraping techniques. If no activity is detected within the configured period, it proceeds to the next step.
[0050] Step 4:
[0051] If the server does not detect activity, it will send a notification to the user using the configured communication method (e.g., email or SMS). The notification will include a request for prompt action.
[0052] Step 5:
[0053] The server waits for a response from the user for a certain period of time. If a response is received, monitoring will continue or stop according to the user's preference.
[0054] Step 6:
[0055] If there is no response, the server will send an approval request notification to the agent. This notification will also include a request for a prompt response.
[0056] Step 7:
[0057] After receiving approval from the agent, the server uses generative artificial intelligence to execute procedures for canceling or erasing data from each digital record asset.
[0058] Step 8:
[0059] The server compiles the results of each procedure and sends a report to the user and their representative. The report includes an overview of the accounts that have been terminated and the data that has been deleted.
[0060] (Example 1)
[0061] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0062] In today's information-driven society, there is a problem with digital information assets used by individuals during their lifetime, which remain unmanaged even after they cease to use them or after their death. This lack of management of digital information poses a risk of personal information leakage and misuse. Furthermore, it is likely to be a burden for surviving family members and other related parties, as it is unclear how these assets should be handled. Therefore, there is a need for a system that can properly manage digital information assets and automatically and securely organize them when they cease to be used or after death.
[0063] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0064] In this invention, the server includes means for accepting pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the access status to the user's identification information for a predetermined period using API access and web information acquisition technology; and means for notifying the user and their agent if no access is detected, and automatically canceling the account and deleting the information upon approval from the agent. This enables appropriate handling of the suspension of use of digital information assets, enhances the security of personal information, and reduces the burden on stakeholders.
[0065] A "user" is an individual or organization that uses this system to manage and configure their own digital information assets.
[0066] "Digital information assets" refer to electronically stored data and information owned or managed by the user, including account information, emails, and digital content.
[0067] "Identification information" refers to account information and login information used to access digital information assets.
[0068] "API access" refers to the way a system interacts with other software services through an application programming interface.
[0069] "Web information acquisition technology" refers to techniques for extracting data from websites, including web scraping.
[0070] An "agent" refers to an individual or entity authorized to receive notifications sent from the system on behalf of the user and to perform necessary approvals.
[0071] A "generative information processing device" refers to an artificial intelligence or computer system that is capable of automatically processing information and performing specific tasks.
[0072] "Means of providing notification" refers to methods that provide a function for transmitting information from the system to users and their agents.
[0073] This invention is a system that enables users to properly manage their digital information assets and prevent them from being left unattended without proper designation. In this system, a server and a terminal work together to manage digital information assets based on user instructions.
[0074] Users access the system via their devices and register information about their digital information assets. This registration information includes account information, email address, cancellation date (number of days since last use), and contact information for their agent. Users also set policies regarding how their information will be managed and deleted.
[0075] The server continuously monitors the usage of specified identification information based on the user's registration information. Monitoring utilizes API access and web information retrieval technologies, which are used to analyze the account's usage history. If access cannot be confirmed, the server sends a notification to the user and also notifies their representative to request authorization.
[0076] Upon approval from the agent, the server automatically performs cancellation and data deletion using a generative information processing device. AI crawls the website, automatically fills in necessary forms, and selects options, enabling operations that do not require user intervention. Through this process, users' digital information assets are managed quickly and accurately according to defined conditions.
[0077] Specific example
[0078] For example, suppose a user registers for a music streaming service with this system and sets it to automatically cancel 60 days after their last login. When the server detects that the service has not been used for 60 days, it sends a notification to the user, and if no response is received, it requests confirmation from their agent. After obtaining permission, the subscription is automatically canceled. As a result, the effort required for both the user and their agent is significantly reduced.
[0079] Example of a prompt
[0080] "How can I use a generative AI model to automatically cancel my music streaming service account?"
[0081] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0082] Step 1:
[0083] Users access the system via their devices and enter information about their digital information assets. Specifically, they fill out a form that includes information about their social media accounts, email address, cancellation date, and contact information for their agent, and then save their settings. This information is sent to the system's database and stored as registration information.
[0084] Step 2:
[0085] The server receives information entered by the user and checks usage status based on the identification information stored in the database. The server tracks the last usage date of each account using API access and web information retrieval technologies and performs data analysis based on a specified reference date.
[0086] Step 3:
[0087] The server sends a notification to the user if the account has not been used for a specified period. The notification is automatically generated using the previously registered email address and prompts the user to confirm their intention to continue.
[0088] Step 4:
[0089] If the server does not receive a response from the user within a certain period, it will send a notification requesting approval to the agent. The message sent to the agent will be sent using a pre-registered communication method and will request approval for the cancellation of the user's identity information and the deletion of the information.
[0090] Step 5:
[0091] Upon receiving approval from the agent, the server uses a generated AI model to initiate the automated cancellation and data deletion process. The AI crawls the website, performing procedures such as form completion and option selection autonomously, and securely processing the specified identification information.
[0092] Step 6:
[0093] Finally, the server reports the results of the cancellation and deletion procedures it has performed. The server notifies the user and their representative of the execution status via email or other means of communication, and confirms the completion of the process.
[0094] (Application Example 1)
[0095] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0096] In modern society, the amount of personal digital information assets is increasing, making it difficult to manage them properly. Furthermore, there is a risk that these information assets may be neglected if users encounter unexpected situations. Moreover, the burden of managing digital information can extend not only to the user but also to their family, thus creating a need for efficient and comprehensive management systems.
[0097] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0098] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the usage status of the user's identification information for a predetermined period; means for notifying the user and their agent if access is not confirmed; means for automatically deactivating the identification information and erasing the information upon approval from the agent; means for reporting the results of the execution; and means for supervising the digital information assets via a home device and enabling interaction with the user. This reduces the burden on the user and their family and enables efficient and rapid management of digital information assets.
[0099] "User" refers to an individual who uses the system to manage digital information assets.
[0100] "Pre-configuration" refers to the act of users registering various conditions and information related to their digital asset management in the system in advance.
[0101] "Digital information assets" is a general term for electronic data and online accounts owned or managed by users.
[0102] "Identification information" refers to information used to identify a user's account or digital assets, and includes usernames, passwords, email addresses, etc.
[0103] "Access status" refers to information that shows the login and usage history of a user's account.
[0104] A "notification" is information that the system sends to a user or their representative to inform them of a situation.
[0105] An "agent" is an individual who has the authority to receive system notifications and perform necessary approvals on behalf of the user.
[0106] "Deactivation" refers to the act of disabling or deleting a user's account or information assets based on specific conditions.
[0107] "Data erasure" refers to the process of ultimately deleting digital information assets.
[0108] "Home devices" refer to electrical and information equipment used in the home, and support the management of digital information assets.
[0109] "Generative artificial intelligence" is an AI technology that automates specific tasks through the generation and analysis of data.
[0110] This invention provides a system for efficiently and conveniently managing digital information assets owned by users. This system is realized by linking a server with user terminals.
[0111] Server Processing
[0112] The server first accepts pre-configurations from the user and stores the information necessary for managing digital information assets in a database according to those configurations. This includes identification information and management policies. Based on the user's identification information, the server continuously monitors access status. Monitoring is performed using API access and web scraping techniques. If no access is detected within a specified period, the server automatically sends a notification to the user and their agent. After sending the notification and obtaining approval from the agent, the server uses generative artificial intelligence to automate the process of deactivating the identification information and deleting the data.
[0113] Terminal processing
[0114] Users' devices (e.g., smartphones and home devices) are used for settings, receiving notifications, and changing management policies. Home devices can communicate with users to inform them of the management status of digital information assets and allow them to make new settings.
[0115] Hardware and software used
[0116] Hardware: Home devices (e.g., smart home devices, home robots)
[0117] Software: Generative artificial intelligence written in Python, libraries for API access (e.g., Requests, BeautifulSoup)
[0118] Specific example
[0119] Consider a scenario where a user uses a smart device in their home to check the latest management status of their digital information assets. When the user speaks to the device, the device accesses a server, retrieves the necessary information, and conveys it to the user. At this time, the server can use generative AI to extract the necessary information and prepare notifications based on conditions set by the user.
[0120] Example of a prompt
[0121] "I want to automate digital management tasks during my next trip, so please set up cancellation conditions for the new streaming service."
[0122] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0123] Step 1:
[0124] Users use their own devices to perform the necessary pre-configurations for managing digital information assets. These configurations include identification information, management policies, and access frequency conditions. The input data is provided by the user, received by the server, and stored in a database. The output is the configuration information stored in the database.
[0125] Step 2:
[0126] The server periodically monitors access to the identification information based on the configured information, using API access and web scraping techniques. The input consists of the configuration information and the current access log. By comparing these two, the server detects an anomaly if no access is detected within the configured period. The output is a flag indicating whether an anomaly occurred.
[0127] Step 3:
[0128] If access is not confirmed, the server automatically sends a notification to the user's terminal and registered agent. This notification reports the situation and requests a signature if necessary. The input is the anomaly detection result from step 2, and the output is the notification message.
[0129] Step 4:
[0130] If the agent approves via a designated communication method (e.g., email or messaging app), the server uses a generated AI model to automatically execute procedures to decrypt and erase the identification information. The input is the agent's approval, and the output is the completion of the identification information decryption procedure on each platform.
[0131] Step 5:
[0132] After all procedures are complete, the server reports the results to the user's terminal. The report includes information such as whether the deactivation was successful and whether the information has been erased. The input is the processing result, and the output is the report message sent to the user.
[0133] Step 6:
[0134] Users can use their home devices to check the latest management status and add new settings or prompts. Input is voice commands and setting changes from the user, and output is voice or screen feedback from the device.
[0135] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0136] This invention provides more flexible and effective notifications and support by combining a system for efficiently organizing digital record assets with an emotion engine that recognizes user emotions. The system manages the user's digital record assets based on pre-configured settings and uses the emotion engine to respond according to the user's psychological state.
[0137] When users access the system using their devices and register information about their digital record assets, they configure their settings to allow sentiment analysis. Based on these settings, the server analyzes the user's emotional state via the sentiment engine using the user's access history and response data during notifications.
[0138] The server receives the user's emotional state as an analysis result and flexibly adjusts the content and timing of notifications. For example, if the server detects that the user is stressed, it can reduce the frequency of notifications or change the tone of the notifications to a gentler one. It can also provide additional specific support information to ensure the user can use the system comfortably.
[0139] As a concrete example, suppose the system is configured to initiate the cancellation process if a user has not accessed the system for 90 days since their last login. When sending a notification, if the emotion engine detects that the user is stressed or anxious, the notification will be sent using softer language than usual and will include additional support information and guidance. This will provide an environment in which the user can respond without stress.
[0140] Furthermore, the server provides appropriate notifications to the agent using an emotion engine. To reduce the agent's psychological burden, it assists them by providing concise explanations of the necessary procedures and sharing past success stories. In this way, a less burdensome procedure is achieved for both the user and the agent.
[0141] This invention enables intelligent digital record asset management that takes into account the user's emotional state, reducing psychological burden while ensuring safe and efficient management.
[0142] The following describes the processing flow.
[0143] Step 1:
[0144] Users log in to the system using their devices and register the digital record assets they wish to manage. At this stage, they also agree to perform sentiment analysis and complete the configuration of the sentiment engine.
[0145] Step 2:
[0146] The server stores a list of digital record assets to be managed in a database, based on the user's configuration information received from the terminal. Simultaneously, the emotion engine performs an initial analysis based on the user's basic information.
[0147] Step 3:
[0148] The server continuously monitors access to the user's account for a set period. It collects user connection data and interaction logs and forwards them to the sentiment engine.
[0149] Step 4:
[0150] The emotion engine analyzes the user's emotional state based on collected data and provides the results to the server. This visualizes the user's mental state.
[0151] Step 5:
[0152] The server uses the emotion engine's analysis results to adjust the content and timing of notifications to the user. If the user is experiencing stress, the notification content is softened, and supportive information is added as needed.
[0153] Step 6:
[0154] When it becomes necessary to notify the agent, the server uses an emotion engine to create and send a notification that takes the agent's psychological state into consideration. This makes it possible to provide support while reducing the agent's psychological burden.
[0155] Step 7:
[0156] After obtaining approval from the user or their representative, generative artificial intelligence will automate the termination of digital record assets and the erasure of data. The specific procedures will be based on information collected in advance.
[0157] Step 8:
[0158] After the procedure is complete, the server aggregates the results and reports them to the user and their representative. The report includes details of the procedure performed and suggestions for follow-up, if necessary.
[0159] (Example 2)
[0160] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0161] When effectively managing digital record assets, challenges include reducing the psychological burden on users and ensuring that notifications and procedures are appropriate to their emotional state. Automating necessary procedures and reducing the psychological burden on agents are also important challenges.
[0162] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0163] In this invention, the server includes means for analyzing the user's emotional state and adjusting the content and timing of notifications based on the analysis results, means for providing additional support information corresponding to the analyzed emotional state, and means for automatically executing the procedures necessary for canceling each digital record asset using generative artificial intelligence. This enables flexible and efficient management of digital record assets while reducing the psychological burden on users and their agents.
[0164] "User" refers to an individual or organization that uses the system to manage digital record assets.
[0165] "Digital recording assets" refer to a collection of electronically recorded information and files.
[0166] "Means of collecting information" refers to the process by which a system acquires necessary data from users and stores it for management purposes.
[0167] "Means of monitoring access status" refers to a method by which a system continuously checks and records access to and usage history of a user's account.
[0168] "Means of notification" refers to a function in which the system sends messages to users or their representatives to inform them of important information.
[0169] "Methods for analyzing emotional states" refer to the process of analyzing a user's psychological state and extracting data related to their emotions.
[0170] "Means of providing additional support information" refers to features that provide additional guidance and help for problems that users face.
[0171] "Generative artificial intelligence" is a technology that automatically generates new information and documents using language generation models and other methods.
[0172] A "prompt statement" is a sentence that contains input instructions or hints used by generative artificial intelligence when generating information.
[0173] An "agent" is a third party who has the authority to perform procedures and take action on behalf of the user.
[0174] "Communication means" refers to technical methods or equipment used to transmit information.
[0175] This invention is a system for effectively managing users' digital record assets. The main element of the system is to reduce the user's psychological burden by analyzing the user's emotional state and adjusting the content and timing of notifications accordingly.
[0176] Users access the system using a terminal and register information about their digital record assets. The terminal has a browser and applications installed, allowing users to input information and configure settings. During registration, users enable sentiment analysis. This setting is necessary to analyze the user's emotional state.
[0177] The server collects user access history and response data, and analyzes this data using an emotion engine. The emotion engine identifies the user's emotional state using natural language processing (NLP) and machine learning algorithms. If the analysis determines that the user is stressed, the server can reduce the frequency of notifications and adjust the content to a gentler tone. The specific software technologies used include generative AI models.
[0178] As a concrete example, suppose the system is configured to initiate the account cancellation process if a user has not accessed the system for 90 days since their last login. In this case, when the server sends a notification, if the emotion engine detects the user's stress or anxiety, it will soften the notification's language and include additional support information and guidance. For example, it might say, "There is no need to rush into canceling your account. If you have any questions, please feel free to contact our support team at any time."
[0179] Furthermore, a generative AI model is used to generate prompt messages, which are then used in notifications. An example of a prompt message is: "The user has not used the system for a long period of time. When sending a notification, please consider the user's emotional state and convey the information in an appropriate and gentle tone. Also, please provide additional support information and suggest ways to reduce the user's psychological burden."
[0180] In this way, the system reduces the psychological burden on users and their representatives, and enables flexible and efficient management of digital record assets.
[0181] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0182] Step 1:
[0183] Users access the system using a terminal and input information related to their digital record assets. This information includes asset type, registration date, and usage status. This input forms the basis for subsequent data processing.
[0184] Step 2:
[0185] The server receives information about digital record assets entered by the user and stores it in a database. At this point, the server generates an access history based on the input data and records the user's usage. This data serves as important foundational data for notifications and sentiment analysis.
[0186] Step 3:
[0187] Users configure permission for sentiment analysis through their device. Once the configuration is complete, the server sends access history and usage data to the sentiment engine based on the user's permission. At this stage, the server receives input indicating whether sentiment analysis is permitted and usage data, preparing it for sentiment analysis.
[0188] Step 4:
[0189] The server analyzes the user's emotional state using an emotion engine. As input data, the server uses collected access history and user response data. The emotion engine utilizes a generative AI model and natural language processing algorithms to evaluate the user's emotions and outputs the results as analysis data.
[0190] Step 5:
[0191] The server adjusts the content and timing of notifications based on the results of sentiment analysis. Taking the analysis data as input, the server generates prompt messages tailored to the user's emotional state. At this stage, if stress is detected, the notification tone is changed to a gentler one, and the frequency is also adjusted.
[0192] Step 6:
[0193] The server provides users with additional support information as needed. Through the generation of prompts, the server customizes the information users encounter, adding reassuring information and guidance to reduce the user's burden. In this process, the final notification content is determined based on the generated prompts.
[0194] (Application Example 2)
[0195] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0196] With the recent digitalization, information assets such as personal and specialized information have increased. However, the psychological burden associated with managing and canceling these information assets has become a challenge. Furthermore, there is a lack of notifications and information provision that take into consideration the feelings of users, and an improvement in the user experience is needed. Systems that adequately address these issues are still scarce.
[0197] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0198] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing information assets; means for monitoring access to the user's identification information for a predetermined period; means for notifying the user and their representative if no access is detected; means for automatically canceling the identification information and deleting the data upon approval from the representative; means for reporting the results of the execution; and means for flexibly adjusting the notification content and the support information provided using an emotion recognition function. This makes it possible to provide effective and flexible notifications and support while taking into account the user's emotional state and reducing the psychological burden associated with managing information assets.
[0199] A "user" is an individual or organization that manages, accesses, and manipulates information assets.
[0200] "Pre-configuration" is the process by which users register the conditions and requirements necessary for managing information assets in the system in advance.
[0201] "Information assets" refer to data such as personal information and specialized information stored digitally, which are resources that can be managed and used.
[0202] "Identification information" refers to unique data used to recognize users and manage access.
[0203] "Access status" refers to monitoring how users interact with and manipulate information assets.
[0204] A "proxy" is a third party authorized to perform management tasks on behalf of the user.
[0205] "Emotion recognition function" is a technology that understands a user's psychological state by analyzing their facial expressions and voice.
[0206] "Notification content" refers to the message and alert information provided to users and their representatives.
[0207] "Cancellation and data erasure" is the process of terminating the use of information assets and completely deleting related data, based on the approval of the user or their representative.
[0208] "Execution results" refer to information indicating the outcome of cancellations or data deletions performed by the system, and are reported to the user and their representative.
[0209] A system for carrying out this invention includes, as its main components, a server, a terminal operated by a user, and software that performs emotion recognition.
[0210] The server provides an interface for accepting pre-configured settings from users, thereby receiving the necessary conditions for managing information assets. Based on user identification information, the server constantly monitors access status and notifies the user and their representative if no access is detected within a specified period. The communication methods used here are existing email and messaging applications.
[0211] The emotion recognition function processes data input through the user's device's camera and microphone to analyze their emotional state. This utilizes commercially available emotion recognition software (such as Microsoft's Azure® Cognitive Services). Based on the emotion analysis results, the server adjusts the content of notifications and the tone of information delivery to reduce the user's psychological burden.
[0212] For example, in a resident app using the city's digital services, when providing information such as resource collection schedules, if the emotion engine detects that a resident is irritated, it can reduce regular notifications and provide more friendly messages. Such implementations allow users to use the system in a less stressful way.
[0213] When using generative AI models, prompts like the following are used: "If the user's emotion is identified as (emotional state), please explain, with specific examples, how to effectively adjust notifications and the information provided."
[0214] This invention integrates emotion recognition functionality with an information asset management system, enabling interactions that take into account the psychological state of individual users.
[0215] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0216] Step 1:
[0217] Users access the system using a terminal and perform pre-configuration for information asset management. Management conditions and identification information are registered as data input. The server receives this input and creates a new user account profile.
[0218] Step 2:
[0219] The server monitors access status based on identification information at regular intervals. The input here is login history data. The server analyzes this data and determines whether or not there has been access. If there has been no access, that fact is output.
[0220] Step 3:
[0221] When no access is detected, the server analyzes data collected from the device's camera and microphone via its emotion recognition function. The input is video and audio data, which is converted into emotional states by the emotion recognition software. The results of this analysis are obtained as output.
[0222] Step 4:
[0223] The server adjusts notification content and support information based on the analysis of the emotional state. Specifically, it uses a generative AI model to input prompt sentences and generates messages with gentle phrasing. This adjusted message is then sent as a notification.
[0224] Step 5:
[0225] The server sends notifications to the user and their representative using the configured communication method. These notifications include content tailored to the user's emotional state. The output of this notification process provides a tailored message and supporting information.
[0226] Step 6:
[0227] If the agent receives the notification and approves, the server will automatically terminate the identity information and delete the data. The input is the agent's approval data, and the deletion of the information asset and a completion report will be output.
[0228] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0229] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0230] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0231] [Second Embodiment]
[0232] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0233] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0234] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0235] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0236] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0237] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0238] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0239] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0240] The specific processing program 56 is an example of the "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by operating as the specific processing unit 290 according to the specific processing program 56 that the processor 28 executes on the RAM 30.
[0241] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the specific processing unit 290.
[0242] In the smart glasses 214, the reception and output processing is performed by the processor 46. The storage 50 stores a reception and output program 60. The processor 46 reads the reception and output program 60 from the storage 50 and executes the read reception and output program 60 on the RAM 48. The reception and output processing is realized by operating as the control unit 46A according to the reception and output program 60 that the processor 46 executes on the RAM 48.
[0243] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".
[0244] The digital legacy sorting system of the present invention is a system that enables users to appropriately manage their digital recording assets around them and prepare for unexpected situations. This system coordinates the server and the terminal to perform account monitoring, automatic解约 (it seems there is a typo here, maybe "cancellation"), and data deletion based on the user's designation.
[0245] Users first access the system using their device and register information about their digital record assets as pre-configurations. These settings include account information and email addresses for the relevant social networking services (SNS), the number of days elapsed since the last use (which triggers cancellation), and contact information for their representative. Users also specify policies regarding how their data should be managed and deleted.
[0246] The server continuously monitors the usage of each account based on its configuration information. This is achieved using API access and web scraping techniques, and if the specified access period is exceeded, it automatically sends a notification to the user to alert them according to the pre-configured settings. The server waits for a response from the user to the notification, and if there is no response, it proceeds with requesting approval from a representative.
[0247] Upon approval from the agent, the server uses generative artificial intelligence to automatically perform the cancellation procedures and data erasure for each digital record asset. This AI crawls the website and performs operations that do not require user intervention, such as filling out necessary forms or selecting options. As a result, the user's digital record assets are organized according to specified criteria, and unnecessary data is quickly erased.
[0248] Specific example: Suppose a user registers their music streaming service with this system and sets it to automatically cancel 60 days after their last login. The server sends a notification to the user when there is no login activity for 60 days. If the user does not respond, it requests approval from their agent, and after approval, the subscription is automatically canceled. As a result, the effort required from both the user and their agent is significantly reduced, and the management of digital record assets is simplified.
[0249] This invention provides an embodiment that comprehensively manages digital record assets used by users on a daily basis and enables rapid processing as needed. This system reduces the burden on users and their families and enables safe and efficient asset management in the digital age.
[0250] The following describes the processing flow.
[0251] Step 1:
[0252] Users log in to the system using their terminal. Users enter information about the digital record assets they wish to manage and set conditions for cancellation / deletion, as well as information about their agent.
[0253] Step 2:
[0254] The server stores configuration information received from the user in a database. This stored information includes the account information to be monitored, the configured termination conditions, and the agent information.
[0255] Step 3:
[0256] The server periodically checks access logs for monitored digital record assets using API access and web scraping techniques. If no activity is detected within the configured period, it proceeds to the next step.
[0257] Step 4:
[0258] If the server does not detect activity, it will send a notification to the user using the configured communication method (e.g., email or SMS). The notification will include a request for prompt action.
[0259] Step 5:
[0260] The server waits for a response from the user for a certain period of time. If a response is received, monitoring will continue or stop according to the user's preference.
[0261] Step 6:
[0262] If there is no response, the server will send an approval request notification to the agent. This notification will also include a request for a prompt response.
[0263] Step 7:
[0264] After receiving approval from the agent, the server uses generative artificial intelligence to execute procedures for canceling or erasing data from each digital record asset.
[0265] Step 8:
[0266] The server compiles the results of each procedure and sends a report to the user and their representative. The report includes an overview of the accounts that have been terminated and the data that has been deleted.
[0267] (Example 1)
[0268] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0269] In today's information-driven society, there is a problem with digital information assets used by individuals during their lifetime, which remain unmanaged even after they cease to use them or after their death. This lack of management of digital information poses a risk of personal information leakage and misuse. Furthermore, it is likely to be a burden for surviving family members and other related parties, as it is unclear how these assets should be handled. Therefore, there is a need for a system that can properly manage digital information assets and automatically and securely organize them when they cease to be used or after death.
[0270] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0271] In this invention, the server includes means for accepting pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the access status to the user's identification information for a predetermined period using API access and web information acquisition technology; and means for notifying the user and their agent if no access is detected, and automatically canceling the account and deleting the information upon approval from the agent. This enables appropriate handling of the suspension of use of digital information assets, enhances the security of personal information, and reduces the burden on stakeholders.
[0272] A "user" is an individual or organization that uses this system to manage and configure their own digital information assets.
[0273] "Digital information assets" refer to electronically stored data and information owned or managed by the user, including account information, emails, and digital content.
[0274] "Identification information" refers to account information and login information used to access digital information assets.
[0275] "API access" refers to the way a system interacts with other software services through an application programming interface.
[0276] "Web information acquisition technology" refers to techniques for extracting data from websites, including web scraping.
[0277] An "agent" refers to an individual or entity authorized to receive notifications sent from the system on behalf of the user and to perform necessary approvals.
[0278] A "generative information processing device" refers to an artificial intelligence or computer system that is capable of automatically processing information and performing specific tasks.
[0279] The "means of notification" refers to a method that provides a function for transmitting information from the system to users and agents.
[0280] This invention is a system for enabling users to appropriately manage digital information assets and prevent them from being left unattended without instructions. This system manages digital information assets based on user instructions through the cooperation of a server and a terminal.
[0281] Users access the system via a terminal and register information regarding their digital information assets. The registered information includes account information, email addresses, cancellation criteria dates (number of days elapsed since the last use), and contact information for agents. Users also set policies on how to manage and delete information.
[0282] Based on the user's registered information, the server continuously monitors the usage status of the specified identification information. API access and web information acquisition technologies are used for monitoring, and these technologies are used to analyze the usage history of the account. If access cannot be confirmed, the server sends a notification to the user and also sends a notification to request approval from the agent.
[0283] When approval is obtained from the agent, the server automatically performs cancellation and information deletion using a generative information processing device. By having AI tour websites, automatically fill in necessary forms, and select options, operations that do not require user intervention are realized. Through this process, the user's digital information assets are managed quickly and accurately according to defined conditions.
[0284] Specific Example
[0285] For example, assume that a user registers for a music streaming service in this system and sets it to automatically cancel the subscription 60 days after the last login. When the server confirms 60 days of inactivity, it sends a notification to the user and, if no response is received, requests confirmation from the agent. After that, with permission, the subscription is automatically cancelled. As a result, the effort for both the user and the agent is significantly reduced.
[0286] Example of prompt text
[0287] "Please teach me how to automatically cancel the account of the music streaming service using the generative AI model."
[0288] The flow of the specific process in Example 1 will be described using FIG. 11.
[0289] Step 1:
[0290] The user accesses the system via the terminal and enters information regarding the digital information asset. Specifically, fill in a form including SNS account information, email address, cancellation reference date, and contact information of the agent, and save the settings. This information is sent to the system's database and saved as registration information.
[0291] Step 2:
[0292] The server receives the information input by the user and checks the usage status based on the identification information saved in the database. The server tracks the last usage date of each account using API access and web information acquisition technologies, and performs data analysis based on the specified reference date.
[0293] Step 3:
[0294] If the account has not been used for the specified period, the server sends a notification to the user. The notification is automatically generated using the pre-registered email address and provides a prompt for the user to confirm the intention to continue.
[0295] Step 4:
[0296] If the server does not receive a response from the user within a certain period, it will send a notification requesting approval to the agent. The message sent to the agent will be sent using a pre-registered communication method and will request approval for the cancellation of the user's identity information and the deletion of the information.
[0297] Step 5:
[0298] Upon receiving approval from the agent, the server uses a generated AI model to initiate the automated cancellation and data deletion process. The AI crawls the website, performing procedures such as form completion and option selection autonomously, and securely processing the specified identification information.
[0299] Step 6:
[0300] Finally, the server reports the results of the cancellation and deletion procedures it has performed. The server notifies the user and their representative of the execution status via email or other means of communication, and confirms the completion of the process.
[0301] (Application Example 1)
[0302] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0303] In modern society, the amount of personal digital information assets is increasing, making it difficult to manage them properly. Furthermore, there is a risk that these information assets may be neglected if users encounter unexpected situations. Moreover, the burden of managing digital information can extend not only to the user but also to their family, thus creating a need for efficient and comprehensive management systems.
[0304] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0305] In this invention, the server includes means for receiving preset settings from users and collecting information necessary for the management of digital information assets, means for monitoring the usage status of users' identification information for a predetermined period, means for notifying users and agents when access is not confirmed, means for automatically executing the release of identification information and information deletion upon receiving approval from the agent, means for reporting the execution results, and means for supervising digital information assets by in-home devices and enabling interaction with users. Thereby, the burden on users and their families can be reduced, and it becomes possible to efficiently and quickly manage digital information assets.
[0306] A "user" refers to an individual who uses the system to manage digital information assets.
[0307] "Preset settings" refer to the act of a user registering various conditions and information related to their own digital asset management in the system in advance.
[0308] "Digital information assets" refer to the general term for electronic data and online accounts owned or managed by users.
[0309] "Identification information" refers to information for identifying a user's account and digital assets, including usernames, passwords, email addresses, etc.
[0310] "Access status" refers to information indicating the login and usage history of a user's account.
[0311] "Notification" refers to information sent by the system to inform users or agents of the situation.
[0312] An "agent" refers to an individual who has the authority to receive system notifications on behalf of the user and give necessary approvals.
[0313] "Release" refers to the act of invalidating or deleting a user's account and information assets based on specific conditions.
[0314] "Data erasure" refers to the process of ultimately deleting digital information assets.
[0315] "Home devices" refer to electrical and information equipment used in the home, and support the management of digital information assets.
[0316] "Generative artificial intelligence" is an AI technology that automates specific tasks through the generation and analysis of data.
[0317] This invention provides a system for efficiently and conveniently managing digital information assets owned by users. This system is realized by linking a server with user terminals.
[0318] Server Processing
[0319] The server first accepts pre-configurations from the user and stores the information necessary for managing digital information assets in a database according to those configurations. This includes identification information and management policies. Based on the user's identification information, the server continuously monitors access status. Monitoring is performed using API access and web scraping techniques. If no access is detected within a specified period, the server automatically sends a notification to the user and their agent. After sending the notification and obtaining approval from the agent, the server uses generative artificial intelligence to automate the process of deactivating the identification information and deleting the data.
[0320] Terminal processing
[0321] Users' devices (e.g., smartphones and home devices) are used for settings, receiving notifications, and changing management policies. Home devices can communicate with users to inform them of the management status of digital information assets and allow them to make new settings.
[0322] Hardware and software used
[0323] Hardware: Home devices (e.g., smart home devices, home robots)
[0324] Software: Generative artificial intelligence written in Python, libraries for API access (e.g., Requests, BeautifulSoup)
[0325] Specific example
[0326] Consider a scenario where a user uses a smart device in their home to check the latest management status of their digital information assets. When the user speaks to the device, the device accesses a server, retrieves the necessary information, and conveys it to the user. At this time, the server can use generative AI to extract the necessary information and prepare notifications based on conditions set by the user.
[0327] Example of a prompt
[0328] "I want to automate digital management tasks during my next trip, so please set up cancellation conditions for the new streaming service."
[0329] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0330] Step 1:
[0331] Users use their own devices to perform the necessary pre-configurations for managing digital information assets. These configurations include identification information, management policies, and access frequency conditions. The input data is provided by the user, received by the server, and stored in a database. The output is the configuration information stored in the database.
[0332] Step 2:
[0333] The server periodically monitors access to the identification information based on the configured information, using API access and web scraping techniques. The input consists of the configuration information and the current access log. By comparing these two, the server detects an anomaly if no access is detected within the configured period. The output is a flag indicating whether an anomaly occurred.
[0334] Step 3:
[0335] If access is not confirmed, the server automatically sends a notification to the user's terminal and registered agent. This notification reports the situation and requests a signature if necessary. The input is the anomaly detection result from step 2, and the output is the notification message.
[0336] Step 4:
[0337] If the agent approves via a designated communication method (e.g., email or messaging app), the server uses a generated AI model to automatically execute procedures to decrypt and erase the identification information. The input is the agent's approval, and the output is the completion of the identification information decryption procedure on each platform.
[0338] Step 5:
[0339] After all procedures are complete, the server reports the results to the user's terminal. The report includes information such as whether the deactivation was successful and whether the information has been erased. The input is the processing result, and the output is the report message sent to the user.
[0340] Step 6:
[0341] Users can use their home devices to check the latest management status and add new settings or prompts. Input is voice commands and setting changes from the user, and output is voice or screen feedback from the device.
[0342] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0343] This invention provides more flexible and effective notifications and support by combining a system for efficiently organizing digital record assets with an emotion engine that recognizes user emotions. The system manages the user's digital record assets based on pre-configured settings and uses the emotion engine to respond according to the user's psychological state.
[0344] When users access the system using their devices and register information about their digital record assets, they configure their settings to allow sentiment analysis. Based on these settings, the server analyzes the user's emotional state via the sentiment engine using the user's access history and response data during notifications.
[0345] The server receives the user's emotional state as an analysis result and flexibly adjusts the content and timing of notifications. For example, if the server detects that the user is stressed, it can reduce the frequency of notifications or change the tone of the notifications to a gentler one. It can also provide additional specific support information to ensure the user can use the system comfortably.
[0346] As a concrete example, suppose the system is configured to initiate the cancellation process if a user has not accessed the system for 90 days since their last login. When sending a notification, if the emotion engine detects that the user is stressed or anxious, the notification will be sent using softer language than usual and will include additional support information and guidance. This will provide an environment in which the user can respond without stress.
[0347] Furthermore, the server provides appropriate notifications to the agent using an emotion engine. To reduce the agent's psychological burden, it assists them by providing concise explanations of the necessary procedures and sharing past success stories. In this way, a less burdensome procedure is achieved for both the user and the agent.
[0348] This invention enables intelligent digital record asset management that takes into account the user's emotional state, reducing psychological burden while ensuring safe and efficient management.
[0349] The following describes the processing flow.
[0350] Step 1:
[0351] Users log in to the system using their devices and register the digital record assets they wish to manage. At this stage, they also agree to perform sentiment analysis and complete the configuration of the sentiment engine.
[0352] Step 2:
[0353] The server stores a list of digital record assets to be managed in a database, based on the user's configuration information received from the terminal. Simultaneously, the emotion engine performs an initial analysis based on the user's basic information.
[0354] Step 3:
[0355] The server continuously monitors access to the user's account for a set period. It collects user connection data and interaction logs and forwards them to the sentiment engine.
[0356] Step 4:
[0357] The emotion engine analyzes the user's emotional state based on collected data and provides the results to the server. This visualizes the user's mental state.
[0358] Step 5:
[0359] The server uses the emotion engine's analysis results to adjust the content and timing of notifications to the user. If the user is experiencing stress, the notification content is softened, and supportive information is added as needed.
[0360] Step 6:
[0361] When it becomes necessary to notify the agent, the server uses an emotion engine to create and send a notification that takes the agent's psychological state into consideration. This makes it possible to provide support while reducing the agent's psychological burden.
[0362] Step 7:
[0363] After obtaining approval from the user or their representative, generative artificial intelligence will automate the termination of digital record assets and the erasure of data. The specific procedures will be based on information collected in advance.
[0364] Step 8:
[0365] After the procedure is complete, the server aggregates the results and reports them to the user and their representative. The report includes details of the procedure performed and suggestions for follow-up, if necessary.
[0366] (Example 2)
[0367] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0368] When effectively managing digital record assets, challenges include reducing the psychological burden on users and ensuring that notifications and procedures are appropriate to their emotional state. Automating necessary procedures and reducing the psychological burden on agents are also important challenges.
[0369] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0370] In this invention, the server includes means for analyzing the user's emotional state and adjusting the content and timing of notifications based on the analysis results, means for providing additional support information corresponding to the analyzed emotional state, and means for automatically executing the procedures necessary for canceling each digital record asset using generative artificial intelligence. This enables flexible and efficient management of digital record assets while reducing the psychological burden on users and their agents.
[0371] "User" refers to an individual or organization that uses the system to manage digital record assets.
[0372] "Digital recording assets" refer to a collection of electronically recorded information and files.
[0373] "Means of collecting information" refers to the process by which a system acquires necessary data from users and stores it for management purposes.
[0374] "Means of monitoring access status" refers to a method by which a system continuously checks and records access to and usage history of a user's account.
[0375] "Means of notification" refers to a function in which the system sends messages to users or their representatives to inform them of important information.
[0376] "Methods for analyzing emotional states" refer to the process of analyzing a user's psychological state and extracting data related to their emotions.
[0377] "Means of providing additional support information" refers to features that provide additional guidance and help for problems that users face.
[0378] "Generative artificial intelligence" is a technology that automatically generates new information and documents using language generation models and other methods.
[0379] A "prompt statement" is a sentence that contains input instructions or hints used by generative artificial intelligence when generating information.
[0380] An "agent" is a third party who has the authority to perform procedures and take action on behalf of the user.
[0381] "Communication means" refers to technical methods or equipment used to transmit information.
[0382] This invention is a system for effectively managing users' digital record assets. The main element of the system is to reduce the user's psychological burden by analyzing the user's emotional state and adjusting the content and timing of notifications accordingly.
[0383] Users access the system using a terminal and register information about their digital record assets. The terminal has a browser and applications installed, allowing users to input information and configure settings. During registration, users enable sentiment analysis. This setting is necessary to analyze the user's emotional state.
[0384] The server collects user access history and response data, and analyzes this data using an emotion engine. The emotion engine identifies the user's emotional state using natural language processing (NLP) and machine learning algorithms. If the analysis determines that the user is stressed, the server can reduce the frequency of notifications and adjust the content to a gentler tone. The specific software technologies used include generative AI models.
[0385] As a concrete example, suppose the system is configured to initiate the account cancellation process if a user has not accessed the system for 90 days since their last login. In this case, when the server sends a notification, if the emotion engine detects the user's stress or anxiety, it will soften the notification's language and include additional support information and guidance. For example, it might say, "There is no need to rush into canceling your account. If you have any questions, please feel free to contact our support team at any time."
[0386] Furthermore, a generative AI model is used to generate prompt messages, which are then used in notifications. An example of a prompt message is: "The user has not used the system for a long period of time. When sending a notification, please consider the user's emotional state and convey the information in an appropriate and gentle tone. Also, please provide additional support information and suggest ways to reduce the user's psychological burden."
[0387] In this way, the system reduces the psychological burden on users and their representatives, and enables flexible and efficient management of digital record assets.
[0388] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0389] Step 1:
[0390] Users access the system using a terminal and input information related to their digital record assets. This information includes asset type, registration date, and usage status. This input forms the basis for subsequent data processing.
[0391] Step 2:
[0392] The server receives information about digital record assets entered by the user and stores it in a database. At this point, the server generates an access history based on the input data and records the user's usage. This data serves as important foundational data for notifications and sentiment analysis.
[0393] Step 3:
[0394] Users configure permission for sentiment analysis through their device. Once the configuration is complete, the server sends access history and usage data to the sentiment engine based on the user's permission. At this stage, the server receives input indicating whether sentiment analysis is permitted and usage data, preparing it for sentiment analysis.
[0395] Step 4:
[0396] The server analyzes the user's emotional state using an emotion engine. As input data, the server uses collected access history and user response data. The emotion engine utilizes a generative AI model and natural language processing algorithms to evaluate the user's emotions and outputs the results as analysis data.
[0397] Step 5:
[0398] The server adjusts the content and timing of notifications based on the results of sentiment analysis. Taking the analysis data as input, the server generates prompt messages tailored to the user's emotional state. At this stage, if stress is detected, the notification tone is changed to a gentler one, and the frequency is also adjusted.
[0399] Step 6:
[0400] The server provides users with additional support information as needed. Through the generation of prompts, the server customizes the information users encounter, adding reassuring information and guidance to reduce the user's burden. In this process, the final notification content is determined based on the generated prompts.
[0401] (Application Example 2)
[0402] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0403] With the recent digitalization, information assets such as personal and specialized information have increased. However, the psychological burden associated with managing and canceling these information assets has become a challenge. Furthermore, there is a lack of notifications and information provision that take into consideration the feelings of users, and an improvement in the user experience is needed. Systems that adequately address these issues are still scarce.
[0404] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0405] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing information assets; means for monitoring access to the user's identification information for a predetermined period; means for notifying the user and their representative if no access is detected; means for automatically canceling the identification information and deleting the data upon approval from the representative; means for reporting the results of the execution; and means for flexibly adjusting the notification content and the support information provided using an emotion recognition function. This makes it possible to provide effective and flexible notifications and support while taking into account the user's emotional state and reducing the psychological burden associated with managing information assets.
[0406] A "user" is an individual or organization that manages, accesses, and manipulates information assets.
[0407] "Pre-configuration" is the process by which users register the conditions and requirements necessary for managing information assets in the system in advance.
[0408] "Information assets" refer to data such as personal information and specialized information stored digitally, which are resources that can be managed and used.
[0409] "Identification information" refers to unique data used to recognize users and manage access.
[0410] "Access status" refers to monitoring how users interact with and manipulate information assets.
[0411] A "proxy" is a third party authorized to perform management tasks on behalf of the user.
[0412] "Emotion recognition function" is a technology that understands a user's psychological state by analyzing their facial expressions and voice.
[0413] "Notification content" refers to the message and alert information provided to users and their representatives.
[0414] "Cancellation and data erasure" is the process of terminating the use of information assets and completely deleting related data, based on the approval of the user or their representative.
[0415] "Execution results" refer to information indicating the outcome of cancellations or data deletions performed by the system, and are reported to the user and their representative.
[0416] A system for carrying out this invention includes, as its main components, a server, a terminal operated by a user, and software that performs emotion recognition.
[0417] The server provides an interface for accepting pre-configured settings from users, thereby receiving the necessary conditions for managing information assets. Based on user identification information, the server constantly monitors access status and notifies the user and their representative if no access is detected within a specified period. The communication methods used here are existing email and messaging applications.
[0418] The emotion recognition function processes data input through the user's device's camera and microphone to analyze their emotional state. This utilizes commercially available emotion recognition software (such as Microsoft's Azure Cognitive Services). Based on the emotion analysis results, the server adjusts the content of notifications and the tone of information delivery to reduce the user's psychological burden.
[0419] For example, in a resident app using the city's digital services, when providing information such as resource collection schedules, if the emotion engine detects that a resident is irritated, it can reduce regular notifications and provide more friendly messages. Such implementations allow users to use the system in a less stressful way.
[0420] When using generative AI models, prompts like the following are used: "If the user's emotion is identified as (emotional state), please explain, with specific examples, how to effectively adjust notifications and the information provided."
[0421] This invention integrates emotion recognition functionality with an information asset management system, enabling interactions that take into account the psychological state of individual users.
[0422] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0423] Step 1:
[0424] Users access the system using a terminal and perform pre-configuration for information asset management. Management conditions and identification information are registered as data input. The server receives this input and creates a new user account profile.
[0425] Step 2:
[0426] The server monitors access status based on identification information at regular intervals. The input here is login history data. The server analyzes this data and determines whether or not there has been access. If there has been no access, that fact is output.
[0427] Step 3:
[0428] When no access is detected, the server analyzes data collected from the device's camera and microphone via its emotion recognition function. The input is video and audio data, which is converted into emotional states by the emotion recognition software. The results of this analysis are obtained as output.
[0429] Step 4:
[0430] The server adjusts notification content and support information based on the analysis of the emotional state. Specifically, it uses a generative AI model to input prompt sentences and generates messages with gentle phrasing. This adjusted message is then sent as a notification.
[0431] Step 5:
[0432] The server sends notifications to the user and their representative using the configured communication method. These notifications include content tailored to the user's emotional state. The output of this notification process provides a tailored message and supporting information.
[0433] Step 6:
[0434] If the agent receives the notification and approves, the server will automatically terminate the identity information and delete the data. The input is the agent's approval data, and the deletion of the information asset and a completion report will be output.
[0435] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0436] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0437] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0438] [Third Embodiment]
[0439] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0440] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0441] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0442] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0443] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0444] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0445] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0446] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0447] The specific processing program 56 is an example of the "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by operating as the specific processing unit 290 according to the specific processing program 56 executed by the processor 28 on the RAM 30.
[0448] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the specific processing unit 290.
[0449] In the headset-type terminal 314, the processor 46 performs reception / output processing. The storage 50 stores a reception / output program 60. The processor 46 reads the reception / output program 60 from the storage 50 and executes the read reception / output program 60 on the RAM 48. The reception / output processing is realized by operating as the control unit 46A according to the reception / output program 60 executed by the processor 46 on the RAM 48.
[0450] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 is referred to as a "server", and the headset-type terminal 314 is referred to as a "terminal".
[0451] The digital legacy sorting system of the present invention is a system that enables a user to appropriately manage digital recording assets around them and prepare for unexpected situations. This system coordinates the server and the terminal to perform account monitoring, automatic contract termination, and data deletion based on the user's designation.
[0452] Users first access the system using their device and register information about their digital record assets as pre-configurations. These settings include account information and email addresses for the relevant social networking services (SNS), the number of days elapsed since the last use (which triggers cancellation), and contact information for their representative. Users also specify policies regarding how their data should be managed and deleted.
[0453] The server continuously monitors the usage of each account based on its configuration information. This is achieved using API access and web scraping techniques, and if the specified access period is exceeded, it automatically sends a notification to the user to alert them according to the pre-configured settings. The server waits for a response from the user to the notification, and if there is no response, it proceeds with requesting approval from a representative.
[0454] Upon approval from the agent, the server uses generative artificial intelligence to automatically perform the cancellation procedures and data erasure for each digital record asset. This AI crawls the website and performs operations that do not require user intervention, such as filling out necessary forms or selecting options. As a result, the user's digital record assets are organized according to specified criteria, and unnecessary data is quickly erased.
[0455] Specific example: Suppose a user registers their music streaming service with this system and sets it to automatically cancel 60 days after their last login. The server sends a notification to the user when there is no login activity for 60 days. If the user does not respond, it requests approval from their agent, and after approval, the subscription is automatically canceled. As a result, the effort required from both the user and their agent is significantly reduced, and the management of digital record assets is simplified.
[0456] This invention provides an embodiment that comprehensively manages digital record assets used by users on a daily basis and enables rapid processing as needed. This system reduces the burden on users and their families and enables safe and efficient asset management in the digital age.
[0457] The following describes the processing flow.
[0458] Step 1:
[0459] Users log in to the system using their terminal. Users enter information about the digital record assets they wish to manage and set conditions for cancellation / deletion, as well as information about their agent.
[0460] Step 2:
[0461] The server stores configuration information received from the user in a database. This stored information includes the account information to be monitored, the configured termination conditions, and the agent information.
[0462] Step 3:
[0463] The server periodically checks access logs for monitored digital record assets using API access and web scraping techniques. If no activity is detected within the configured period, it proceeds to the next step.
[0464] Step 4:
[0465] If the server does not detect activity, it will send a notification to the user using the configured communication method (e.g., email or SMS). The notification will include a request for prompt action.
[0466] Step 5:
[0467] The server waits for a response from the user for a certain period of time. If a response is received, monitoring will continue or stop according to the user's preference.
[0468] Step 6:
[0469] If there is no response, the server will send an approval request notification to the agent. This notification will also include a request for a prompt response.
[0470] Step 7:
[0471] After receiving approval from the agent, the server uses generative artificial intelligence to execute procedures for canceling or erasing data from each digital record asset.
[0472] Step 8:
[0473] The server compiles the results of each procedure and sends a report to the user and their representative. The report includes an overview of the accounts that have been terminated and the data that has been deleted.
[0474] (Example 1)
[0475] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0476] In today's information-driven society, there is a problem with digital information assets used by individuals during their lifetime, which remain unmanaged even after they cease to use them or after their death. This lack of management of digital information poses a risk of personal information leakage and misuse. Furthermore, it is likely to be a burden for surviving family members and other related parties, as it is unclear how these assets should be handled. Therefore, there is a need for a system that can properly manage digital information assets and automatically and securely organize them when they cease to be used or after death.
[0477] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0478] In this invention, the server includes means for accepting pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the access status to the user's identification information for a predetermined period using API access and web information acquisition technology; and means for notifying the user and their agent if no access is detected, and automatically canceling the account and deleting the information upon approval from the agent. This enables appropriate handling of the suspension of use of digital information assets, enhances the security of personal information, and reduces the burden on stakeholders.
[0479] A "user" is an individual or organization that uses this system to manage and configure their own digital information assets.
[0480] "Digital information assets" refer to electronically stored data and information owned or managed by the user, including account information, emails, and digital content.
[0481] "Identification information" refers to account information and login information used to access digital information assets.
[0482] "API access" refers to the way a system interacts with other software services through an application programming interface.
[0483] "Web information acquisition technology" refers to techniques for extracting data from websites, including web scraping.
[0484] An "agent" refers to an individual or entity authorized to receive notifications sent from the system on behalf of the user and to perform necessary approvals.
[0485] A "generative information processing device" refers to an artificial intelligence or computer system that is capable of automatically processing information and performing specific tasks.
[0486] "Means of providing notification" refers to methods that provide a function for transmitting information from the system to users and their agents.
[0487] This invention is a system that enables users to properly manage their digital information assets and prevent them from being left unattended without proper designation. In this system, a server and a terminal work together to manage digital information assets based on user instructions.
[0488] Users access the system via their devices and register information about their digital information assets. This registration information includes account information, email address, cancellation date (number of days since last use), and contact information for their agent. Users also set policies regarding how their information will be managed and deleted.
[0489] The server continuously monitors the usage of specified identification information based on the user's registration information. Monitoring utilizes API access and web information retrieval technologies, which are used to analyze the account's usage history. If access cannot be confirmed, the server sends a notification to the user and also notifies their representative to request authorization.
[0490] Upon approval from the agent, the server automatically performs cancellation and data deletion using a generative information processing device. AI crawls the website, automatically fills in necessary forms, and selects options, enabling operations that do not require user intervention. Through this process, users' digital information assets are managed quickly and accurately according to defined conditions.
[0491] Specific example
[0492] For example, suppose a user registers for a music streaming service with this system and sets it to automatically cancel 60 days after their last login. When the server detects that the service has not been used for 60 days, it sends a notification to the user, and if no response is received, it requests confirmation from their agent. After obtaining permission, the subscription is automatically canceled. As a result, the effort required for both the user and their agent is significantly reduced.
[0493] Example of a prompt
[0494] "How can I use a generative AI model to automatically cancel my music streaming service account?"
[0495] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0496] Step 1:
[0497] Users access the system via their devices and enter information about their digital information assets. Specifically, they fill out a form that includes information about their social media accounts, email address, cancellation date, and contact information for their agent, and then save their settings. This information is sent to the system's database and stored as registration information.
[0498] Step 2:
[0499] The server receives information entered by the user and checks usage status based on the identification information stored in the database. The server tracks the last usage date of each account using API access and web information retrieval technologies and performs data analysis based on a specified reference date.
[0500] Step 3:
[0501] The server sends a notification to the user if the account has not been used for a specified period. The notification is automatically generated using the previously registered email address and prompts the user to confirm their intention to continue.
[0502] Step 4:
[0503] If the server does not receive a response from the user within a certain period, it will send a notification requesting approval to the agent. The message sent to the agent will be sent using a pre-registered communication method and will request approval for the cancellation of the user's identity information and the deletion of the information.
[0504] Step 5:
[0505] Upon receiving approval from the agent, the server uses a generated AI model to initiate the automated cancellation and data deletion process. The AI crawls the website, performing procedures such as form completion and option selection autonomously, and securely processing the specified identification information.
[0506] Step 6:
[0507] Finally, the server reports the results of the cancellation and deletion procedures it has performed. The server notifies the user and their representative of the execution status via email or other means of communication, and confirms the completion of the process.
[0508] (Application Example 1)
[0509] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0510] In modern society, the amount of personal digital information assets is increasing, making it difficult to manage them properly. Furthermore, there is a risk that these information assets may be neglected if users encounter unexpected situations. Moreover, the burden of managing digital information can extend not only to the user but also to their family, thus creating a need for efficient and comprehensive management systems.
[0511] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0512] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the usage status of the user's identification information for a predetermined period; means for notifying the user and their agent if access is not confirmed; means for automatically deactivating the identification information and erasing the information upon approval from the agent; means for reporting the results of the execution; and means for supervising the digital information assets via a home device and enabling interaction with the user. This reduces the burden on the user and their family and enables efficient and rapid management of digital information assets.
[0513] "User" refers to an individual who uses the system to manage digital information assets.
[0514] "Pre-configuration" refers to the act of users registering various conditions and information related to their digital asset management in the system in advance.
[0515] "Digital information assets" is a general term for electronic data and online accounts owned or managed by users.
[0516] "Identification information" refers to information used to identify a user's account or digital assets, and includes usernames, passwords, email addresses, etc.
[0517] "Access status" refers to information that shows the login and usage history of a user's account.
[0518] A "notification" is information that the system sends to a user or their representative to inform them of a situation.
[0519] An "agent" is an individual who has the authority to receive system notifications and perform necessary approvals on behalf of the user.
[0520] "Deactivation" refers to the act of disabling or deleting a user's account or information assets based on specific conditions.
[0521] "Data erasure" refers to the process of ultimately deleting digital information assets.
[0522] "Home devices" refer to electrical and information equipment used in the home, and support the management of digital information assets.
[0523] "Generative artificial intelligence" is an AI technology that automates specific tasks through the generation and analysis of data.
[0524] This invention provides a system for efficiently and conveniently managing digital information assets owned by users. This system is realized by linking a server with user terminals.
[0525] Server Processing
[0526] The server first accepts pre-configurations from the user and stores the information necessary for managing digital information assets in a database according to those configurations. This includes identification information and management policies. Based on the user's identification information, the server continuously monitors access status. Monitoring is performed using API access and web scraping techniques. If no access is detected within a specified period, the server automatically sends a notification to the user and their agent. After sending the notification and obtaining approval from the agent, the server uses generative artificial intelligence to automate the process of deactivating the identification information and deleting the data.
[0527] Terminal processing
[0528] Users' devices (e.g., smartphones and home devices) are used for settings, receiving notifications, and changing management policies. Home devices can communicate with users to inform them of the management status of digital information assets and allow them to make new settings.
[0529] Hardware and software used
[0530] Hardware: Home devices (e.g., smart home devices, home robots)
[0531] Software: Generative artificial intelligence written in Python, libraries for API access (e.g., Requests, BeautifulSoup)
[0532] Specific example
[0533] Consider a scenario where a user uses a smart device in their home to check the latest management status of their digital information assets. When the user speaks to the device, the device accesses a server, retrieves the necessary information, and conveys it to the user. At this time, the server can use generative AI to extract the necessary information and prepare notifications based on conditions set by the user.
[0534] Example of a prompt
[0535] "I want to automate digital management tasks during my next trip, so please set up cancellation conditions for the new streaming service."
[0536] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0537] Step 1:
[0538] Users use their own devices to perform the necessary pre-configurations for managing digital information assets. These configurations include identification information, management policies, and access frequency conditions. The input data is provided by the user, received by the server, and stored in a database. The output is the configuration information stored in the database.
[0539] Step 2:
[0540] The server periodically monitors access to the identification information based on the configured information, using API access and web scraping techniques. The input consists of the configuration information and the current access log. By comparing these two, the server detects an anomaly if no access is detected within the configured period. The output is a flag indicating whether an anomaly occurred.
[0541] Step 3:
[0542] If access is not confirmed, the server automatically sends a notification to the user's terminal and registered agent. This notification reports the situation and requests a signature if necessary. The input is the anomaly detection result from step 2, and the output is the notification message.
[0543] Step 4:
[0544] If the agent approves via a designated communication method (e.g., email or messaging app), the server uses a generated AI model to automatically execute procedures to decrypt and erase the identification information. The input is the agent's approval, and the output is the completion of the identification information decryption procedure on each platform.
[0545] Step 5:
[0546] After all procedures are complete, the server reports the results to the user's terminal. The report includes information such as whether the deactivation was successful and whether the information has been erased. The input is the processing result, and the output is the report message sent to the user.
[0547] Step 6:
[0548] Users can use their home devices to check the latest management status and add new settings or prompts. Input is voice commands and setting changes from the user, and output is voice or screen feedback from the device.
[0549] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0550] This invention provides more flexible and effective notifications and support by combining a system for efficiently organizing digital record assets with an emotion engine that recognizes user emotions. The system manages the user's digital record assets based on pre-configured settings and uses the emotion engine to respond according to the user's psychological state.
[0551] When users access the system using their devices and register information about their digital record assets, they configure their settings to allow sentiment analysis. Based on these settings, the server analyzes the user's emotional state via the sentiment engine using the user's access history and response data during notifications.
[0552] The server receives the user's emotional state as an analysis result and flexibly adjusts the content and timing of notifications. For example, if the server detects that the user is stressed, it can reduce the frequency of notifications or change the tone of the notifications to a gentler one. It can also provide additional specific support information to ensure the user can use the system comfortably.
[0553] As a concrete example, suppose the system is configured to initiate the cancellation process if a user has not accessed the system for 90 days since their last login. When sending a notification, if the emotion engine detects that the user is stressed or anxious, the notification will be sent using softer language than usual and will include additional support information and guidance. This will provide an environment in which the user can respond without stress.
[0554] Furthermore, the server provides appropriate notifications to the agent using an emotion engine. To reduce the agent's psychological burden, it assists them by providing concise explanations of the necessary procedures and sharing past success stories. In this way, a less burdensome procedure is achieved for both the user and the agent.
[0555] This invention enables intelligent digital record asset management that takes into account the user's emotional state, reducing psychological burden while ensuring safe and efficient management.
[0556] The following describes the processing flow.
[0557] Step 1:
[0558] Users log in to the system using their devices and register the digital record assets they wish to manage. At this stage, they also agree to perform sentiment analysis and complete the configuration of the sentiment engine.
[0559] Step 2:
[0560] The server stores a list of digital record assets to be managed in a database, based on the user's configuration information received from the terminal. Simultaneously, the emotion engine performs an initial analysis based on the user's basic information.
[0561] Step 3:
[0562] The server continuously monitors access to the user's account for a set period. It collects user connection data and interaction logs and forwards them to the sentiment engine.
[0563] Step 4:
[0564] The emotion engine analyzes the user's emotional state based on collected data and provides the results to the server. This visualizes the user's mental state.
[0565] Step 5:
[0566] The server uses the emotion engine's analysis results to adjust the content and timing of notifications to the user. If the user is experiencing stress, the notification content is softened, and supportive information is added as needed.
[0567] Step 6:
[0568] When it becomes necessary to notify the agent, the server uses an emotion engine to create and send a notification that takes the agent's psychological state into consideration. This makes it possible to provide support while reducing the agent's psychological burden.
[0569] Step 7:
[0570] After obtaining approval from the user or their representative, generative artificial intelligence will automate the termination of digital record assets and the erasure of data. The specific procedures will be based on information collected in advance.
[0571] Step 8:
[0572] After the procedure is complete, the server aggregates the results and reports them to the user and their representative. The report includes details of the procedure performed and suggestions for follow-up, if necessary.
[0573] (Example 2)
[0574] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0575] When effectively managing digital record assets, challenges include reducing the psychological burden on users and ensuring that notifications and procedures are appropriate to their emotional state. Automating necessary procedures and reducing the psychological burden on agents are also important challenges.
[0576] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0577] In this invention, the server includes means for analyzing the user's emotional state and adjusting the content and timing of notifications based on the analysis results, means for providing additional support information corresponding to the analyzed emotional state, and means for automatically executing the procedures necessary for canceling each digital record asset using generative artificial intelligence. This enables flexible and efficient management of digital record assets while reducing the psychological burden on users and their agents.
[0578] "User" refers to an individual or organization that uses the system to manage digital record assets.
[0579] "Digital recording assets" refer to a collection of electronically recorded information and files.
[0580] "Means of collecting information" refers to the process by which a system acquires necessary data from users and stores it for management purposes.
[0581] "Means of monitoring access status" refers to a method by which a system continuously checks and records access to and usage history of a user's account.
[0582] "Means of notification" refers to a function in which the system sends messages to users or their representatives to inform them of important information.
[0583] "Methods for analyzing emotional states" refer to the process of analyzing a user's psychological state and extracting data related to their emotions.
[0584] "Means of providing additional support information" refers to features that provide additional guidance and help for problems that users face.
[0585] "Generative artificial intelligence" is a technology that automatically generates new information and documents using language generation models and other methods.
[0586] A "prompt statement" is a sentence that contains input instructions or hints used by generative artificial intelligence when generating information.
[0587] An "agent" is a third party who has the authority to perform procedures and take action on behalf of the user.
[0588] "Communication means" refers to technical methods or equipment used to transmit information.
[0589] This invention is a system for effectively managing users' digital record assets. The main element of the system is to reduce the user's psychological burden by analyzing the user's emotional state and adjusting the content and timing of notifications accordingly.
[0590] Users access the system using a terminal and register information about their digital record assets. The terminal has a browser and applications installed, allowing users to input information and configure settings. During registration, users enable sentiment analysis. This setting is necessary to analyze the user's emotional state.
[0591] The server collects user access history and response data, and analyzes this data using an emotion engine. The emotion engine identifies the user's emotional state using natural language processing (NLP) and machine learning algorithms. If the analysis determines that the user is stressed, the server can reduce the frequency of notifications and adjust the content to a gentler tone. The specific software technologies used include generative AI models.
[0592] As a concrete example, suppose the system is configured to initiate the account cancellation process if a user has not accessed the system for 90 days since their last login. In this case, when the server sends a notification, if the emotion engine detects the user's stress or anxiety, it will soften the notification's language and include additional support information and guidance. For example, it might say, "There is no need to rush into canceling your account. If you have any questions, please feel free to contact our support team at any time."
[0593] Furthermore, a generative AI model is used to generate prompt messages, which are then used in notifications. An example of a prompt message is: "The user has not used the system for a long period of time. When sending a notification, please consider the user's emotional state and convey the information in an appropriate and gentle tone. Also, please provide additional support information and suggest ways to reduce the user's psychological burden."
[0594] In this way, the system reduces the psychological burden on users and their representatives, and enables flexible and efficient management of digital record assets.
[0595] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0596] Step 1:
[0597] Users access the system using a terminal and input information related to their digital record assets. This information includes asset type, registration date, and usage status. This input forms the basis for subsequent data processing.
[0598] Step 2:
[0599] The server receives information about digital record assets entered by the user and stores it in a database. At this point, the server generates an access history based on the input data and records the user's usage. This data serves as important foundational data for notifications and sentiment analysis.
[0600] Step 3:
[0601] Users configure permission for sentiment analysis through their device. Once the configuration is complete, the server sends access history and usage data to the sentiment engine based on the user's permission. At this stage, the server receives input indicating whether sentiment analysis is permitted and usage data, preparing it for sentiment analysis.
[0602] Step 4:
[0603] The server analyzes the user's emotional state using an emotion engine. As input data, the server uses collected access history and user response data. The emotion engine utilizes a generative AI model and natural language processing algorithms to evaluate the user's emotions and outputs the results as analysis data.
[0604] Step 5:
[0605] The server adjusts the content and timing of notifications based on the results of sentiment analysis. Taking the analysis data as input, the server generates prompt messages tailored to the user's emotional state. At this stage, if stress is detected, the notification tone is changed to a gentler one, and the frequency is also adjusted.
[0606] Step 6:
[0607] The server provides users with additional support information as needed. Through the generation of prompts, the server customizes the information users encounter, adding reassuring information and guidance to reduce the user's burden. In this process, the final notification content is determined based on the generated prompts.
[0608] (Application Example 2)
[0609] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0610] With the recent digitalization, information assets such as personal and specialized information have increased. However, the psychological burden associated with managing and canceling these information assets has become a challenge. Furthermore, there is a lack of notifications and information provision that take into consideration the feelings of users, and an improvement in the user experience is needed. Systems that adequately address these issues are still scarce.
[0611] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0612] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing information assets; means for monitoring access to the user's identification information for a predetermined period; means for notifying the user and their representative if no access is detected; means for automatically canceling the identification information and deleting the data upon approval from the representative; means for reporting the results of the execution; and means for flexibly adjusting the notification content and the support information provided using an emotion recognition function. This makes it possible to provide effective and flexible notifications and support while taking into account the user's emotional state and reducing the psychological burden associated with managing information assets.
[0613] A "user" is an individual or organization that manages, accesses, and manipulates information assets.
[0614] "Pre-configuration" is the process by which users register the conditions and requirements necessary for managing information assets in the system in advance.
[0615] "Information assets" refer to data such as personal information and specialized information stored digitally, which are resources that can be managed and used.
[0616] "Identification information" refers to unique data used to recognize users and manage access.
[0617] "Access status" refers to monitoring how users interact with and manipulate information assets.
[0618] A "proxy" is a third party authorized to perform management tasks on behalf of the user.
[0619] "Emotion recognition function" is a technology that understands a user's psychological state by analyzing their facial expressions and voice.
[0620] "Notification content" refers to the message and alert information provided to users and their representatives.
[0621] "Cancellation and data erasure" is the process of terminating the use of information assets and completely deleting related data, based on the approval of the user or their representative.
[0622] "Execution results" refer to information indicating the outcome of cancellations or data deletions performed by the system, and are reported to the user and their representative.
[0623] A system for carrying out this invention includes, as its main components, a server, a terminal operated by a user, and software that performs emotion recognition.
[0624] The server provides an interface for accepting pre-configured settings from users, thereby receiving the necessary conditions for managing information assets. Based on user identification information, the server constantly monitors access status and notifies the user and their representative if no access is detected within a specified period. The communication methods used here are existing email and messaging applications.
[0625] The emotion recognition function processes data input through the user's device's camera and microphone to analyze their emotional state. This utilizes commercially available emotion recognition software (such as Microsoft's Azure Cognitive Services). Based on the emotion analysis results, the server adjusts the content of notifications and the tone of information delivery to reduce the user's psychological burden.
[0626] For example, in a resident app using the city's digital services, when providing information such as resource collection schedules, if the emotion engine detects that a resident is irritated, it can reduce regular notifications and provide more friendly messages. Such implementations allow users to use the system in a less stressful way.
[0627] When using generative AI models, prompts like the following are used: "If the user's emotion is identified as (emotional state), please explain, with specific examples, how to effectively adjust notifications and the information provided."
[0628] This invention integrates emotion recognition functionality with an information asset management system, enabling interactions that take into account the psychological state of individual users.
[0629] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0630] Step 1:
[0631] Users access the system using a terminal and perform pre-configuration for information asset management. Management conditions and identification information are registered as data input. The server receives this input and creates a new user account profile.
[0632] Step 2:
[0633] The server monitors access status based on identification information at regular intervals. The input here is login history data. The server analyzes this data and determines whether or not there has been access. If there has been no access, that fact is output.
[0634] Step 3:
[0635] When no access is detected, the server analyzes data collected from the device's camera and microphone via its emotion recognition function. The input is video and audio data, which is converted into emotional states by the emotion recognition software. The results of this analysis are obtained as output.
[0636] Step 4:
[0637] The server adjusts notification content and support information based on the analysis of the emotional state. Specifically, it uses a generative AI model to input prompt sentences and generates messages with gentle phrasing. This adjusted message is then sent as a notification.
[0638] Step 5:
[0639] The server sends notifications to the user and their representative using the configured communication method. These notifications include content tailored to the user's emotional state. The output of this notification process provides a tailored message and supporting information.
[0640] Step 6:
[0641] If the agent receives the notification and approves, the server will automatically terminate the identity information and delete the data. The input is the agent's approval data, and the deletion of the information asset and a completion report will be output.
[0642] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0643] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0644] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0645] [Fourth Embodiment]
[0646] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0647] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0648] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0649] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0650] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0651] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0652] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0653] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0654] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, in the data processing device 12, specific processing is performed by the processor 28. The storage 32 stores a specific processing program 56.
[0655] The specific processing program 56 is an example of the "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by operating as a specific processing unit 290 according to the specific processing program 56 executed by the processor 28 on the RAM 30.
[0656] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the specific processing unit 290.
[0657] In the robot 414, input / output processing is performed by the processor 46. The storage 50 stores an input / output program 60. The processor 46 reads the input / output program 60 from the storage 50 and executes the read input / output program 60 on the RAM 48. The input / output processing is realized by operating as a control unit 46A according to the input / output program 60 executed by the processor 46 on the RAM 48.
[0658] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 is referred to as a "server", and the robot 414 is referred to as a "terminal".
[0659] The digital legacy management system of the present invention is a system that enables users to appropriately manage their digital recording assets around them and prepare for unexpected situations. This system coordinates the server and the terminal to monitor accounts, automatically cancel contracts, and delete data based on the user's designation.
[0660] Users first access the system using their device and register information about their digital record assets as pre-configurations. These settings include account information and email addresses for the relevant social networking services (SNS), the number of days elapsed since the last use (which triggers cancellation), and contact information for their representative. Users also specify policies regarding how their data should be managed and deleted.
[0661] The server continuously monitors the usage of each account based on its configuration information. This is achieved using API access and web scraping techniques, and if the specified access period is exceeded, it automatically sends a notification to the user to alert them according to the pre-configured settings. The server waits for a response from the user to the notification, and if there is no response, it proceeds with requesting approval from a representative.
[0662] Upon approval from the agent, the server uses generative artificial intelligence to automatically perform the cancellation procedures and data erasure for each digital record asset. This AI crawls the website and performs operations that do not require user intervention, such as filling out necessary forms or selecting options. As a result, the user's digital record assets are organized according to specified criteria, and unnecessary data is quickly erased.
[0663] Specific example: Suppose a user registers their music streaming service with this system and sets it to automatically cancel 60 days after their last login. The server sends a notification to the user when there is no login activity for 60 days. If the user does not respond, it requests approval from their agent, and after approval, the subscription is automatically canceled. As a result, the effort required from both the user and their agent is significantly reduced, and the management of digital record assets is simplified.
[0664] This invention provides an embodiment that comprehensively manages digital record assets used by users on a daily basis and enables rapid processing as needed. This system reduces the burden on users and their families and enables safe and efficient asset management in the digital age.
[0665] The following describes the processing flow.
[0666] Step 1:
[0667] Users log in to the system using their terminal. Users enter information about the digital record assets they wish to manage and set conditions for cancellation / deletion, as well as information about their agent.
[0668] Step 2:
[0669] The server stores configuration information received from the user in a database. This stored information includes the account information to be monitored, the configured termination conditions, and the agent information.
[0670] Step 3:
[0671] The server periodically checks access logs for monitored digital record assets using API access and web scraping techniques. If no activity is detected within the configured period, it proceeds to the next step.
[0672] Step 4:
[0673] If the server does not detect activity, it will send a notification to the user using the configured communication method (e.g., email or SMS). The notification will include a request for prompt action.
[0674] Step 5:
[0675] The server waits for a response from the user for a certain period of time. If a response is received, monitoring will continue or stop according to the user's preference.
[0676] Step 6:
[0677] If there is no response, the server will send an approval request notification to the agent. This notification will also include a request for a prompt response.
[0678] Step 7:
[0679] After receiving approval from the agent, the server uses generative artificial intelligence to execute procedures for canceling or erasing data from each digital record asset.
[0680] Step 8:
[0681] The server compiles the results of each procedure and sends a report to the user and their representative. The report includes an overview of the accounts that have been terminated and the data that has been deleted.
[0682] (Example 1)
[0683] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0684] In today's information-driven society, there is a problem with digital information assets used by individuals during their lifetime, which remain unmanaged even after they cease to use them or after their death. This lack of management of digital information poses a risk of personal information leakage and misuse. Furthermore, it is likely to be a burden for surviving family members and other related parties, as it is unclear how these assets should be handled. Therefore, there is a need for a system that can properly manage digital information assets and automatically and securely organize them when they cease to be used or after death.
[0685] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0686] In this invention, the server includes means for accepting pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the access status to the user's identification information for a predetermined period using API access and web information acquisition technology; and means for notifying the user and their agent if no access is detected, and automatically canceling the account and deleting the information upon approval from the agent. This enables appropriate handling of the suspension of use of digital information assets, enhances the security of personal information, and reduces the burden on stakeholders.
[0687] A "user" is an individual or organization that uses this system to manage and configure their own digital information assets.
[0688] "Digital information assets" refer to electronically stored data and information owned or managed by the user, including account information, emails, and digital content.
[0689] "Identification information" refers to account information and login information used to access digital information assets.
[0690] "API access" refers to the way a system interacts with other software services through an application programming interface.
[0691] "Web information acquisition technology" refers to techniques for extracting data from websites, including web scraping.
[0692] An "agent" refers to an individual or entity authorized to receive notifications sent from the system on behalf of the user and to perform necessary approvals.
[0693] A "generative information processing device" refers to an artificial intelligence or computer system that is capable of automatically processing information and performing specific tasks.
[0694] "Means of providing notification" refers to methods that provide a function for transmitting information from the system to users and their agents.
[0695] This invention is a system that enables users to properly manage their digital information assets and prevent them from being left unattended without proper designation. In this system, a server and a terminal work together to manage digital information assets based on user instructions.
[0696] Users access the system via their devices and register information about their digital information assets. This registration information includes account information, email address, cancellation date (number of days since last use), and contact information for their agent. Users also set policies regarding how their information will be managed and deleted.
[0697] The server continuously monitors the usage of specified identification information based on the user's registration information. Monitoring utilizes API access and web information retrieval technologies, which are used to analyze the account's usage history. If access cannot be confirmed, the server sends a notification to the user and also notifies their representative to request authorization.
[0698] Upon approval from the agent, the server automatically performs cancellation and data deletion using a generative information processing device. AI crawls the website, automatically fills in necessary forms, and selects options, enabling operations that do not require user intervention. Through this process, users' digital information assets are managed quickly and accurately according to defined conditions.
[0699] Specific example
[0700] For example, suppose a user registers for a music streaming service with this system and sets it to automatically cancel 60 days after their last login. When the server detects that the service has not been used for 60 days, it sends a notification to the user, and if no response is received, it requests confirmation from their agent. After obtaining permission, the subscription is automatically canceled. As a result, the effort required for both the user and their agent is significantly reduced.
[0701] Example of a prompt
[0702] "How can I use a generative AI model to automatically cancel my music streaming service account?"
[0703] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0704] Step 1:
[0705] Users access the system via their devices and enter information about their digital information assets. Specifically, they fill out a form that includes information about their social media accounts, email address, cancellation date, and contact information for their agent, and then save their settings. This information is sent to the system's database and stored as registration information.
[0706] Step 2:
[0707] The server receives information entered by the user and checks usage status based on the identification information stored in the database. The server tracks the last usage date of each account using API access and web information retrieval technologies and performs data analysis based on a specified reference date.
[0708] Step 3:
[0709] The server sends a notification to the user if the account has not been used for a specified period. The notification is automatically generated using the previously registered email address and prompts the user to confirm their intention to continue.
[0710] Step 4:
[0711] If the server does not receive a response from the user within a certain period, it will send a notification requesting approval to the agent. The message sent to the agent will be sent using a pre-registered communication method and will request approval for the cancellation of the user's identity information and the deletion of the information.
[0712] Step 5:
[0713] Upon receiving approval from the agent, the server uses a generated AI model to initiate the automated cancellation and data deletion process. The AI crawls the website, performing procedures such as form completion and option selection autonomously, and securely processing the specified identification information.
[0714] Step 6:
[0715] Finally, the server reports the results of the cancellation and deletion procedures it has performed. The server notifies the user and their representative of the execution status via email or other means of communication, and confirms the completion of the process.
[0716] (Application Example 1)
[0717] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0718] In modern society, the amount of personal digital information assets is increasing, making it difficult to manage them properly. Furthermore, there is a risk that these information assets may be neglected if users encounter unexpected situations. Moreover, the burden of managing digital information can extend not only to the user but also to their family, thus creating a need for efficient and comprehensive management systems.
[0719] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0720] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing digital information assets; means for monitoring the usage status of the user's identification information for a predetermined period; means for notifying the user and their agent if access is not confirmed; means for automatically deactivating the identification information and erasing the information upon approval from the agent; means for reporting the results of the execution; and means for supervising the digital information assets via a home device and enabling interaction with the user. This reduces the burden on the user and their family and enables efficient and rapid management of digital information assets.
[0721] "User" refers to an individual who uses the system to manage digital information assets.
[0722] "Pre-configuration" refers to the act of users registering various conditions and information related to their digital asset management in the system in advance.
[0723] "Digital information assets" is a general term for electronic data and online accounts owned or managed by users.
[0724] "Identification information" refers to information used to identify a user's account or digital assets, and includes usernames, passwords, email addresses, etc.
[0725] "Access status" refers to information that shows the login and usage history of a user's account.
[0726] A "notification" is information that the system sends to a user or their representative to inform them of a situation.
[0727] An "agent" is an individual who has the authority to receive system notifications and perform necessary approvals on behalf of the user.
[0728] "Deactivation" refers to the act of disabling or deleting a user's account or information assets based on specific conditions.
[0729] "Data erasure" refers to the process of ultimately deleting digital information assets.
[0730] "Home devices" refer to electrical and information equipment used in the home, and support the management of digital information assets.
[0731] "Generative artificial intelligence" is an AI technology that automates specific tasks through the generation and analysis of data.
[0732] This invention provides a system for efficiently and conveniently managing digital information assets owned by users. This system is realized by linking a server with user terminals.
[0733] Server Processing
[0734] The server first accepts pre-configurations from the user and stores the information necessary for managing digital information assets in a database according to those configurations. This includes identification information and management policies. Based on the user's identification information, the server continuously monitors access status. Monitoring is performed using API access and web scraping techniques. If no access is detected within a specified period, the server automatically sends a notification to the user and their agent. After sending the notification and obtaining approval from the agent, the server uses generative artificial intelligence to automate the process of deactivating the identification information and deleting the data.
[0735] Terminal processing
[0736] Users' devices (e.g., smartphones and home devices) are used for settings, receiving notifications, and changing management policies. Home devices can communicate with users to inform them of the management status of digital information assets and allow them to make new settings.
[0737] Hardware and software used
[0738] Hardware: Home devices (e.g., smart home devices, home robots)
[0739] Software: Generative artificial intelligence written in Python, libraries for API access (e.g., Requests, BeautifulSoup)
[0740] Specific example
[0741] Consider a scenario where a user uses a smart device in their home to check the latest management status of their digital information assets. When the user speaks to the device, the device accesses a server, retrieves the necessary information, and conveys it to the user. At this time, the server can use generative AI to extract the necessary information and prepare notifications based on conditions set by the user.
[0742] Example of a prompt
[0743] "I want to automate digital management tasks during my next trip, so please set up cancellation conditions for the new streaming service."
[0744] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0745] Step 1:
[0746] Users use their own devices to perform the necessary pre-configurations for managing digital information assets. These configurations include identification information, management policies, and access frequency conditions. The input data is provided by the user, received by the server, and stored in a database. The output is the configuration information stored in the database.
[0747] Step 2:
[0748] The server periodically monitors access to the identification information based on the configured information, using API access and web scraping techniques. The input consists of the configuration information and the current access log. By comparing these two, the server detects an anomaly if no access is detected within the configured period. The output is a flag indicating whether an anomaly occurred.
[0749] Step 3:
[0750] If access is not confirmed, the server automatically sends a notification to the user's terminal and registered agent. This notification reports the situation and requests a signature if necessary. The input is the anomaly detection result from step 2, and the output is the notification message.
[0751] Step 4:
[0752] If the agent approves via a designated communication method (e.g., email or messaging app), the server uses a generated AI model to automatically execute procedures to decrypt and erase the identification information. The input is the agent's approval, and the output is the completion of the identification information decryption procedure on each platform.
[0753] Step 5:
[0754] After all procedures are complete, the server reports the results to the user's terminal. The report includes information such as whether the deactivation was successful and whether the information has been erased. The input is the processing result, and the output is the report message sent to the user.
[0755] Step 6:
[0756] Users can use their home devices to check the latest management status and add new settings or prompts. Input is voice commands and setting changes from the user, and output is voice or screen feedback from the device.
[0757] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0758] This invention provides more flexible and effective notifications and support by combining a system for efficiently organizing digital record assets with an emotion engine that recognizes user emotions. The system manages the user's digital record assets based on pre-configured settings and uses the emotion engine to respond according to the user's psychological state.
[0759] When users access the system using their devices and register information about their digital record assets, they configure their settings to allow sentiment analysis. Based on these settings, the server analyzes the user's emotional state via the sentiment engine using the user's access history and response data during notifications.
[0760] The server receives the user's emotional state as an analysis result and flexibly adjusts the content and timing of notifications. For example, if the server detects that the user is stressed, it can reduce the frequency of notifications or change the tone of the notifications to a gentler one. It can also provide additional specific support information to ensure the user can use the system comfortably.
[0761] As a concrete example, suppose the system is configured to initiate the cancellation process if a user has not accessed the system for 90 days since their last login. When sending a notification, if the emotion engine detects that the user is stressed or anxious, the notification will be sent using softer language than usual and will include additional support information and guidance. This will provide an environment in which the user can respond without stress.
[0762] Furthermore, the server provides appropriate notifications to the agent using an emotion engine. To reduce the agent's psychological burden, it assists them by providing concise explanations of the necessary procedures and sharing past success stories. In this way, a less burdensome procedure is achieved for both the user and the agent.
[0763] This invention enables intelligent digital record asset management that takes into account the user's emotional state, reducing psychological burden while ensuring safe and efficient management.
[0764] The following describes the processing flow.
[0765] Step 1:
[0766] Users log in to the system using their devices and register the digital record assets they wish to manage. At this stage, they also agree to perform sentiment analysis and complete the configuration of the sentiment engine.
[0767] Step 2:
[0768] The server stores a list of digital record assets to be managed in a database, based on the user's configuration information received from the terminal. Simultaneously, the emotion engine performs an initial analysis based on the user's basic information.
[0769] Step 3:
[0770] The server continuously monitors access to the user's account for a set period. It collects user connection data and interaction logs and forwards them to the sentiment engine.
[0771] Step 4:
[0772] The emotion engine analyzes the user's emotional state based on collected data and provides the results to the server. This visualizes the user's mental state.
[0773] Step 5:
[0774] The server uses the emotion engine's analysis results to adjust the content and timing of notifications to the user. If the user is experiencing stress, the notification content is softened, and supportive information is added as needed.
[0775] Step 6:
[0776] When it becomes necessary to notify the agent, the server uses an emotion engine to create and send a notification that takes the agent's psychological state into consideration. This makes it possible to provide support while reducing the agent's psychological burden.
[0777] Step 7:
[0778] After obtaining approval from the user or their representative, generative artificial intelligence will automate the termination of digital record assets and the erasure of data. The specific procedures will be based on information collected in advance.
[0779] Step 8:
[0780] After the procedure is complete, the server aggregates the results and reports them to the user and their representative. The report includes details of the procedure performed and suggestions for follow-up, if necessary.
[0781] (Example 2)
[0782] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0783] When effectively managing digital record assets, challenges include reducing the psychological burden on users and ensuring that notifications and procedures are appropriate to their emotional state. Automating necessary procedures and reducing the psychological burden on agents are also important challenges.
[0784] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0785] In this invention, the server includes means for analyzing the user's emotional state and adjusting the content and timing of notifications based on the analysis results, means for providing additional support information corresponding to the analyzed emotional state, and means for automatically executing the procedures necessary for canceling each digital record asset using generative artificial intelligence. This enables flexible and efficient management of digital record assets while reducing the psychological burden on users and their agents.
[0786] "User" refers to an individual or organization that uses the system to manage digital record assets.
[0787] "Digital recording assets" refer to a collection of electronically recorded information and files.
[0788] "Means of collecting information" refers to the process by which a system acquires necessary data from users and stores it for management purposes.
[0789] "Means of monitoring access status" refers to a method by which a system continuously checks and records access to and usage history of a user's account.
[0790] "Means of notification" refers to a function in which the system sends messages to users or their representatives to inform them of important information.
[0791] "Methods for analyzing emotional states" refer to the process of analyzing a user's psychological state and extracting data related to their emotions.
[0792] "Means of providing additional support information" refers to features that provide additional guidance and help for problems that users face.
[0793] "Generative artificial intelligence" is a technology that automatically generates new information and documents using language generation models and other methods.
[0794] A "prompt statement" is a sentence that contains input instructions or hints used by generative artificial intelligence when generating information.
[0795] An "agent" is a third party who has the authority to perform procedures and take action on behalf of the user.
[0796] "Communication means" refers to technical methods or equipment used to transmit information.
[0797] This invention is a system for effectively managing users' digital record assets. The main element of the system is to reduce the user's psychological burden by analyzing the user's emotional state and adjusting the content and timing of notifications accordingly.
[0798] Users access the system using a terminal and register information about their digital record assets. The terminal has a browser and applications installed, allowing users to input information and configure settings. During registration, users enable sentiment analysis. This setting is necessary to analyze the user's emotional state.
[0799] The server collects user access history and response data, and analyzes this data using an emotion engine. The emotion engine identifies the user's emotional state using natural language processing (NLP) and machine learning algorithms. If the analysis determines that the user is stressed, the server can reduce the frequency of notifications and adjust the content to a gentler tone. The specific software technologies used include generative AI models.
[0800] As a concrete example, suppose the system is configured to initiate the account cancellation process if a user has not accessed the system for 90 days since their last login. In this case, when the server sends a notification, if the emotion engine detects the user's stress or anxiety, it will soften the notification's language and include additional support information and guidance. For example, it might say, "There is no need to rush into canceling your account. If you have any questions, please feel free to contact our support team at any time."
[0801] Furthermore, a generative AI model is used to generate prompt messages, which are then used in notifications. An example of a prompt message is: "The user has not used the system for a long period of time. When sending a notification, please consider the user's emotional state and convey the information in an appropriate and gentle tone. Also, please provide additional support information and suggest ways to reduce the user's psychological burden."
[0802] In this way, the system reduces the psychological burden on users and their representatives, and enables flexible and efficient management of digital record assets.
[0803] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0804] Step 1:
[0805] Users access the system using a terminal and input information related to their digital record assets. This information includes asset type, registration date, and usage status. This input forms the basis for subsequent data processing.
[0806] Step 2:
[0807] The server receives information about digital record assets entered by the user and stores it in a database. At this point, the server generates an access history based on the input data and records the user's usage. This data serves as important foundational data for notifications and sentiment analysis.
[0808] Step 3:
[0809] Users configure permission for sentiment analysis through their device. Once the configuration is complete, the server sends access history and usage data to the sentiment engine based on the user's permission. At this stage, the server receives input indicating whether sentiment analysis is permitted and usage data, preparing it for sentiment analysis.
[0810] Step 4:
[0811] The server analyzes the user's emotional state using an emotion engine. As input data, the server uses collected access history and user response data. The emotion engine utilizes a generative AI model and natural language processing algorithms to evaluate the user's emotions and outputs the results as analysis data.
[0812] Step 5:
[0813] The server adjusts the content and timing of notifications based on the results of sentiment analysis. Taking the analysis data as input, the server generates prompt messages tailored to the user's emotional state. At this stage, if stress is detected, the notification tone is changed to a gentler one, and the frequency is also adjusted.
[0814] Step 6:
[0815] The server provides users with additional support information as needed. Through the generation of prompts, the server customizes the information users encounter, adding reassuring information and guidance to reduce the user's burden. In this process, the final notification content is determined based on the generated prompts.
[0816] (Application Example 2)
[0817] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0818] With the recent digitalization, information assets such as personal and specialized information have increased. However, the psychological burden associated with managing and canceling these information assets has become a challenge. Furthermore, there is a lack of notifications and information provision that take into consideration the feelings of users, and an improvement in the user experience is needed. Systems that adequately address these issues are still scarce.
[0819] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0820] In this invention, the server includes means for receiving pre-configurations from users and collecting information necessary for managing information assets; means for monitoring access to the user's identification information for a predetermined period; means for notifying the user and their representative if no access is detected; means for automatically canceling the identification information and deleting the data upon approval from the representative; means for reporting the results of the execution; and means for flexibly adjusting the notification content and the support information provided using an emotion recognition function. This makes it possible to provide effective and flexible notifications and support while taking into account the user's emotional state and reducing the psychological burden associated with managing information assets.
[0821] A "user" is an individual or organization that manages, accesses, and manipulates information assets.
[0822] "Pre-configuration" is the process by which users register the conditions and requirements necessary for managing information assets in the system in advance.
[0823] "Information assets" refer to data such as personal information and specialized information stored digitally, which are resources that can be managed and used.
[0824] "Identification information" refers to unique data used to recognize users and manage access.
[0825] "Access status" refers to monitoring how users interact with and manipulate information assets.
[0826] A "proxy" is a third party authorized to perform management tasks on behalf of the user.
[0827] "Emotion recognition function" is a technology that understands a user's psychological state by analyzing their facial expressions and voice.
[0828] "Notification content" refers to the message and alert information provided to users and their representatives.
[0829] "Cancellation and data erasure" is the process of terminating the use of information assets and completely deleting related data, based on the approval of the user or their representative.
[0830] "Execution results" refer to information indicating the outcome of cancellations or data deletions performed by the system, and are reported to the user and their representative.
[0831] A system for carrying out this invention includes, as its main components, a server, a terminal operated by a user, and software that performs emotion recognition.
[0832] The server provides an interface for accepting pre-configured settings from users, thereby receiving the necessary conditions for managing information assets. Based on user identification information, the server constantly monitors access status and notifies the user and their representative if no access is detected within a specified period. The communication methods used here are existing email and messaging applications.
[0833] The emotion recognition function processes data input through the user's device's camera and microphone to analyze their emotional state. This utilizes commercially available emotion recognition software (such as Microsoft's Azure Cognitive Services). Based on the emotion analysis results, the server adjusts the content of notifications and the tone of information delivery to reduce the user's psychological burden.
[0834] For example, in a resident app using the city's digital services, when providing information such as resource collection schedules, if the emotion engine detects that a resident is irritated, it can reduce regular notifications and provide more friendly messages. Such implementations allow users to use the system in a less stressful way.
[0835] When using generative AI models, prompts like the following are used: "If the user's emotion is identified as (emotional state), please explain, with specific examples, how to effectively adjust notifications and the information provided."
[0836] This invention integrates emotion recognition functionality with an information asset management system, enabling interactions that take into account the psychological state of individual users.
[0837] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0838] Step 1:
[0839] Users access the system using a terminal and perform pre-configuration for information asset management. Management conditions and identification information are registered as data input. The server receives this input and creates a new user account profile.
[0840] Step 2:
[0841] The server monitors access status based on identification information at regular intervals. The input here is login history data. The server analyzes this data and determines whether or not there has been access. If there has been no access, that fact is output.
[0842] Step 3:
[0843] When no access is detected, the server analyzes data collected from the device's camera and microphone via its emotion recognition function. The input is video and audio data, which is converted into emotional states by the emotion recognition software. The results of this analysis are obtained as output.
[0844] Step 4:
[0845] The server adjusts notification content and support information based on the analysis of the emotional state. Specifically, it uses a generative AI model to input prompt sentences and generates messages with gentle phrasing. This adjusted message is then sent as a notification.
[0846] Step 5:
[0847] The server sends notifications to the user and their representative using the configured communication method. These notifications include content tailored to the user's emotional state. The output of this notification process provides a tailored message and supporting information.
[0848] Step 6:
[0849] If the agent receives the notification and approves, the server will automatically terminate the identity information and delete the data. The input is the agent's approval data, and the deletion of the information asset and a completion report will be output.
[0850] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0851] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0852] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0853] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0854] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0855] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0856] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0857] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0858] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0859] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0860] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0861] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0862] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0863] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0864] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0865] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0866] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0867] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0868] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0869] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0870] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0871] The following is further disclosed regarding the embodiments described above.
[0872] (Claim 1)
[0873] A means of accepting pre-configurations from users and collecting information necessary for managing digital record assets,
[0874] A means of monitoring access to a user's account for a predetermined period,
[0875] A means of notifying the user and their representative if access cannot be confirmed,
[0876] A means of automatically closing an account and erasing data upon approval from an agent,
[0877] A means of reporting the execution results,
[0878] A system that includes this.
[0879] (Claim 2)
[0880] The system according to claim 1, comprising means for automatically executing the procedures necessary for the cancellation of each digital record asset using generative artificial intelligence.
[0881] (Claim 3)
[0882] The system according to claim 1, comprising means for using a pre-configured communication means when sending a notice requesting approval from an agent.
[0883] "Example 1"
[0884] (Claim 1)
[0885] A means of accepting pre-configurations from users and collecting information necessary for managing digital information assets,
[0886] A means for monitoring access to user identification information for a predetermined period,
[0887] Methods for checking access status using API access and web information acquisition technologies,
[0888] A means of notifying the user and their representative if access cannot be confirmed,
[0889] A means of automatically canceling the use of identification information and deleting the information upon approval from the agent,
[0890] A means of reporting the execution results,
[0891] A system that includes this.
[0892] (Claim 2)
[0893] The system according to claim 1, comprising means for automatically executing the procedures necessary for the cancellation of each digital information asset using a generative information processing device.
[0894] (Claim 3)
[0895] The system according to claim 1, comprising means for using a pre-configured communication technology when sending a notice requesting approval from an agent.
[0896] "Application Example 1"
[0897] (Claim 1)
[0898] A means of accepting pre-configurations from users and collecting information necessary for managing digital information assets,
[0899] A means for monitoring the usage status of user identification information for a predetermined period,
[0900] A means of notifying the user and their representative if access cannot be confirmed,
[0901] A means to automatically deactivate and erase identification information upon approval from an agent,
[0902] A means of reporting the execution results,
[0903] A means of managing digital information assets and enabling interaction with users through in-home devices,
[0904] A system that includes this.
[0905] (Claim 2)
[0906] The system according to claim 1, comprising means for automatically executing the procedures necessary to unlock each digital information asset using generative artificial intelligence.
[0907] (Claim 3)
[0908] The system according to claim 1, comprising means for using a pre-configured communication means when sending a notice requesting approval from an agent.
[0909] "Example 2 of combining an emotion engine"
[0910] (Claim 1)
[0911] A means of accepting pre-configurations from users and collecting information necessary for managing digital record assets,
[0912] A means of monitoring access to a user's account for a predetermined period,
[0913] A means of notifying the user and their representative if access cannot be confirmed,
[0914] A means of analyzing the user's emotional state and adjusting the content and timing of notifications based on the analysis results,
[0915] A means of providing additional support information corresponding to the analyzed emotional state,
[0916] A means of automatically closing an account and erasing data upon approval from an agent,
[0917] A means of reporting the execution results,
[0918] A system that includes this.
[0919] (Claim 2)
[0920] The system according to claim 1, comprising means for automatically executing the procedures necessary for canceling each digital record asset using generative artificial intelligence, and further generating prompt sentences based on emotional state.
[0921] (Claim 3)
[0922] The system according to claim 1, comprising means for providing information to reduce the psychological burden on an agent, using a pre-configured communication method when sending a notice requesting approval from an agent.
[0923] "Application example 2 when combining with an emotional engine"
[0924] (Claim 1)
[0925] A means of accepting pre-configurations from users and collecting information necessary for managing information assets,
[0926] A means for monitoring access to user identification information for a predetermined period,
[0927] A means of notifying users and their representatives if access cannot be confirmed,
[0928] A means of automatically canceling the account and erasing the data of the identification information upon approval from the agent,
[0929] A means of reporting the execution results,
[0930] A means of flexibly adjusting notification content and support information provided using emotion recognition functionality,
[0931] A system that includes this.
[0932] (Claim 2)
[0933] The system according to claim 1, comprising means for automatically executing the procedures necessary for canceling information assets using generative artificial intelligence in order to provide flexible information based on emotional states.
[0934] (Claim 3)
[0935] The system according to claim 1, comprising means for adjusting the expression of a notification based on the emotion recognition result, using a pre-configured communication means when sending a notification requesting approval from an agent. [Explanation of Symbols]
[0936] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A means of accepting pre-configurations from users and collecting information necessary for managing digital record assets, A means of monitoring access to a user's account for a predetermined period, A means of notifying the user and their representative if access cannot be confirmed, A means of automatically closing an account and erasing data upon approval from an agent, A means of reporting the execution results, A system that includes this.
2. The system according to claim 1, comprising means for automatically executing the procedures necessary for the cancellation of each digital record asset using generative artificial intelligence.
3. The system according to claim 1, further comprising means for using a pre-configured communication means when sending a notice requesting approval from an agent.