Service provision system
Patent Information
- Application Number
- JP2025069480
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2019-01-06
- Filing Date
- 2025-04-21
- Publication Date
- 2025-11-26
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The conflict between the guarantee of authenticity of recorded information and the right to delete the information, particularly in blockchain systems, results in the impossibility of erasing personal information once it is recorded, impairing the right to be forgotten.
A processing system that includes encryption, decryption, and non-decryptable state setting, with a second key concealment mechanism to enable secure deletion of information, allowing users to control the visibility of their data.
Resolves the dilemma of conflicting guarantees by enabling secure erasure of personal information while maintaining data authenticity, thus respecting the right to be forgotten.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a processing system and a program for an information recording method that is difficult to tamper with or erase, such as blockchain, for example. relates to.
Background Art
[0002] Blockchain has been generally known as an information recording method that is difficult to tamper with. For example, Patent Document 1 records various information related to cargo transportation using this blockchain.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] However, recording information using such a blockchain is not only difficult to tamper with but also difficult to erase (hereinafter referred to as "impossibility of erasure"). As a result, once personal information is recorded using blockchain, even if the personal information owner wishes to erase the personal information, it cannot be erased, and the right to erase personal information (so-called right to be forgotten) is impaired.
[0005] That is, there is a drawback that an antinomy occurs in which the guarantee of the authenticity of the recorded information and the guarantee of the right to delete the information are in conflict.
[0006] The present invention has been conceived in view of such circumstances, and its object is to resolve the antinomy in which the guarantee of the authenticity of the recorded information and the guarantee of the right to delete the information are in conflict.
Means for Solving the Problems
[0007] The present invention includes an encryption means for performing an encryption process to encrypt information to be recorded, a recording means for recording the information after the encryption process, a decryption means for performing a decryption process on the information recorded by the recording means using a first key and a second key to obtain plaintext information, and a non-decryptable state setting means for setting the information recorded by the recording means in a non-decryptable state, and the decryption means includes a second key concealment holding means for concealing and holding the second key, and the non-decryptable state setting means sets the non-decryptable state by updating the second key held by the second key concealment holding means with another key.
[0008] Preferably, the decryption means further includes a first key distribution means for distributing the first key to a person who wishes to view the information. Preferably, it further includes a search means for searching the information recorded by the recording means without converting it into plaintext.
[0009] More preferably, the information recorded by the recording means includes personal information, and the non-decryptable state setting means sets the personal information of the personal information owner in the non-decryptable state in response to a request from the personal information owner.
[0010] Another aspect of the present invention includes a step of performing an encryption process to encrypt information to be recorded, a decryption step of performing a decryption process on the information recorded by a recording means for recording the information after the encryption process using a first key and a second key to obtain plaintext information, and a step of setting the information recorded by the recording means in a non-decryptable state, which is executed by a computer, the decryption step includes a step of concealing and holding the second key, and the step of setting the non-decryptable state sets the non-decryptable state by updating the second key held by the holding step with another key. [Effect of the Invention]
[0011] According to the present invention, it is possible to resolve, as much as possible, the dilemma in which the guarantee of the authenticity of the recorded information and the guarantee of the right to delete the information are in conflict with each other. [Brief Description of the Drawings]
[0012]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Figure 16
Figure 17
Figure 18
Figure 19
Figure 20
Figure 21
Figure 22
Figure 23
Figure 24
Figure 25
Figure 26
Figure 27
Figure 28
Figure 29
Figure 30
Figure 31
Figure 32
Figure 33
Figure 34
Figure 35
Figure 36
Figure 37
Figure 38
Figure 39
Figure 40
Figure 41
Figure 42
Figure 43
Figure 44
Figure 45
Figure 46
Figure 47
Figure 48
Figure 49
Figure 50
Figure 51
Figure 52
Figure 53
Figure 54
Figure 55
Figure 56
Figure 57
Figure 58
Figure 59
Figure 60
Best Mode for Carrying Out the Invention
[0013] [First Embodiment] A first embodiment of the present invention will be described with reference to FIGS. 1 to 13. First, referring to the overall system in FIG. 1, three types of blockchain networks, a private chain 2, a consortium chain 3, and a public chain 4, are connected to a centralized oracle 21. The public chain 4 has a completely open structure, and anyone, whether an individual or a group, can conduct transactions there. Transactions can be effectively confirmed on that blockchain. Mining (competition for the right to record accounts) is also free and anyone can participate. The consortium chain 3 is a blockchain that can only be used by partners belonging to an association or a union. The people (each node) among them are designated as account recorders. The generation of blocks is also determined in advance, and other people (nodes) can conduct transactions but do not have the right to record accounts. The private chain 2 only records accounts using blockchain technology. The right to record accounts is not open and is monopolized by an individual or a company, and only internal transactions are recorded. To connect blockchains to each other and exchange tokens and data between each blockchain, Polkadot is used. Polkadot is a blockchain for connecting different blockchains. A blockchain developed using Substrate can be connected to Polkadot, and by connecting to Polkadot, it becomes possible to exchange tokens and data with other blockchains connected to Polkadot.
[0014] The centralized oracle 21 is a system that bridges data between the blockchain and the Internet 1. It is connected to the Internet 1, collects various information scattered on the network, and provides information to the smart contracts of the blockchain.
[0015] Each node 19 of the private chain 2, the consortium chain 3, and the public chain 4 is composed of a user terminal such as a personal computer (hereinafter referred to as "PC") 16. This PC (hereinafter also referred to as "user terminal") 16 is connected to the Internet 1. Further connected to the Internet 1 are a server 20 of an SNS (Social Networking Service) 40 and a server 18 of a blockchain certification business operator 17. Note that the server 18 of the certification business operator 17 may participate in the blockchain as a node 19. Also, a server of a certification authority that issues an electronic certificate in PKI (Public Key Infrastructure) may be connected to the Internet 1.
[0016] The certification business operator 17 stores personal information, issues an electronic ID mainly for the individual, and records the hash value of the personal information on the blockchain. The stored personal information is stored in a personal information database (hereinafter referred to as "personal information DB") 29. Note that the certification business operator 17 may participate in the blockchain as a node 19.
[0017] The PC 16 is composed of a CPU (Central Processing Unit) 10 as a control center, a RAM (Random Access Memory) 9 that functions as a work area for the CPU 10, a ROM (Read Only Memory) 11 that stores data and programs, a storage unit such as an HDD (hard disk drive) 12, an input operation unit 7 such as a display and a keyboard, a communication unit 5, a display unit 6, an interface 8, a bus 13, and various other hardware. Each server such as the server 20 and the server 18 is also composed of the same hardware as the PC 16, and the illustration and description thereof are omitted here for the sake of brevity. Note that as the storage unit, in addition to or instead of the above HDD, an SDD (Solid State Drive) may be used.
[0018] Node 19 of the consortium chain 3 is connected to the IoT (Internet of Things) device 14 and the wireless sensor network 15. Sensor signals from the IoT device 14 and the wireless sensor network 15 are input into node 19, and a drive signal for the IoT device 14 is output from node 19. The IoT device 14 is various sensors, actuators, etc. for IoT.
[0019] The wireless sensor network 15 is a wireless network that scatters a plurality of wireless terminals with sensors in space, enabling them to cooperate to collect the environment and physical conditions. For example, make sensor devices with energy harvesting, M2M, or batteries, etc., and constantly monitor, for example, deterioration such as metal fatigue with pressure sensors or gauge sensors, and notify when there is a change. It is mainly installed in structures such as bridges and tunnels. Generally, it includes a plurality of sensor nodes and gateway sensor nodes. These nodes are usually composed of one or more sensors, wireless chips, microprocessors, and power sources (such as batteries). The wireless sensor network usually has an ad hoc function and a routing algorithm for sending data from each node to the central node. That is, it has a function of autonomously reconstructing another communication path when there is an obstacle in communication between nodes. There is also an element of distributed processing for nodes to cooperate as a group. In addition, it has a function of operating for a long time without receiving power supply from the outside, and for this purpose, it has a power-saving function or a self-power generation function.
[0020] In this embodiment, the IoT device 14 and the wireless sensor network 15 are connected to the consortium chain 3 via node 19. However, without going through node 19, one or both of the IoT device 14 and the wireless sensor network 15 themselves may be part of node 19 of the consortium chain 3.
[0021] Next, referring to FIG. 2(A), the information stored in the HDD 12 of the PC 16 will be described. The HDD 12 stores the user's secret key SK, public key PK, common key K1, trapdoor common key K2, the user's address in the blockchain, smart contract, token, artificial intelligence (also referred to as "AI (Artificial Intelligence)"), and blockchain data, etc. Note that the user is a broad concept that includes not only natural persons but also legal persons.
[0022] The secret key SK and the public key PK are a key pair used in PKI (Public key Infratructure), and the data encrypted with the public key PK is decrypted with the secret key SK. The secret key SK is also used for electronic signatures. The common key K1 is a key used for common key encryption such as DES (Data Encryption Standard) or AES (Advanced Encryption Standard). The data encrypted with the common key K1 is decrypted using the same common key K1. In this embodiment, different common keys are used for each piece of personal information to be encrypted. In the first embodiment, for the encrypted personal information E K1 (personal information), an index for keyword search is provided for the ciphertext. The index is encrypted with the common key K2. To perform a keyword search, an encrypted search query (referred to as a "trapdoor") obtained by encrypting the keyword (search query) used for the search with the common key K2 is used for the search. This common key K2 is stored in the HDD 12 as the trapdoor common key K2.
[0023] The user's address in the blockchain is generated through the following process. 1. Generate a public key from the secret key using ECDSA. 2. Pass the public key through the hash function SHA-256 to obtain a hash value. 3. Pass the hash value through the hash function RIPEMD-160 to obtain a hash value. 4. Add 00 as a prefix to the beginning of the hash value. 5. Pass it through the hash function SHA-256. 6 Pass it through the hash function SHA-256 again. 7 Add a 4-byte checksum at the very end. 8 Encode it in Base58 format.
[0024] A smart contract is a computer protocol intended for smooth verification, condition confirmation, execution, performance, and negotiation of contracts. A token is a unique currency issued on a blockchain by a company or an individual.
[0025] Next, explain the blockchain data. The data in each block of the blockchain includes the hash value of the previous block, the nonce, and the data of multiple transactions (also referred to as transactions). Also, although not shown in the illustration, a timestamp is also embedded in the blockchain. Such a blockchain is generated by each node 19 performing blockchain processing (see S3, S19, S30, S51, S117, S122, S153, etc. described later) and added as a new blockchain. The blockchain processing mainly consists of three phases: transaction, propagation, and recording.
[0026] The transaction phase is an act generally referred to as a transaction and means legal acts such as buying and selling acts, transfer acts, lending (loan) acts, etc. This transaction phase can be more specifically divided into three phases: generation → signature → propagation.
[0027] The generation phase is to generate a transaction. For example, Person A decides to "lend the idle PC resources (computing resources) to Person B for 39,005 seconds and obtain 25.78 tokens." and electronically signs the generation of the transaction. This electronic signature is generated by passing the transaction data through a predetermined hash function to obtain a hash value, and encrypting the hash value using the private keys SK of the parties (Person A and Person B) to the transaction (transaction). Also, a digital public key certificate may be issued by a certification authority. Figure 2 shows an example of lending PC resources (computing resources), but the lending target is not limited to this. For example, power generated by self-generation at home or in a company, values such as the user's professional knowledge, experience, skills, connections (including the human network on the Internet), and credit, etc. can be considered.
[0028] The propagation phase is to have other nodes confirm that the generation and signature of the transaction have been completed correctly. If it is determined that the generation and signature of the transaction have not been performed correctly, the transaction is discarded.
[0029] The recording phase is for the miner to perform mining to record the transaction when it is confirmed that the generation and signature of the transaction have been completed correctly. The transaction for which it has been confirmed that the generation and signature have been completed correctly moves to a place called a mining pool. Then, the miner selects the transaction to be recorded from the mining pool and performs mining.
[0030] Mining is the operation of calculating a nonce. The nonce is a value used to adjust so that a very small hash value with many 0s lined up at the beginning is generated when the block data is passed through a hash function. A new block is generated when a nonce can be calculated such that the hash value is below the target value.
[0031] Note that the transaction data, as shown in Transaction I on the right side of Figure 2, is E obtained by encrypting the user's personal information with key K1. K1The hash value of (personal information), its electronic ID, and the index of personal information and the consideration for providing personal information (provided with 2.4 tokens in Fig. 2) are encrypted with key K2 to obtain E K2 (Provided with index + 2.4 tokens) is also included. Specific examples of personal information include vital information such as the user's heart rate, blood pressure, body temperature, electroencephalogram, etc., behavioral history information such as purchase history and website browsing history, the user's location information such as GPS, race, creed, social status, medical history, electronic medical record data, ID (identification), posting information on SNS, etc.
[0032] The posting information on SNS, etc. is the past posting information that has already been posted on SNS25 and stored in server 20, which has been transferred from server 20 to personal information DB29 and the blockchain. Specifically, the user encrypts all of their own past posting information and stores it in the personal information DB29 of the certifying operator, and records its hash value on the blockchain. Thereafter, instead of posting on SNS25, the user encrypts the posting content and stores it in the personal information DB29 of the certifying operator, and records its hash value on the blockchain. As a result, the user can retrieve personal information from operators such as SNS and place it under their own management.
[0033] Regarding the consideration for providing personal information (provided with 2.4 tokens in Fig. 2), it may be recorded on the blockchain in plain text without encryption. In that case, other users can search the blockchain and know the consideration without obtaining the encryption key K2. Furthermore, transaction conditions such as the consideration for providing personal information and the consideration for lending PC resources (computing resources) (in Fig. 2, lending PC resources (computing resources) for 39005 seconds to obtain 25.78 tokens) can be coded in the form of a smart contract, and the smart contract can be used to automate transactions (legal acts).
[0034] The encrypted personal information itself, which is the target of the hash value recorded as Transaction I, is stored in the personal information DB29 of the certifying operator 17. Specifically, as shown in Fig. 2(B), the certifying operator 17 encrypts the personal information EK1 Encrypted personal information E is associated with the electronic ID issued for K1 (Personal information) is stored in the personal information DB29.
[0035] An index is an index for keyword searching of the encrypted personal information E K1 (Personal information). In the present embodiment, since a common key encryption method for encrypting the index with the common key K2 is adopted, in order to perform a keyword search, a search is performed using an encrypted search query (referred to as a "trapdoor") obtained by encrypting the keyword (search query) used for the search with the common key K2. The common key K2 is a different key for each user, but the same key is used for the encrypted indexes of the same user. Therefore, by a smart contract described later, for example, if user A performs a transaction to distribute the common key K2 to user B, user B can K2 search all the encrypted indexes of user A on the blockchain using the
[0036] Note that a searchable encryption such as a homomorphic encryption or a fully homomorphic encryption that can search while keeping the ciphertext encrypted may be used. In that case, the personal information may be encrypted using the homomorphic encryption or the fully homomorphic encryption, and the encrypted personal information may be directly recorded on the blockchain. Also, the encrypted personal information E K1 (Personal information) may be directly recorded on the blockchain.
[0037] Next, referring to FIG. 3(A), the flowchart of the main routine program of the user terminal of the public blockchain 19 will be described. In step S (hereinafter simply referred to as "S") 1, a personal information recording process is performed, in S2, a smart contract process is performed, and in S3, a blockchain process is performed.
[0038] Personal information recording process refers to the process in which the personal information owner encrypts personal information, registers it with the certified operator 17, and records the hash value of the encrypted personal information on the blockchain. Smart contract process refers to the process of automatically performing legal acts such as conclusion and execution of contracts according to pre-determined rules. The specific content of the blockchain process is as described above based on FIG. 2(A).
[0039] Referring to FIG. 3(B), the personal information recording process will be described. At S5, it is determined whether there is a personal information registration operation in the user terminal constituting the node 19 of the public chain 19. If not, this personal information recording process returns and proceeds to the smart contract process of S2. If it is determined that there is a personal information registration operation, at S6, the personal information stored in the memory (such as HDD 12) of the user terminal is encrypted with the key K1, electronically signed with the private key SK, and the index is encrypted with the key K2 and sent to the server 18 of the certified operator 17.
[0040] The server 18 of the certified operator 17 that receives it at S7 issues an electronic ID and generates the hash value of E K1 (personal information). Next, the issued electronic ID is returned to the user terminal (S9). The user terminal that receives it stores the electronic ID in the memory (such as HDD 12). The server 18 of the certified operator 17 performs processing for recording the electronic ID, the hash value, and the encrypted index on the blockchain at S10.
[0041] Describe the flowchart of the subroutine program for the smart contract process shown in S2. Referring to FIG. 4, in S13, it is determined whether the distribution contract of the common key K2 has been established. If not, in S15, it is determined whether the lending contract of the PC resources (computing resources) of the user terminal has been established. If not, in S16, it is determined whether the personal information provision contract has been established. If not, in S17, it is determined whether the order contract for ordering made-to-order goods, etc. has been established. If not, in S22, it is determined whether the sales contract of goods, etc. has been established. If not, return. These determinations are made by the smart contract. For example, when the consideration, etc. described above is coded as a smart contract, the smart contract determines whether the conditions of the consideration, etc. of both parties match. If it is determined that they match, the conclusion and execution of the contract are automatically performed.
[0042] When it is determined that the distribution contract of the common key K2 has been established, the control proceeds to S14. After the common key K2 is transmitted to the distribution destination, the control proceeds to S19. In S19, the process for recording the established contract as a transaction in the blockchain is performed. When it is determined that the lending contract of the PC resources (computing resources) has been established, the control proceeds to S18, and the lending process of the PC resources (computing resources) is performed. When it is determined that the personal information provision contract has been established, the control proceeds to S20, and the electronic ID of the personal information to be provided and the signature agreeing to the provision of the personal information are returned to the recipient, and at the same time, the common key K1 used for encrypting the personal information to be provided is encrypted with the public key of the recipient and returned to the recipient.
[0043] When it is determined that the order contract has been established, the control proceeds to S21. After the order process is performed, it proceeds to S19. When it is determined that the sales contract has been established, the control proceeds to S23, and the process of obtaining the purchase target is executed and then proceeds to S19.
[0044] Next, the flowchart of the main routine program of the user terminal that constitutes Node 19 of Private Chain 2 will be described based on FIG. 5(A). Personal information search processing is performed in S28, smart contract processing is performed in S29, blockchain processing is performed in S30, machine learning processing is performed in S31, AI smart contract generation processing is performed in S32, and smart contract trust subcontracting processing is performed in S33. The AI smart contract is a concept that includes both the "integrated type" and the "cooperative type". The "integrated type" is a type in which AI and a smart contract are integrated, machine learning is performed based on contract (legal act) data, and the smart contract itself is AI-ized. The "cooperative type" is a type in which an AI that has performed machine learning based on contract (legal act) data and a smart contract are cooperative. In the case of the cooperative type, the learned AI (hereinafter referred to as "cooperative AI") adds, changes, updates, etc. the smart contract according to the situation.
[0045] Personal information search processing is a process of searching for an encrypted index recorded in a blockchain using a trapdoor (encrypted search query). Smart contract processing is a process of automatically performing legal acts such as conclusion and execution of a contract according to predetermined rules. The specific content of the blockchain processing is as described above based on FIG. 2(A). Machine learning processing is a process of performing machine learning on personal information of a large number of users as learning data to generate a learned model of artificial intelligence. More specifically, after generating a general learned model of artificial intelligence by performing machine learning on a vast amount of personal information in a form that cannot identify the personal information owner as learning data, a personalized learned model personalized for each personal information owner (for each address in the blockchain) is generated using the personal information classified for each data that can identify the personal information owner (for example, the address in the blockchain).
[0046] AI smart contract generation processing refers to the process of using personal information related to contracts (legal acts) as training data for machine learning to generate a trained model of a smart contract by artificial intelligence. More specifically, after using personal information related to a vast number of contracts (legal acts) in a form that cannot identify the personal information owner as training data for machine learning to generate a general trained model of a smart contract by artificial intelligence, a personalized AI smart contract trained model is generated for each personal information owner (for example, for each address in the blockchain) using personal information related to contracts (legal acts) classified for each data that can identify the personal information owner (for example, the address in the blockchain).
[0047] Smart contract trusteeship processing refers to the process of providing a service that executes, on behalf of the principal, the process of automatically performing legal acts such as contract conclusion and execution. More specifically, a personalized AI smart contract trained model personalized for the trustor is generated, and using that personalized AI smart contract trained model, legal acts are executed on behalf of the trustor. Based on the result of that execution, a reward for the AI is determined, and using that reward, the personalized AI smart contract trained model is further reinforced through learning.
[0048] Next, based on FIG. 5(B), the flowchart of the subroutine program of the personal information search process shown in S28 will be described. It is determined at S37 whether there is a memory of the common key K2, and if not, the process returns. If K2 is stored at S45 described later and it is determined at S37 that there is a memory of the common key K2, the control proceeds to S38. At S38, a process of searching for an encrypted index on the blockchain using a search query (trapdoor) encrypted with K2 is performed. As a result of that search, it is determined at S39 whether there is the personal information to be obtained. If it is determined that there is no personal information to be obtained, the process returns, but if it is determined that there is the personal information to be obtained, the electronic ID of the desired personal information is stored at S40.
[0049] Next, based on FIGS. 6 and 7(A), the flowchart of the subroutine program for the smart contract process shown in S29 will be described. It is determined by S42 whether there is personal information to be searched for. This determination is made, for example, by sequentially negotiating with the smart contracts of personal information owners who have not been searched yet, and when the conditions match, the personal information of that personal information owner is determined to be the personal information to be searched for. If it is determined by S42 that there is no personal information to be searched for, it is determined by S46 whether there is storage of personal information to be obtained. If it is determined that there is none, the control proceeds to S55 in FIG. 7(A), and it is determined whether a lending contract of PC resources (computing resources) is established. If it is determined that it is not established, it is determined by S56 whether an order contract is established. If it is determined that it is not established, it is determined by S57 whether a sales contract is established. If it is determined that it is not established, the process returns.
[0050] If it is determined by S42 that there is personal information to be searched for, the control proceeds to S43, and the common key K2 is requested from the personal information owner. Specifically, the own address and an Attribute Certificate are sent to the address of the personal information owner of the personal information to be searched for on the blockchain to request the common key K2. It is determined by S44 whether there is a reply of K2, and the process waits until there is a reply. The personal information owner or the smart contract of the personal information owner determines whether to reply with K2 after confirming the sent Attribute Certificate. If it is determined that it is okay to reply, K2 is replied. When there is a reply of K2 from that personal information owner, the control proceeds to S45. After storing the replied K2, the control transfers to S54. In S54, the process of storing the established contract as a transaction on the blockchain is performed. In this case, a contract stating that the common key K2 used for encrypting the index is distributed from the address of the replied personal information owner to the address of the user who received the reply is stored on the blockchain.
[0051] When it is determined by S46 that there is a memory of the personal information desired to be obtained, the control proceeds to S47, and a process of requesting the personal information desired to be obtained from the personal information owner is performed. Specifically, the own address and the attribute certificate are transmitted to the address on the blockchain of the personal information owner of the personal information desired to be obtained to request the personal information desired to be obtained. At the user terminal of the public blockchain that has received this, the smart contract checks the attribute certificate and determines whether the conditions for providing the personal information are met. When it is determined that the personal information may be provided (YES in S16), the electronic ID of the personal information to be provided and the signature agreeing to provide the personal information are returned, and the common key K1 used for encrypting the personal information to be provided is encrypted with the public key of the recipient and returned (see S20).
[0052] When there is such a reply, it is determined by S48 that there is a reply from the personal information owner, and the control proceeds to S49. The encrypted common key E PK (K1) is decrypted with the own secret key SK, that is, D SK (E PK (K1)) is performed to calculate K1. Next, by S50, a process of transmitting the electronic ID and signature returned from the personal information owner to the server 18 of the certification business operator 17 is performed. The server 18 of the certification business operator 17 that has received this checks the transmitted signature, and then searches the personal information DB29 (see Fig. 2(B)) based on the received electronic ID, and reads out and returns the encrypted personal information E K1 (personal information) associated with the received electronic ID.
[0053] If that reply is received, it is determined as YES by S51 and the control proceeds to S52. The encrypted personal information E K1 (personal information) is decrypted with K1 calculated in S49, that is, D K1 (E K1 (personal information)) is performed to obtain the plaintext personal information. The personal information is stored by S53. Then, the process proceeds to S54, and a process for recording the provision contract of the personal information as a transaction on the blockchain is performed.
[0054] Next, if a lending contract for PC resources (computing resources) is established with the user terminal of the public chain (YES in S15), it is determined as YES by S55 and the control proceeds to S58, and the borrowing process of the PC resources (computing resources) is performed. Then the control shifts to S54, and a process for recording the lending contract as a transaction in the blockchain is performed. If an order contract is established with the user terminal of the public chain (YES in S17), it is determined that the order contract is established by S56 and the control proceeds to S59, and a process for storing the order receipt for the order is performed. Then the control shifts to S54, and a process for recording the order receipt contract as a transaction in the blockchain is performed.
[0055] If a sales contract is established with the user terminal of the public chain (YES in S15), it is determined that the lending contract for PC resources (computing resources) is established by S57 and the control proceeds to S60, and a process for providing the sales target is performed. Then the control shifts to S54, and a process for recording the sales contract as a transaction in the blockchain is performed. In the smart contract process described above, instead of performing actions (for example, S42, S47, S58, S56, S60) based only on the judgment (for example, S42, S46, S55, S56, S57) on the private chain user terminal 16 based on the smart contract, the actions may be performed after obtaining the consent of the owner of the smart contract. This consent of the owner may also be obtained when executing the contract by the smart contract described later.
[0056] Next, based on FIG. 7(B), the flowchart of the subroutine program of the machine learning process shown in S31 will be described. By S63, a process is performed to make a huge amount of personal information stored in a form that cannot identify the personal information owner into learning data. As the learning algorithm adopted in this machine learning, for example, various algorithms such as regression and discrimination as supervised learning, model estimation and data mining as unsupervised learning, and reinforcement learning and deep learning as intermediate methods are prepared.
[0057] Next, by S64, machine learning is performed on the learning data using the borrowed PC resources (computing resources). For example, in the case of regression as supervised learning, a large dataset consisting of input information (vector x) and correct answer information y is used as training data (learning data). In the case of supervised learning, since the function ci(x) (ci: x → y) that maps the input x to the correct answer y is learned, the learned model includes the function ci. Note that the machine learning performed by the machine learning means 34 is not limited to supervised learning, and can be any type of machine learning such as unsupervised learning like model estimation or pattern mining (data mining), semi-supervised learning which is an intermediate method between supervised learning and unsupervised learning, reinforcement learning, deep learning, etc.
[0058] A general learned model is generated by the machine learning by S64 and stored (S65). This general learned model is a model that uses a vast amount of personal information, which is the personal information of a large number of users and cannot identify the personal information owner, as learning data, and is an average learned model that can be widely applied to a large number of users.
[0059] Next, it is determined by S66 whether there is an order memory. If not, the process returns. If there is, it is determined by S67 whether it is an order received by artificial intelligence. If it is not an order received by artificial intelligence, the process returns. If it is an order received by artificial intelligence, then by S68, a process is performed to request personal information to the address of the order placer. If there is a reply of personal information from the order placer, it is determined as YES by S69 and the process proceeds to S70. In S70, a process is performed to personalize the general pre-trained model based on the replied personal information to generate a personalized pre-trained model. The process of personalizing this general pre-trained model to generate a personalized pre-trained model is described in Japanese Patent Publication No. 6432859. Since the personal information required for personalization is collected using a blockchain, there is an advantage that the problem of privacy can be avoided as much as possible by collecting it while ensuring the anonymity of the blockchain. Next, by S71, the personalized pre-trained model is transmitted to the address of the order placer.
[0060] Next, based on FIG. 8, a flowchart of the subroutine program of the AI smart contract generation process shown in S32 will be described. By S80, a process is performed to extract personal information related to a contract (juridical act) from a vast amount of personal information stored in a form that cannot identify the personal information owner and use it as learning data. Next, by S81, machine learning using the learning data is performed using the PC resources (computing resources) being borrowed. The processes of S80 and S81 are the same as those described in S63 and S64 above, and the repetition of the explanation will be omitted here.
[0061] Next, in S82, a process is performed to generate and store a learned model of a general AI smart contract. Next, in S83, simulation learning processing is executed. This simulation learning processing virtually executes (simulates) in a computer, by having a group of multiple AI smart contracts substitute for legal acts such as verification, condition confirmation, execution, performance, and negotiation of contracts that are originally carried out among a large number of people, and gives a reward according to the result to each AI smart contract to perform reinforcement learning. Because it is reinforcement learning by simulation in a computer rather than reinforcement learning in the real world, there is an advantage that a huge amount of reinforcement learning can be performed in a short time. Reinforcement learning is a mechanism in which an agent placed in a state of a certain environment acquires a policy that maximizes the cumulative reward from the initial state to the goal based on the reward given when the agent selects an action. In reinforcement learning, learning progresses through the interaction between a software agent (hereinafter referred to as "agent"), which is a type of AI, and the environment. Here, the agent is a type of AI, which is software that communicates with users, software, etc., and autonomously behaves with a certain degree of judgment ability and continuously operates permanently. When the agent performs a certain action a on the environment, the state s of the environment changes, and when a certain target state is reached, a reward r is given to the agent. The agent learns a function that takes the state s as an input and outputs the action a for the purpose of maximizing this reward r.
[0062] Time progresses in reinforcement learning by repeating the following simple steps. 1. The agent receives an observation o (or directly, the state s of the environment) received from the environment and returns an action a to the environment based on the policy π. 2. Based on the action a received from the agent and the current state s, the environment changes to the next state s′, and based on this transition, it returns to the agent the next observation o′ and a scalar quantity (a single number) r called the reward, which indicates the goodness or badness of the previous action. 3. Progression of time: t ← t + 1 Here, ← represents an assignment operation. As reinforcement learning, for example, an AlphaZero-type reinforcement learning algorithm may be used. This AlphaZero-type reinforcement learning algorithm is different from algorithms such as DQN (Deep Q-Network). It uses Monte Carlo tree search (MCTS) for exploration, and allows a neural network to predict all values and policies, and modifies the prediction only with the experience obtained from self-play by tree search. Compared with the conventional AlphaGo, the value network for predicting value and the policy network for predicting policy are integrated into one neural network, and the prediction accuracy is improved by multi-task learning. In addition, due to the improvement of the performance of the neural network, the processor layout in tree search (extending the search tree until a reward is obtained) processing is no longer required, and the search can be performed faster. Furthermore, evolutionary computation, genetic algorithm, or generative adversarial networks may be used.
[0063] Next, S84 determines whether there is an order receipt record of the AI smart contract. If not, the process returns. If the order receipt is recorded by the aforementioned S59, it is determined as YES by S84 and the control proceeds to S85, where it is determined whether the recorded order receipt is an order receipt of a simulation-trained AI smart contract. If it is not an order receipt of a simulation-trained AI smart contract, it is an order receipt of a personalized AI smart contract trained model, and in that case, the control proceeds to S86, where a process of requesting personal information regarding the contract (legal act) to the address of the order placer is performed. When there is a reply of personal information from the order placer, it is determined as YES by S87 and the control proceeds to S88.
[0064] In S88, a process is performed to personalize the learned model of the general AI smart contract based on the personal information regarding the replied contract (legal act) to generate a personalized learned model of the AI smart contract. The process of personalizing the learned model of the general AI smart contract to generate a personalized learned model of the AI smart contract is described in Japanese Patent Publication No. 6432859. The personalized learned model is transmitted to the address of the orderer by S89.
[0065] On the other hand, in the case of receiving an order for the AI smart contract with the learned simulation, it is determined as YES by S85 and the control proceeds to S90, and the AI smart contract with the learned simulation is transmitted to the address of the orderer.
[0066] Next, based on FIG. 9(A), the flowchart of the subroutine program of the simulation learning process shown in S83 will be described. By S334, it is determined whether there is an input for the simulation, and if not, the process returns. This simulation is input by the user terminal of the private chain 2. For example, in the case where it is assumed that policies and laws that the government intends to adopt (for example, reduced tax rates accompanying consumption tax increases, revised immigration control laws, the United Kingdom's withdrawal from the EU (European Union), partial or full adoption of basic income, amendment of Article 9 of the Japanese Constitution, etc.) are adopted, transaction simulations in the investment market such as stock trading and futures trading, company management simulations, or consumer behavior simulations, etc. Further, it may be a simulation of promotions of new products (including financial products and life insurance) and new services by various media. If it is determined by S334 that there is an input for the simulation, the control proceeds to S335 and the AI smart contract group generation process is executed.
[0067] The flowchart of the subroutine program for this AI smart contract group generation process will be described based on FIG. 9(B). In S344, a process is performed to set a group of personas that match the input simulation using the borrowed PC resources (computing resources). A persona is generally defined as a virtual person representing the typical target of a company, product, or service. In this embodiment, a persona is defined as a virtual person representing the typical person image targeted by the simulation content. For example, in the case of the consumption behavior simulation under the reduced tax rate accompanying the aforementioned consumption tax increase, personas corresponding to general consumers are set for each group grouped by gender, age, region, annual income, etc.
[0068] The number of personas to be set is made proportional to the number of users belonging to the group. For example, when the age-based population distribution of general consumers is 5% for those in their 10s, 5% for those in their 20s, 10% for those in their 30s, 10% for those in their 40s, 20% for those in their 50s, 20% for those in their 60s, 20% for those in their 70s, 5% for those in their 80s, and 5% for those in their 90s, the number of personas representing those in their 10s is set to 1, the number of personas representing those in their 20s is set to 1, the number of personas representing those in their 30s is set to 2, the number of personas representing those in their 40s is set to 2, the number of personas representing those in their 50s is set to 4, the number of personas representing those in their 60s is set to 4, the number of personas representing those in their 70s is set to 4, the number of personas representing those in their 80s is set to 1, and the number of personas representing those in their 90s is set to 1.
[0069] Next, by S345, a process is performed to select a user group belonging to each persona using the borrowed PC resources (computing resources). Next, by S346, a process is performed to group-ping the user groups belonging to each persona and collect the transaction data of the user groups from the blockchain for each group. For example, in the case of the consumption behavior simulation under the reduced tax rate accompanying the aforementioned consumption tax increase, the user groups are grouped by gender, age, region, annual income, etc., and the transaction data of the user groups is collected from the blockchain for each group. For the selection of the user group and the collection of the transaction data of the user group in S345 and S346, it is useful to use, for example, the database of the questionnaire answering monitor members held by an Internet questionnaire survey company. The Internet questionnaire survey company stores in the database the contact information (such as email addresses) of the questionnaire answering monitor members in association with attributes such as gender, age, place of residence, unmarried, married, occupation, and household annual income, and uses the monitor member data by attribute. Similarly, in S145 and S146, S586 and S587, S622 and S623, etc. described later, it is useful to use the database of the questionnaire answering monitor members held by the Internet questionnaire survey company. Next, by S347, a process is performed to perform machine learning using the transaction data as learning data using the borrowed PC resources (computing resources) and generate a learned AI smart contract for each persona. This AI smart contract is generated in the same number as the number of settings of the corresponding persona. As a result, the environment for executing the simulation is prepared, and the simulation is performed within that environment.
[0070] Returning to Fig. 9(A), each AI smart contract generated as described above executes a contract (juridical act) according to act a (S336). This "act a" is act a as a result of the reinforcement learning by S338. Next, by S337, a process is performed to record the contracts established between the AI smart contracts in the blockchain.
[0071] Next, by S338, the reward r is calculated based on the concluded contract terms using the borrowed PC resources (computing resources), and the action a according to the optimal policy π * is obtained through TD learning. For example, in the case of the consumption behavior simulation under the reduced tax rate accompanying the aforementioned consumption tax increase, the smaller the value of (expenditure amount before tax increase - expenditure amount after tax increase), the higher the reward r. Then, it is determined by S339 whether the simulation has ended. If it has not ended yet, the control returns to S336, and the loop of S337 → S338 → S339 → S336 is repeated to progress the reinforcement learning. When the simulation ends and it is determined as YES by S339, the control proceeds to S340, and after memorizing the AI smart contract that obtained the highest reward r, it returns. Note that it is not limited to the AI smart contract that obtained the highest reward r. For example, the top 5% of AI smart contracts may be memorized. Also, the recording to the blockchain by S337 does not necessarily have to be performed. In that case, in the above-described cooperation type, the "AI smart contract" in S335, S336, S340, and S347 is changed to "cooperation-use AI". That is, in the case of simulation within a computer, since there is no execution of a contract (legal act) in the real world, when the recording to the blockchain is not performed, there is no need to use a smart contract deliberately, because it is sufficient for each cooperation-use AI to execute the action a and perform reinforcement learning. At the actual citation stage after the reinforcement learning is completed, the learned cooperation-use AI may cooperate with the smart contract to execute the contract and record it on the blockchain.
[0072] Next, based on FIG. 10, the flowchart of the subroutine program for the smart contract trust subcontracting process shown in S33 will be described. By S94, it is determined whether there is an order memory for the smart contract trust. If it is determined that there is no order memory, the process returns. When it is confirmed that the content of the order memory stored by the aforementioned S59 is an order for the smart contract trust, it is determined as YES by S94 and the control proceeds to S95. In S95, personal information regarding the contract (juridical act) is requested to the address of the orderer. When personal information is returned from the orderer, it is determined as YES by S96 and the control proceeds to S97.
[0073] In S97, a process of personalizing the learned model of the general AI smart contract based on the returned personal information regarding the contract (juridical act) to generate a personalized AI smart contract learned model is performed. The process of personalizing the learned model of the general AI smart contract to generate a personalized AI smart contract learned model is described in Japanese Patent Publication No. 6432859.
[0074] Next, by S98, a process of associating and storing the address of the orderer and the personalized AI smart contract learned model is performed. Using the stored personalized AI smart contract learned model, a subcontracting process is performed for the orderer (S99). Next, by S100, a reinforcement learning process of the personalized AI smart contract learned model is executed.
[0075] Based on FIG. 11(A), the flowchart of the subroutine program for the reinforcement learning process of the personalized AI smart contract learned model shown in S100 will be described. In reinforcement learning, as a method for estimating the Q-value when the value when performing action at in state st is Q(st, at), if knowledge for modeling the environment, that is, the state transition probability and the probability distribution of rewards are given, a model-based method can be used. However, when the environment model is unknown, TD (Temporal Difference) learning is used. First, since exploration of the environment is necessary, the ε-greedy method is used. At the initial stage of exploration, various actions are tried, and as it settles down, the concept of temperature is introduced so that more optimal actions are selected. Letting the temperature be T, actions are selected according to the probability represented by the following formula.
[0076] P(a|s)={exp(Q(s,a) / T)} / {Σexp(Q(s,b) / T} (Note that b∈A is described below Σ, and its description is omitted in the above formula) Here, a is the action, Q(s,a) is the value when performing action a in state s,
[0077] T is called the temperature in annealing (simulated annealing). If it is high, actions are selected with a probability close to equal probability, and if it is low, it is biased towards the optimal one. As learning progresses, by reducing the value of T, the learning result becomes stable. Such a method for estimating the Q-value may be applied to all of the above-described reinforcement learning and the reinforcement learning to be described later. Also, as a computer for performing machine learning such as reinforcement learning, a general Neumann-type computer is used, but a neural network processor (NNP) may also be used. A large number of "artificial neurons" modeled after real neurons are mounted on the chip of the NNP, and each neuron cooperates with each other in the network. Also, a quantum computer adopting the "quantum annealing method" may be used. In particular, by using a quantum computer adopting the "quantum annealing method", the required time for optimization calculation in machine learning can be significantly shortened.
[0078] Receive an evaluation from the trustee for the result of performing trust subcontracting processing using the personalized AI smart contract learned model in S105. Next, in S106, a process of calculating the reward r based on the received evaluation is performed. Next, in S107, using the borrowed PC resources (computing resources), a process of obtaining the action a according to the optimal policy π * is performed. Next, in S108, execute the contract according to the action a on behalf of the trustee. By receiving an evaluation from the trustee for the result (S105), the processes of S106 to S108 are executed.
[0079] Next, based on FIG. 11(B), the flowchart of the main routine program of the user terminal constituting the nodes of the consortium chain 3 will be described. In S114, IoT sensor data aggregation processing is executed, in S115, smart contract processing is executed, in S116, simulation processing is executed, and in S117, blockchain processing is executed. The specific content of the blockchain processing is as described above based on FIG. 2(A).
[0080] Next, based on FIG. 12(A), the flowchart of the subroutine program of the IoT sensor data aggregation processing shown in S114 will be described. In S120, a process of classifying and grouping IoT sensor data by type, period, region, etc. is performed. This process is performed not only on IoT sensor data but also on data from the wireless sensor network. Next, in S121, a process of determining the value of each grouped data is performed. According to the determined value, the consideration (amount of tokens) for the provision of the data is coded as a smart contract for each corresponding data. Next, in S122, a process of recording each grouped data on the blockchain is performed.
[0081] Next, based on FIG. 13(B), the flowchart of the subroutine program of the smart contract process shown in S115 will be described. By S150, it is determined whether a sales contract with the data requester has been established. This determination is automatically determined to be YES by S150 when the conditions of both parties match regarding the consideration (amount of tokens) for the provision of the data encoded as a smart contract. If it is determined to be NO by S150, the control proceeds to S151, where it is determined whether a lending contract for PC resources has been established, and if not, the process returns.
[0082] If it is determined to be YES by S150, the control proceeds to S152, where the data is transmitted to the address of the requester, and the process of acquiring the tokens as the consideration is performed. The established contract is recorded as a transaction in the blockchain by S153. On the other hand, if a lending contract for PC resources (computing resources) is established, the control proceeds to S154, where the borrowing process of the PC resources (computing resources) is performed, and the contract is recorded as a transaction in the blockchain by S153.
[0083] Next, based on FIG. 12(B), the flowchart of the subroutine program for the simulation process shown in S116 will be described. This simulation process virtually executes (simulates) in a computer, having multiple AI smart contract groups substitute for legal acts such as verification, condition confirmation, execution, performance, and negotiation of contracts that are originally carried out among multiple people, and verifies what kind of simulation results will occur under certain conditions. Specific examples of the above-mentioned "certain conditions" include policies and laws that the government is trying to adopt (for example, reduced tax rates accompanying consumption tax increases, revised immigration control laws, the United Kingdom's withdrawal from the EU (European Union), partial or full adoption of basic income, amendment of Article 9 of the Japanese Constitution, etc.), marketing-related conditions (for example, setting prices or consideration for new products (including financial products and life insurance) and new services, promotion effects by various media, etc.), investment market-related conditions (for example, weather conditions in futures trading, monetary tightening policies in the stock market, etc.), and the like.
[0084] It is determined by S134 whether there is a request for simulation. If not, the process returns. If it is determined by S134 that there is a request for simulation, the control proceeds to S135 and the AI smart contract group generation process is executed.
[0085] The flowchart of the subroutine program for this AI smart contract group generation process will be described based on FIG. 13(A). By S144, a process of setting a group of personas that match the requested simulation is performed using the PC resources (computing resources) being borrowed. A persona is generally defined as a virtual person representing the typical target image of a company, product, or service. In this embodiment, a persona is defined as a virtual person representing the typical target image of the simulation content. For example, in the case of the simulation of the reduced tax rate accompanying the aforementioned consumption tax increase, personas corresponding to general consumers are set for each group grouped by gender, age, region, annual income, etc.
[0086] The number of personas to be set is a number proportional to the number of users belonging to the group. For example, when the age - based population distribution of the general public is 5% for the 10 - 19 age group, 5% for the 20 - 29 age group, 10% for the 30 - 39 age group, 10% for the 40 - 49 age group, 20% for the 50 - 59 age group, 20% for the 60 - 69 age group, 20% for the 70 - 79 age group, 5% for the 80 - 89 age group, and 5% for the 90 - 99 age group, the number of personas representing the 10 - 19 age group is set to 1, the number of personas representing the 20 - 29 age group is set to 1, the number of personas representing the 30 - 39 age group is set to 2, the number of personas representing the 40 - 49 age group is set to 2, the number of personas representing the 50 - 59 age group is set to 4, the number of personas representing the 60 - 69 age group is set to 4, the number of personas representing the 70 - 79 age group is set to 4, the number of personas representing the 80 - 89 age group is set to 1, and the number of personas representing the 90 - 99 age group is set to 1.
[0087] Next, in S145, a process of selecting user groups belonging to each persona is performed using the borrowed PC resources (computing resources). Next, in S146, a process of group - pinning the user groups belonging to each persona and collecting the transaction data of the user groups from the blockchain for each group is performed. For example, in the case of the simulation of the reduced tax rate accompanying the aforementioned consumption tax increase, the user groups are grouped by gender, age, region, annual income, etc., and the transaction data of the user groups is collected from the blockchain for each group. Next, in S147, a process of performing machine learning using the borrowed PC resources (computing resources) with the transaction data as learning data and generating a learned AI smart contract for each persona is performed. The number of these AI smart contracts generated is the same as the number of set personas corresponding to them. As a result, an environment for executing the simulation is prepared, and the simulation is performed within that environment.
[0088] Return to FIG. 12(B), and each AI smart contract generated as described above executes a contract (legal act) in accordance with act a (S136). This "act a" is the act a as a result of the reinforcement learning according to S138. Next, in S137, a process of recording the contracts established between the AI smart contracts on the blockchain is performed. Further, the change situation of the situation due to the progress of the simulation is recorded on the blockchain. For example, in the case of the simulation of the reduced tax rate accompanying the aforementioned consumption tax increase, how the domestic demand and the economy have changed as the simulation progresses is recorded on the blockchain.
[0089] Next, in S138, using the borrowed PC resources (computing resources), the reward r is calculated based on the established contract content, and the process of obtaining the act a according to the optimal policy π * by TD learning is performed. Then, it is determined in S whether the simulation has ended. If it has not ended yet, the control returns to S136, and the reinforcement learning is advanced by repeatedly circulating S137 → S138 → S139 → S136. When the simulation ends and it is determined as YES in S139, the control proceeds to S140, and after the process of deriving the simulation result is performed, it returns.
[0090] As a specific example of the process for deriving simulation results, for example, in the case of a simulation of economic fluctuations accompanying the adoption of a reduced tax rate due to a consumption tax hike, it is derived how each item of the economic trend index has changed as a result of the simulation. In the case of a simulation accompanying a monetary tightening policy in the stock market, it is derived how the stock market has changed as a result of the simulation. Further, a simulation optimization method may be adopted in which the optimal form of the reduced tax rate is determined while varying the specific form of the reduced tax rate accompanying the consumption tax hike (for example, what items are subject to the reduced tax rate and the reduced tax rate for each item subject to the reduced tax rate, etc.) in a plurality of forms. In this case, as the optimal form of the reduced tax rate, (tax revenue increase rate (%) + diffusion index (DI) as the economic trend index / 50) is set as the expected value E, and a simulation result that maximizes the expected value E is obtained. Let the control parameter (the form of the reduced tax rate) in the simulation be θ, the result of the simulation be Y(θ), and θ in maxE[Y(θ)] be obtained. As a specific method for optimizing such a simulation, for example, the particle swarm optimization method (PSO), which is a metaheuristic algorithm, DFO (derivative free optimization) for obtaining an optimal solution in a situation where it is difficult to analytically represent the objective function or information regarding the differentiation of the objective function cannot be used, etc. are used. Note that the recording on the blockchain by S137 does not necessarily have to be performed. In that case, in the above-described cooperation type, the "AI smart contract" in S135, S136, and S147 is changed to "cooperation-use AI". That is, in the case of a simulation in a computer, since it does not involve the execution of a contract (juridical act) in the real world, when the recording on the blockchain is not performed, there is no need to use a smart contract specifically, because it is sufficient for each cooperation-use AI to execute action a and perform reinforcement learning. [Modified Example]
[0091] (1) The certified business operator 17 has the encrypted personal information E of the user K1It stores (personal information), but instead, it may directly record E, which is encrypted personal information, on the blockchain. K1 It may directly record (personal information) on the blockchain.
[0092] (2) Transaction data other than personal information, such as Transaction C and Transaction F in FIG. 2, may also be encrypted with a key K1 or the like and recorded on the blockchain in the same manner as personal information.
[0093] (3) In the above description, the operation processes of the nodes 19 in each blockchain network 2, 3, and 4 are shown. However, the operation processes shown for the nodes 19 in the private blockchain 2 may be performed by the nodes 19 in the other blockchain networks 3 and 4. The operation processes shown for the nodes 19 in the consortium blockchain 3 may be performed by the nodes 19 in the other blockchain networks 2 and 4. The operation processes shown for the nodes 19 in the public blockchain 4 may be performed by the nodes 19 in the other blockchain networks 2 and 3. This modification may be similarly applied in the embodiments described later.
[0094] (4) It may perform mining (competition for the right to record) in the blockchain using the borrowed PC resources (computing resources). In this case, the PC resources (computing resources) may be lent at a time unit price as in the first embodiment, or a certain percentage of the benefits (tokens, etc.) obtained by the miner who has succeeded in mining (competition for the right to record) may be distributed (dividends) to the lender of the PC resources (computing resources). The dividend ratio (dividend amount) is controlled to be proportional to the lent amount of the PC resources (computing resources) (number of lent PCs × lending time, etc.).
[0095] (5) It may be possible to borrow (utilize) the above-mentioned PC resources (computing resources), power generated by self-generation, etc., which are the objects of lending (providing), and carry out some project. Specific examples of projects include research and development (for example, artificial intelligence development, machine learning, human genome analysis, new product development, new drug development, etc.), exploration and excavation of rare metals, oil, natural gas, marine resources, etc., space development, etc. can be considered. At this time, the lender (provider) may obtain a consideration (token, etc.) corresponding to the lending amount (providing amount) of the lending (providing) object as in the first embodiment, but a certain percentage of the profit obtained by the project executor (individual, corporation or organization) due to the success of the project may be distributed (allocated) to the resource lender (resource provider). The allocation ratio (allocation amount) is controlled to be proportional to the lending amount (providing amount) of the resources.
[0096] Furthermore, instead of the resource lender (resource provider) receiving the dividend itself, it may be possible to obtain the right to receive the dividend (hereinafter referred to as "dividend enjoyment right"). This dividend enjoyment right may be controlled, for example, so that the lender (provider) obtains it in the form of a token issued by the project executor. Then, the lender (provider) may control so that the obtained dividend enjoyment right (token) can be transferred to others at a price (token) corresponding to the market price at that time. By configuring in this way, the dividend enjoyment right (token) can be operated as if it were a stock transaction in the secondary market in the stock market.
[0097] (6) In S71, the personalized learned model generated is sent and delivered to the address of the orderer, but in addition to or instead of that, the generated personalized learned model may be utilized to provide a personalized service to the orderer.
[0098] (7) In the foregoing description, verification, condition confirmation, execution, enforcement, and negotiation of contracts are automated by smart contracts. However, control may be performed to request the commitment of the user himself / herself before concluding and executing a contract (legal act such as a transaction). Also, instead of requesting the commitment of the user himself / herself for all contracts (legal acts such as transactions), it may be determined whether a contract (legal act such as a transaction) is a predetermined important contract, and control may be performed to request the commitment of the user himself / herself when it is determined that the contract (legal act such as a transaction) is an important contract. Further, it may be determined whether a contract (legal act such as a transaction) requires urgent conclusion and execution, and when it is determined that the contract (legal act such as a transaction) requires urgent conclusion and execution, control may be performed to conclude and execute the contract (legal act such as a transaction) without obtaining the commitment of the user himself / herself and report it to the user himself / herself later. This modification may be similarly applied in the embodiments described later.
[0099] (8) The above-described program operating on the user terminal 16 and various servers constituting the node 19 of each blockchain may be downloaded and installed from a predetermined website or the like. However, for example, it may be recorded on a recording medium (non-transitory recording medium) such as a CD-ROM 99 and distributed, and the person who purchased the CD-ROM 99 or the like may install the program on the user terminal 16 and various servers (see FIG. 60).
[0100] (9) In the foregoing description, the centralized oracle 21 is adopted. However, a decentralized oracle that is distributed and managed throughout the network may be adopted. Information collected by a plurality of oracles distributed throughout the network is gathered to extract average information, and the average information is regarded as correct information and incorporated into the blockchain for use in smart contracts. This is based on the theory proposed by James Suroweicki in the book "The Wisdom of Crowds" that "by gathering information in a group, the conclusion reached by the group can lead to a better conclusion than the conclusion of any individual in the group." Then, an incentive for operating the decentralized oracle is provided by giving a reward such as a token to the oracle that collected information close to the average information.
[0101] In summary, there are an extraction means for collecting information collected by a plurality of oracles distributed on a network and extracting average information, an adoption means for adopting the average information extracted by the extraction means, and a reward granting means for granting a reward to the oracle. The plurality of oracles include a first oracle and a second oracle, and the reward granting means grants more rewards to the second oracle that has collected information closer to the average information than the first oracle. Note that the reward given to the first oracle may be 0 or may be negative.
[0102] (10) For the determination of the establishment of one or both of the above-mentioned K2 distribution contract in S13 and the establishment of the personal information provision contract in S16, a function may be provided to determine whether to establish according to the information for identifying the will of the personal information owner himself / herself (hereinafter referred to as "will identification information"). Specifically, when a personal information owner asks to be recommended products or services that match himself / herself in a physical store, an e-commerce mall, etc., by having the specific information of his / her own mobile terminal (smartphone, IC card, etc.) read and entering a password for establishing a contract to indicate that it is okay, the will identification information consisting of the specific information and the password is notified to the smart contract of the personal information owner, and the smart contract determines according to the will identification information.
[0103] By doing so, the user can utilize the personal information retrieved from an operator such as an SNS and placed under his / her own management for his / her own purposes according to his / her own will. [Second Embodiment]
[0104] Next, the second embodiment will be described. This second embodiment responds to the need for the right to delete personal information (so-called the right to be forgotten) to delete one's own personal information by applying encryption technology to the personal information recorded using blockchain. Blockchain is characterized in that once recorded information cannot be tampered with or it is extremely difficult to tamper with. Therefore, it is impossible or extremely difficult to delete the once recorded information (hereinafter referred to as "impossibility of deletion"). On the other hand, the GDPR (General Data Protection Regulation) in Europe requires guaranteeing the right to delete personal information (so-called the right to be forgotten) that the personal information owner can delete the recorded personal information. There is a direct confrontation and an antinomic dilemma between this requirement of the right to delete personal information in the GDPR and the impossibility of deletion in blockchain. That is, this second embodiment resolves the dilemma in which the requirement to guarantee the right to delete the information to be deleted and the impossibility of deletion are antinomic. The outline will be described based on FIG. 14.
[0105] FIG. 14(A) shows the normal state in which the right to delete is not exercised, and FIG. 14(B) shows the state in which the information has been made unreadable by exercising the right to delete. Referring to FIG. 14(A), an information holder (also referred to as an information owner) 40 double-encrypts the information using two split common keys KA and KB. Expressed by the formula, it is E KA (E KB (information)). Next, the encrypted information E KA (E KB (information)) is recorded on a blockchain or the like. Note that the split common key KA is stored in a user terminal or the like of the information holder 40 in a confidential state.
[0106] In this state, when an information requester 41 requests information from the information owner 40, the information owner 40 decrypts the recorded encrypted information E KA (E KB (information)) with the key KA. Expressed by the formula, D KA (E KA (E KB (information)) = E KB (information). And this E KB(Information) and the split common key KB are sent by the information provider 40 to the information requester 41.
[0107] The information requester 41 that has received them decrypts the received E KB (Information) with the received split common key KB. Expressed by the formula, D KB (E KB (Information)) = Information. Thus, the information requester 41 can obtain the plaintext information.
[0108] Next, the state where the information is made indecipherable by exercising the deletion right will be described based on FIG. 14(B). The information provider 40 updates one of the split keys KA and KB used for encrypting the information to be made indecipherable to a random number R (≠KA). Next, when the information requester 41 that already stores the split common key KB requests information from the information provider 40, the information provider 40 decrypts the encrypted information E KA (E KB (Information)) with the key R (random number). Expressed by the formula, D R (E KA (E KB (Information)). Then, this D R (E KA (E KB (Information)) is sent by the information provider 40 to the information requester 41.
[0109] The information requester 41 that has received it decrypts D R (E KA (E KB (Information)) with the split common key KB that it already stores. Expressed by the formula, D KB (D R (E KA (E KB(Information)) ≠ Information. In this way, in the indecipherable state, even the information requester 41 that already stores the split common key KB cannot obtain the plaintext information, and it is possible to resolve the dilemma where the request to guarantee the deletion right of the information to be deleted and the impossibility of deletion are in antinomy. If copy prohibition processing is performed so that information such as personal information recorded in a blockchain or the like cannot be copied & pasted, the guarantee of the right to delete information will be more complete. Note that it is not necessary to limit to double encryption using two keys KA and KB, and multiple encryption using three or more keys (n keys) may be used. In this case, by replacing at least any one of the n keys with a random number R, it becomes an indecipherable state.
[0110] The outline of the second embodiment described above will be described in more detail. Regarding the common points with the first embodiment, repeated explanations will be omitted, and mainly the differences will be described. FIG. 15 corresponds to FIG. 2 in the first embodiment. Referring to the transaction I in the blockchain, in this second embodiment, the encrypted personal information E KA (E KB (personal information)) is directly recorded in the block. Therefore, the certified operator 17 is unnecessary in the second embodiment. Here, KA and KB are split common keys.
[0111] Next, referring to FIG. 16, a flowchart of the main routine of the user terminal constituting the node 19 of the private blockchain 2 and the user terminal 16 constituting the node of the public blockchain 4 will be described. This main routine omits the flowchart of the operation processing shown in the first embodiment, and shows only the flowchart of the operation processing added or changed to the operation processing shown in the first embodiment. In the user terminal 16 constituting the node of the public blockchain 4, personal information recording processing to the blockchain is performed by S160, recording indecipherable processing is performed by S161, and personal information providing processing is performed by S162. In the user terminal constituting the node 19 of the private blockchain 2, personal information acquisition processing is performed by S170.
[0112] The personal information recording process on the blockchain is a process of recording personal information on the blockchain. The record decryption prevention process is a process for making information indecipherable by exercising the right of deletion. The personal information providing process is a process in which the user terminal 16 of the public blockchain 4 provides personal information to the user terminal of the private blockchain 2. The personal information obtaining process is a process in which the user terminal of the private blockchain 2 obtains personal information from the user terminal 16 of the public blockchain.
[0113] Based on FIG. 17(A), a flowchart of a subroutine program for the personal information recording process on the blockchain will be described. In S174, a process of generating two random numbers is performed. For example, in the case of DES, two 56-bit random numbers are generated, and these 56-bit random numbers are used as the split common keys KA and KB. In the case of ADS, two 128-bit random numbers are generated, and these 128-bit random numbers are used as the split common keys KA and KB.
[0114] Next, in S177, the process of recording E KA (E KB (personal information)), E K2 (index + consideration for personal information provision), and the ciphertext identifier on the blockchain is performed. This ciphertext identifier is an identifier for specifying the encrypted personal information E KA (E KB (personal information)), and corresponds to the electronic ID in the first embodiment.
[0115] Next, in S183, KA and KB are associated with the ciphertext identifier and stored in the HDD 12 of the user terminal 16.
[0116] Next, based on FIG. 17(B), a flowchart of a subroutine program for the record decryption prevention process will be described. In S190, the ciphertext recorded on the blockchain (for example, E KA (E KBIt is determined whether there is a ciphertext that needs to be made indecipherable among (personal information), etc. If not, the process returns. However, if there is a ciphertext that needs to be made indecipherable, the control proceeds to S191, and a process of searching for the split common key KA stored in association with the ciphertext identifier of the ciphertext from the HDD12 is performed.
[0117] Next, a random number R is generated by S192. For example, in the case of DES, a 56-bit random number is generated. In the case of ADS, a 128-bit random number is generated. Next, it is determined by S193 whether the generated random number R = KA. If the generated random number R is the same as the split common key KA stored in the HDD12, the control returns to S192 and the random number is generated again. If it is determined as NO by S193, the control proceeds to S194, and a process of updating the split common key KA stored in the HDD12 with R is performed.
[0118] Next, based on FIG. 18, a flowchart of a subroutine program for personal information providing processing and personal information obtaining processing will be described. At the user terminal of the private chain 2, it is determined by S198 whether the split common key KB of the personal information desired to be obtained is already stored. If the split common key KB of the personal information desired to be obtained has already been distributed from the user terminal 16 of the public chain 4 to the user terminal of the private chain 2, it is determined as stored by S198 and the control proceeds to S203. However, if it has not been stored yet, the control proceeds to S199.
[0119] In S199, a process of transmitting the ciphertext identifier of the personal information desired to be obtained to the user terminal 16 of the public chain 4 and requesting the split common key KB is performed. At the user terminal 16 of the public chain 4 that received it in S200, it is determined by the smart contract whether to perform a transaction of providing the personal information specified by the ciphertext identifier (see S16). If a transaction of providing the personal information is to be performed, a signature agreeing to the provision of the personal information and the split common key KB corresponding to the ciphertext identifier are returned by S201.
[0120] At the user terminal of the private chain 2 that received it in S202, in S203, the signature and the ciphertext identifier of the personal information to be obtained are transmitted to the user terminal 16 of the public chain 4. At the user terminal 16 of the public chain 4 that received it in S206, it is determined by the smart contract whether to conduct a transaction to provide the personal information specified by the ciphertext identifier (see S16). When conducting a transaction to provide the personal information, in S207, D KA (Encrypted personal information) or D R (Encrypted personal information) is calculated and the reply process is performed. Specifically, when the split common key KA stored in the HDD 12 of the user terminal 16 has already been updated to the random number R, D R (Encrypted personal information) is calculated and replied, but when it has not yet been updated to the random number R, D KA (Encrypted personal information) is calculated and the reply process is performed.
[0121] At the user terminal of the private chain 2 that received the reply from the user terminal 16 of the public chain 4 in S208, in S209, D KB (D KA (Encrypted personal information)) = plaintext or D KB (D R (Encrypted personal information)) ≠ plaintext is calculated. Specifically, when receiving D KA (Encrypted personal information), D KB (D KA (Encrypted personal information)) = D KB (D KA (E KA (E KB (Personal information)))) = plaintext is calculated to obtain the plaintext personal information. On the other hand, when receiving (D R (Encrypted personal information)), D KB (D R (Encrypted personal information)) = D KB (D R (E KA (E KB(Personal information))))≠Plaintext will be calculated, and the plaintext personal information cannot be obtained. Thus, it is possible to solve the dilemma in which the requirement to guarantee the right to delete the information to be deleted and the impossibility of deletion are in antinomy. [Modification Example]
[0122] (1) In the above description, the encrypted personal information E KA (E KB (Personal information) was directly recorded on the blockchain, and if this large amount of encrypted personal information was stored in each node (all nodes in the public blockchain 4), there would be the inconvenience that each node (user terminal) would be required to have a huge storage capacity. As a means to solve this, an application of a secret sharing technology for storing divided data on multiple computers is adopted. The data is divided and fragmented, and each fragmented data is distributed and stored in multiple nodes. Also, the data stored in each node is made redundant (duplicated) and stored. By providing sufficient redundancy, even if a part of the fragmented data is lost, there will be no problem in restoration, and the difficulty of tampering as a blockchain can also be ensured. Furthermore, control may be performed so that the storage amount responsible for storing the fragmented data is determined by the intention of each node, and a corresponding price is given to each node in the form of a token or the like according to the storage amount to be borne.
[0123] (2) In the above description, the encrypted personal information E KA (E KB (Personal information) was directly recorded on the blockchain, but in the modification examples shown in FIGS. 19 to 23, the encrypted personal information E KA (E KB (Personal information)) is stored in the personal information DB 29 of the certifying operator 17, and the hash value of the encrypted personal information is recorded on the blockchain. In the transaction I shown in FIG. 19(A), the hash value of E KA (E KB (Personal information)) + E K2 (Index + provided with 2.4 tokens) + ciphertext identifier and digital signature are recorded. Also, in the personal information DB 29 of the certifying operator 17 shown in FIG. 19(B), the encrypted personal information E KA (E KB(Personal information) is stored.
[0124] Based on FIG. 20, a flowchart of the main routine of the user terminal constituting node 19 of private chain 2, the user terminal 16 constituting node 19 of public chain 4, and the server 18 of the certification business operator 17 in this modification will be described. The server 18 of the certification business operator 17 participates in the blockchain as node 19. The personal information recording process to the blockchain is executed by S215, the recording decoding impossible process is executed by S216, the personal information providing process is executed by S217, the hash value recording process is executed by S220, the encrypted text transmission process is executed by S221, and the personal information obtaining process is executed by S224.
[0125] The personal information recording process to the blockchain is a process in which the user terminal 16 constituting node 19 of public chain 4 transmits the encrypted personal information E KA (E KB (personal information)) to the server 18 of the certification business operator 17. The hash value recording process is a process in which the server 18 of the certification business operator 17 that has received the encrypted personal information E KA (E KB (personal information)) etc. stores it and generates its hash value and records it in the blockchain. The recording decoding impossible process is a process for making the encrypted text of the encrypted personal information E KA (E KB (personal information)) etc. undecipherable. The personal information providing process is a process executed by the user terminal 16 constituting node 19 of public chain 4 to provide personal information to the user terminal constituting node 19 of private chain 2. The personal information obtaining process is a process in which the user terminal constituting node 19 of private chain 2 obtains personal information. The encrypted text transmission process is a process in which the server 18 of the certification business operator 17 transmits the encrypted text of the encrypted personal information E KA (E KB (personal information)) etc. to the user terminal constituting node 19 of private chain 2.
[0126] The details of each process will be described below based on the flowcharts of each subroutine program. The differences from the second embodiment will be mainly described.
[0127] Based on FIG. 21, the flowchart of the subroutine program for personal information recording processing and hash value recording processing on the blockchain will be described. By S231, E KA (E KB (personal information)) and E K2 (index + consideration for providing personal information) are transmitted to the server 18 of the certified operator 17. At the server 18 that received it at S240, by S241, E KA (E KB (personal information)) generates a hash value and a ciphertext identifier. Next, by S242, E KA (E KB (personal information)) hash value, E K2 (index + consideration for providing personal information), and the ciphertext identifier are recorded on the blockchain.
[0128] Next, by S243, the ciphertext identifier is transmitted to the user terminal 16 of the public chain 4. At the user terminal 16 of the public chain 4 that received it at S232, by S233, the split keys KA and KB are associated with the received ciphertext identifier and stored in the HDD 12. At the server 18 of the certified operator 17, by S244, E KA (E KB (personal information)) and the ciphertext identifier are associated and stored in the personal information DB 29.
[0129] The recording and non-decryptable processing shown in FIG. 22 is the same as that already described in FIG. 17(B) of the second embodiment, so the repeated description will be omitted.
[0130] Next, based on FIG. 23, a flowchart of a subroutine program for personal information providing process, personal information obtaining process, and encrypted text transmitting process will be described. In this modification, when the user terminal of private chain 2 receives from the user terminal 16 of public chain 4 a signature consenting to the provision of personal information and a split common key KB corresponding to the encrypted text identifier (S264), in S265, it transmits the received signature and the encrypted text identifier of the personal information to be obtained to the server 18 of the certifying operator 17. In the server 18 of the certifying operator 17 that receives it in S266, in S267, after confirming the signature, a process is performed of searching the personal information DB29 for the encrypted text corresponding to the encrypted text identifier and transmitting it to the user terminal 16 of public chain 4.
[0131] In the user terminal 16 of public chain 4 that receives it in S268, in S269, D KA (Encrypted personal information) or D R (Encrypted personal information)) is calculated and a process of replying to the user terminal of private chain 2 is performed. Specifically, when the split common key KA stored in the HDD 12 of the user terminal 16 has already been updated to R, D R (Encrypted personal information) is calculated and replied, but when it has not yet been updated to R, a process of calculating D KA (Encrypted personal information) and replying is performed.
[0132] In the user terminal of private chain 2 that receives the reply from the user terminal 16 of public chain 4 in S270, in S271, D KB (D KA (Encrypted personal information)) = plaintext or D KB (D R (Encrypted personal information)) ≠ plaintext is calculated. Specifically, when D KA (Encrypted personal information) is received, D KB (D KA (Encrypted personal information)) = D KB (D KA (E KA (E KB (Personal information)))) = plaintext is calculated to obtain the plaintext personal information. On the other hand, (DR When receiving (encrypted personal information), D KB (D R (encrypted personal information)) = D KB (D R (E KA (E KB (personal information))) ≠ plaintext will be calculated, and the plaintext personal information cannot be obtained. Thus, it is possible to solve the dilemma in which the requirement to guarantee the deletion right of the information to be deleted and the impossibility of deletion are in antinomy.
[0133] Note that the server 18 of the certified operator 17 may be connected to the user terminals of the private chain 2 and the user terminals of the public chain 4 via the Internet 1 without participating in the blockchain as the node 19.
[0134] (3) In the above description, the split common key KA was held by the personal information owner (stored in the HDD 12 of the user terminal 16), but instead, the split common key KA may be registered in the key DB 32 of the key registration center 30, an example of a predetermined institution (third - party institution). Note that the split common key KA is stored in the key DB 32 in a confidential state. This modification example will be described with reference to FIGS. 24 to 27.
[0135] Referring to FIG. 24, the server 31 of the key registration center 30 is connected to the Internet 1. In the key DB 32 connected to the server 31, for each address of the users who are the nodes 19 of the public chain 4, the ciphertext identifier and the split common key KA are stored in association with each other. And if there is a request for record decryption incapacitation from the user, the split common key KA stored in association with the ciphertext identifier corresponding to the record for which the request was made is updated with the random number R. In FIG. 24, the split common key stored in association with the ciphertext identifier 307cd4 of the address 0x6079dd is updated with the random number 1R2, the split common key stored in association with the ciphertext identifier 4arb56 of the address 0x6080dd is updated with the random number 2Rn, and the split common key stored in association with the ciphertext identifier e2c87r of the address 0x6978dd is updated with the random number mR1.
[0136] Next, based on FIG. 25, a flowchart of the main routine of the user terminal 16 of the public chain 4, the server 31 of the key registration center 30, and the user terminal of the private chain 2 will be described. Regarding the common points with the second embodiment, repeated explanations will be omitted, and mainly the differences will be described.
[0137] In the user terminal 16 of the public chain 4, the personal information recording process on the blockchain is executed by S468, the recording decryption prevention request process is executed by S469, and the decryption key providing process is executed by S470. In the server 31 of the key registration center 30, the key registration process is executed by S463, the recording decryption prevention process is executed by S464, and the data decryption process is executed by S465. In the user terminal of the private chain 2, the data acquisition process is executed by S460.
[0138] Next, based on FIG. 26(A), a flowchart of the subroutine program of the personal information recording process and the key registration process on the blockchain will be described. In the user terminal 16 of the public chain 4, by S479, E KA (E KB (personal information)), E K2 (index + consideration for personal information provision), and the ciphertext identifier are recorded on the blockchain. By S480, the process of transmitting the split common key KA and the ciphertext identifier to the key registration center 30 is performed.
[0139] In the server 31 of the key registration center 30 that receives it at S474, by S475, the process of associating the received split common key KA and the ciphertext identifier and storing them in the key DB32 is performed.
[0140] Next, based on FIG. 26(B), the flowchart of the subroutine programs for the unreadable recording request process and the unreadable recording process will be described. In the user terminal 16 of the public chain 4, it is determined by S494 whether there is a ciphertext to be made unreadable. If not, the process returns. If there is, the process of transmitting the ciphertext identifier for which unreadability is requested to the server 31 of the key registration center 30 is performed by S495.
[0141] In the server 31 of the key registration center 30 that received it at S485, the process of searching for the split common key KA stored in association with the received ciphertext identifier from the key DB32 is performed. Next, a random number R is generated by S487, and it is determined by S488 whether the random number R = KA. If R = KA, the random number R is regenerated again by S487. When R ≠ KA, the process of updating the split common key KA to R is performed by S489.
[0142] Next, with reference to FIG. 27, the flowchart of the subroutine programs for the split common key providing process, the data obtaining process, and the data decrypting process will be described. In the user terminal of the private chain 2, the process of transmitting the ciphertext identifier of the data to be obtained to the server 31 of the key registration center 30 is performed by S503. In the server 31 of the key registration center 30 that received it at S504, the process of searching for the ciphertext (encrypted personal information, etc.) corresponding to the ciphertext identifier from the blockchain is performed by S505. Next, the process of searching for the split common key KA or R corresponding to the ciphertext identifier is performed by S506.
[0143] Next, by S507, D KA (encrypted personal information) or D R (encrypted personal information) is returned to the user terminal of the private chain 2. Specifically, when the split common key KA stored in the key DB32 of the key registration center 30 has already been updated to R, D R (encrypted personal information) is calculated and returned. When it has not yet been updated to R, the process of calculating and returning D KA (encrypted personal information) is performed.
[0144] At the user terminal of the private chain 2 that received it at S509, at S510, D KA (D KB (Encrypted personal information)) = plaintext, or D KA (D R (Encrypted personal information)) ≠ plaintext is calculated. Specifically, when D KA (Encrypted personal information) is received, D KB (D KA (Encrypted personal information)) = D KB (D KA (E KA (E KB (Personal information)))) = plaintext is calculated to obtain the plaintext personal information. On the other hand, when (D R (Encrypted personal information)) is received, D KB (D R (Encrypted personal information)) = D KB (D R (E KA (E KB (Personal information)))) ≠ plaintext will be calculated, and the plaintext personal information cannot be obtained. Thus, it is possible to solve the dilemma in which the requirement to guarantee the deletion right of the information to be deleted and the impossibility of deletion are in antinomy. Moreover, since the process of updating the split common key KA to R is performed at the key registration center 30, it is easy to ensure the reliability that KA has been updated to R and the deletion right is guaranteed. For example, there is an advantage that it is easy to perform the update of KA to R under the supervision of a predetermined institution.
[0145] (4) As another method of solving the dilemma in which the requirement to guarantee the deletion right of the information to be deleted and the impossibility of deletion are in antinomy, E, which is the encrypted personal information stored in the personal information DB29 of the certified operator 17 KA (E KBIt may be possible to delete (personal information) in response to a request from the owner of the personal information. In that case, although the hash value of the personal information is recorded on the blockchain, there will be a contradictory state where the corresponding personal information is not stored in the personal information DB29. However, if this contradiction can be tolerated, deleting personal information can also be an effective means.
[0146] (5) The information guaranteeing the right to delete is not limited to personal information. For example, it can be any information such as posting information to SNS or blogs (including data of posted photos and videos), notarized documents such as wills and voluntary guardianship contracts, personal documents and articles of incorporation of companies, etc., which require a definite date. Also, in the second embodiment, the information guaranteeing the right to delete was recorded using the blockchain, but the blockchain is just an example, and other means can be used for recording.
[0147] (6) The above-described programs operating on the user terminals 16 and various servers constituting the node 19 of each blockchain may be downloaded and installed from a predetermined website or the like. However, for example, they may be recorded on a recording medium (non-transitory recording medium) such as a CD-ROM 99 and distributed, and those who purchase the CD-ROM 99 or the like may install the program on the user terminal 16 and various servers (see Fig. 60).
[0148] (7) In the above description, double encryption is performed by encrypting once with the split common key KA and then encrypting again with the split common key KB, and double decryption is performed by decrypting once with the split common key KB and then decrypting again with the split common key KA to obtain the plaintext. However, it is not limited to this, and encryption with the split common key KA or KB may be performed multiple times, and decryption with the split common key KA or KB may be performed multiple times. Furthermore, the split common keys KA and KB are not limited to two, and three or more split common keys may be used.
[0149] Furthermore, the exclusive logical sum (exclusive OR) of the split common keys KA and KB is calculated to generate one key K (KA(+)KB = K), and the personal information is encrypted with that key K (E K (personal information)). The split common key KA is registered in the key DB32 of the key registration center 30, and the split common key KB is distributed to the requester of the personal information. The personal information owner who has received the request from the requester of the personal information transmits the encrypted personal information to the server 31 of the key registration center 30, and the requester of the personal information transmits the distributed split common key KB to the server 31 of the key registration center 30. In the server 31 of the key registration center 30, the exclusive logical sum (exclusive OR) of the received split common key KB and the split common key KA registered in the key DB32 is calculated to generate one key K (KA(+)KB = K), and the received encrypted personal information (E K (personal information)) is decrypted with that key K to obtain plaintext (D K (E K (personal information)) = plaintext), and the plaintext personal information may be transmitted to the requester of the personal information. The above (+) represents the exclusive logical sum (exclusive OR) in symbols.
[0150] Note that the exclusive logical sum (exclusive OR) is just an example, and any algorithm may be used as long as it generates one key K from the split common keys KA and KB.
[0151] Also, in the case of the above method of generating the key K using an additive group such as exclusive OR (XOR), there is an advantage that the split common keys KA and KB can be periodically updated to maintain security. For example, when one of the split common keys KA is updated to KC, the other split common key KB = K(+)KC, which can be obtained by calculation. By updating the split common keys KA and KB in this way, not only can we counter the leakage of the split common keys, but also prevent the personal information requester who has once distributed the split common key KB from decrypting the encrypted personal information on the blockchain again to view it. By performing such an update of the split common key every time the split common key KB is distributed once, even if the person who has received the distributed split common key KB leaks it to others, it is possible to make the encrypted personal information on the blockchain undecipherable by the person who has received the leakage. That is, the distributed split common key KB can be made into a one-time key that can be used only once.
[0152] Also, it is not limited to the common key, and public key cryptosystems such as RSA and elliptic curve cryptography may be used.
[0153] Also, in realizing the above key update, an encryption algorithm that satisfies the following conditions may be adopted. Let the plaintext be M, its ciphertext be C, and the encryption keys be KA, KB, KC, and KD, E KA (E KB (M)) = E KC (E KD (M)) = C An algorithm for which the equation holds.
[0154] When such an algorithm is a symmetric key encryption algorithm, when the split symmetric keys KA and KB are updated to KC and KD, the plaintext M can be obtained by decrypting the ciphertext C recorded in the blockchain with the split symmetric keys KC and KD. On the other hand, in the case of a public key encryption algorithm, when the private keys KA and KB are updated to KC and KD, the plaintext M can be obtained by decrypting the ciphertext C recorded in the blockchain with the pair of public keys PKC and PKD corresponding to the private keys KC and KD. (8) In the above description, the information holder transmits the encrypted personal information (D KA (encrypted personal information)) or D R (encrypted personal information)) and the split symmetric key KB to the information requester (S201, S207), and the information requester himself / herself decrypts the encrypted personal information into plaintext using the split symmetric key KB (S209). However, the decryption using the split symmetric key KB may be performed by a third-party institution (a predetermined service institution). In this case, the information holder transmits the encrypted personal information (D KA (encrypted personal information)) or D R (encrypted personal information)) and the split symmetric key KB to a third-party institution (a predetermined service institution), and the third-party institution (a predetermined service institution) decrypts it and transmits it to the information requester. [Features of the disclosed content]
[0155] Next, the features of the disclosed content of the above-described embodiments are listed below. (Feature 1) [Technical field]
[0156] Feature 1 relates to a processing system and a program for an information recording method such as a blockchain that is difficult to tamper with or erase. [Background art]
[0157] The blockchain has been generally known as an information recording method that is difficult to tamper with or erase. For example, Japanese Patent Application Laid-Open No. 2018-128723 records various information related to cargo transportation using this blockchain. [Outline of Feature 1] [Problem to be Solved by Feature 1]
[0158] However, recording information using such a blockchain is not only difficult to tamper with but also difficult to erase (hereinafter referred to as "irremovability"). As a result, once personal information is recorded using a blockchain, even if the personal information owner wishes to erase the personal information, it cannot be erased, and there is a drawback that the right to erase personal information (so-called the right to be forgotten) is impaired.
[0159] That is, there is a drawback that an antinomy occurs in which the guarantee of the authenticity of the recorded information and the guarantee of the right to delete the information are in conflict.
[0160] Feature 1 was devised in view of such circumstances, and its purpose is to resolve the antinomy in which the guarantee of the authenticity of the recorded information and the guarantee of the right to delete the information are in conflict. [Means for Solving the Problem]
[0161] The subject matter of Feature 1 is shown as items such as the following, for example. (Item 1) Encryption means (for example, S174, S177, or S228, S231, or S478, S479) that performs an encryption process for encrypting information to be recorded (for example, personal information), Recording means (for example, S177 and a blockchain, or S231, S240, S242, S244, a blockchain, and personal information DB29, or S479 and a blockchain) that records the information after the encryption process, Decryption means (for example, S201, S202, S207 to S209, or S263 to S271, or S500 to S510) that performs a decryption process on the information recorded by the recording means using a first key and a second key to obtain plaintext information, Irreversible means (for example, S191 to S194, or S250 to S254, or S494, S495, S485 to S489) that puts the information recorded by the recording means into an irreversible state where it cannot be decrypted, and is provided with The decryption means includes second key concealment holding means (e.g., S194, or S233, or S475) for concealing and holding the second key (e.g., the split common key KA). The decryption disabling means puts the decryption disabling state by updating the second key held by the second key concealment holding means to another value (e.g., random number R) (e.g., S190 - S194, or S250 - S254, or S494, S495, S485 - S489), processing system.
[0162] (Item 2) The decryption means further includes first key distribution means (e.g., S200, S201, or S2562, S263, or S500, S501) for distributing the first key (e.g., the split common key KB) to the information viewer, the processing system according to Item 1. (Item 3) The processing system according to Item 1 or 2 further includes search means (e.g., S37 - S40, S42 - S45) for searching the information recorded by the recording means without decrypting it into plain text.
[0163] (Item 4) The information recorded by the recording means includes personal information. The decryption disabling means puts the personal information of the personal information owner into the decryption disabling state in response to the request of the personal information owner (e.g., S190 - S194, or S250 - S254, or S494, S495, S485 - S489), the processing system according to any one of Items 1 - 3.
[0164] (Item 5) Steps of performing an encryption process for encrypting information to be recorded (e.g., personal information) (e.g., S174, S177, or S228, S231, or S478, S479), and A decryption step (e.g., S201, S202, S207 - S209, or S263 - S271, or S500 - S510) of performing decryption processing on the information recorded by a recording means (e.g., S177 and blockchain, or S231, S240, S242, S244, blockchain and personal information DB29, or S479 and blockchain) that records the information after the encryption processing to obtain plaintext information, A step of making the information recorded by the recording means in an undecipherable state where it cannot be decrypted (e.g., S191 - S194, or S250 - S254, or S494, S495, S485 - S489), Execute on a computer, The decryption step includes a step of secretly holding the second key (e.g., split common key KA) (e.g., S194, or S233, or S475), The step of making it in the undecipherable state makes it in the undecipherable state by updating the second key held by the holding step with another thing (e.g., random number R) (e.g., S190 - S194, or S250 - S254, or S494, S495, S485 - S489), program.
[0165] (Effect of Feature 1) According to Feature 1, it is possible to resolve as much as possible the dilemma in which the guarantee of the authenticity of the recorded information and the guarantee of the deletion right of that information are in antinomy. (Feature 2) [Technical Field]
[0166] Feature 2 relates to, for example, a smart contract used in a blockchain or the like. [Background Art]
[0167] A smart contract is a computer protocol intended for smooth verification, condition confirmation, execution, enforcement, and negotiation of contracts, and has conventionally been used in blockchain and the like. Such smart contracts have been conventionally known as automating contracts, transactions, etc. (for example, Patent No. 6403177). [Summary of Feature 2] [Problems to be Solved by Feature 2]
[0168] In the field of such smart contracts, an advanced smart contract that can execute legal acts such as various contracts represented by sales contracts and lease contracts, or various transactions, etc. on behalf of the user himself / herself is desired.
[0169] The object of Feature 2 devised in view of such circumstances is to provide an advanced smart contract that can execute legal acts on behalf of the user himself / herself. [Means for Solving the Problems] The subject matter of Feature 2 is shown as items such as the following, for example. (Item 1) Machine learning means (for example, S80 to S82) that inputs information on legal acts performed by a plurality of natural persons or legal persons as data for machine learning to generate a general model, Means for personalizing the general model into a model suitable for the user, the personalizing means for personalizing based on information on legal acts performed by the user (for example, S86 to S88, or S94 to S98), Smart contract generation means (for example, S86 to S88, or S94 to S98) that generates a smart contract for executing a legal act on behalf of the user using the personalized model, a computer system comprising the same.
[0170] (Item 2) A personalization means (e.g., S80 to S82, S86 to S88, or S94 to S98) for personalizing a general model generated by inputting information on legal acts performed by multiple natural persons or legal entities as data for machine learning into a model suitable for a user, the personalization being based on information on the legal acts performed by the user; A computer system comprising: a smart contract generation means (e.g., S86 to S88, or S94 to S98) that generates a smart contract using the personalized model to perform legal acts on behalf of the user.
[0171] (Item 3) A personalization means (e.g., S80 to S82, S86 to S88, or S94 to S98) for personalizing a general model generated by inputting information on legal acts performed by multiple natural persons or legal entities as data for machine learning into a model suitable for a user, the personalization being based on information on the legal acts performed by the user; A computer system comprising: a service providing means (e.g., S99) that provides a service that performs legal acts on behalf of the user using the personalized model as a smart contract.
[0172] (Item 4) The computer system described in item 3 further comprises a reinforcement learning means (e.g., S105 to S108) that learns a strategy for maximizing the accumulation of rewards by giving rewards for legal acts performed in connection with the provision of services by the service providing means (e.g., S99) to the model that performed the service.
[0173] (Item 5) A computer system that performs simulations (such as stock trading and futures trading in the investment market, corporate management simulations, or consumer behavior simulations) in a computer for a predetermined theme (for example, assuming that a policy or law adopted by the government (such as a reduced tax rate accompanying a consumption tax increase, the revised Immigration Control Law, the United Kingdom's withdrawal from the EU (European Union), partial or full adoption of basic income, or amendment of Article 9 of the Japanese Constitution, etc.) is adopted), and advances reinforcement learning. Selection means (for example, S344, S345) for selecting a user group belonging to a plurality of personas that match the theme of the simulation. Collection means (for example, S346) for grouping the user group selected by the selection means for each of the plurality of personas and collecting information on legal acts performed by the user group for each group. Generation means (for example, S347) for performing machine learning using the collected information on legal acts as learning data to generate a group of learned smart contract models for each persona. Simulation means (for example, S336~S339) for executing in a computer a simulation of performing legal acts between the generated groups of learned smart contract models. The computer system includes: The simulation means includes reinforcement learning means (for example, S336, S338) for giving a reward for the executed legal act to the learned smart contract model that executed it, so that the learned smart contract model learns a policy for maximizing the accumulation of the reward.
[0174] (Item 6) A computer system that performs simulations in a computer and advances reinforcement learning, A computer system includes reinforcement learning means (e.g., S336, S338) that performs simulation reinforcement learning processing. In the computer, a simulation is executed to perform a legal act between learned smart contract models generated by machine learning, and a reward for the executed legal act is given to the executed learned smart contract model, so that the learned smart contract model learns a strategy for maximizing the accumulation of the reward.
[0175] (Item 7) The computer system according to item 6 further includes selection means (e.g., S340) for selecting a learned smart contract model to be actually used based on the performance of the reinforcement learning result by the reinforcement learning means from among the learned smart contract model group.
[0176] (Note) For the above-mentioned "data for machine learning" for general model generation and "data for machine learning" used for personalization, it is sufficient if it contains "information related to legal acts", and it may also contain information other than "information related to legal acts" (e.g., access history to a website, GPS location information, etc.). The above-mentioned "smart contract generation means" includes, for example, a case where a role as a smart contract is assigned to an artificial intelligence such as a personal assistant machine-learned from information related to legal acts.
[0177] (Effect of Feature 2) According to Feature 2, it becomes possible to provide an advanced smart contract that can execute various legal acts on behalf of the user himself / herself.
[0178] (Feature 3) [Technical Field] Feature 3 relates to a computer system that sets conditions such as policies and laws that the government is trying to adopt (for example, reduced tax rates associated with consumption tax increases, revised immigration control laws, the United Kingdom's withdrawal from the European Union (EU), partial or full adoption of basic income, amendment of Article 9 of the Japanese Constitution, etc.), marketing-related conditions (for example, setting prices and consideration for new products (including financial products and life insurance) and new services, promotion effects by various media, etc.), investment market-related conditions (for example, weather conditions in futures trading, financial tightening policies in the stock market, etc.), and performs simulations in a computer under those conditions to predict in advance what simulation results will be obtained. [Background Art]
[0179] As this type of computer system, in order to clarify the liabilities that the nation will have to bear in the future and the resources that will be available in the future and support decision-making at the policy level, a new balance sheet account for calculating changes in net assets has been set up to clarify the asset changes due to policy decisions in the current year and simulate the future burden on the nation. An accounting method has been proposed (for example, Japanese Patent Laid-Open No. 2006-155233). [Outline of Feature 3] [Problems to be Solved by Feature 3]
[0180] In such a simulation field, a computer system is desired that can execute a simulation in a computer that faithfully mimics the activities of natural persons and corporations in real society and derive a simulation result with minimal deviation from the real world..
[0181] The purpose of Feature 3 conceived in view of such circumstances is to enable a simulation that faithfully mimics the activities of natural persons and corporations in real society. [Means for Solving the Problems]
[0182] The subject of Feature 3 is shown as items such as the following, for example. (Item 1) A computer system that performs simulations in a computer under predetermined conditions (for example, policies and laws that the government is trying to adopt (such as reduced tax rates associated with consumption tax increases, revised immigration control laws, the United Kingdom's withdrawal from the EU (European Union), partial or full adoption of basic income, amendment of Article 9 of the Japanese Constitution, etc.), marketing-related conditions (for example, setting prices and consideration for new products (including financial products and life insurance) and new services, promotion effects by various media, etc.), investment market-related conditions (for example, weather conditions in futures trading, monetary tightening policies in the stock market, etc.)), Selection means (for example, S144, S145) for selecting a user group belonging to a plurality of personas that match the conditions of the simulation, Collection means (for example, S146) for grouping the user group selected by the selection means for each of the plurality of personas and collecting information on legal acts performed by the user group for each group, Generation means (for example, S147) for performing machine learning using the collected information on legal acts as learning data to generate a group of learned smart contract models for each persona, Simulation means (for example, S136~S139) for executing a simulation in a computer of performing legal acts between the generated groups of learned smart contract models, Derivation means (for example, S140) for deriving the results of the simulation by the simulation means, and comprising, The simulation means includes reinforcement learning means (for example, S136, S138) for giving a reward for the executed legal act to the learned smart contract model that executed the act, so that the learned smart contract model learns a strategy for maximizing the accumulation of the reward. A computer system.
[0183] (Item 2) A computer system that performs simulations in a computer, Execute a simulation in a computer to perform legal acts among the learned smart contract model groups generated by machine learning (for example, S144 to S146), and give the reward for the executed legal act to the learned smart contract model that executed it, thereby causing the learned smart contract model to learn a strategy for maximizing the accumulation of the reward. Reinforcement learning means (for example, S136, S138) for advancing the reinforcement learning, Derivation means (for example, S140) for deriving the result of the simulation of performing legal acts among the learned smart contract model groups in which the reinforcement learning by the reinforcement learning means has advanced. A computer system comprising: (Effect of Feature 3)
[0184] According to Feature 3, it becomes possible to perform a simulation that faithfully imitates the activities of natural persons and legal persons in the real world as much as possible. [Third Embodiment]
[0185] Next, the third embodiment will be described. This third embodiment is a system for performing a simulation by using the inside of a mirror world (cyberspace) composed of a digital twin of the real world (real world) as a simulation environment, for example, deriving an optimal solution for predicting the future, deriving an optimal solution for incentive design in a DAO (Decentralized Autonomous Organization), or performing machine learning (for example, reinforcement learning) of AI.
[0186] A digital twin is a digital representation of a real-world entity or system. A mirror world is a mirrored world composed of digital twins in which all information in the physical world (real world), such as real countries, cities, societies, local governments, companies and other organizations, and people, has been digitized. Specifically, the digital twin of a person is composed of an assistant AI (hereinafter referred to as "personal AI") that acquires, as knowledge, a life log such as the actions of the person (both real and virtual actions) and performs machine learning (e.g., reinforcement learning by an agent) to assist the person in performing optimal actions. This reinforcement learning is multi-agent reinforcement learning in which multiple personal AIs cooperate to perform reinforcement learning. The digital twin of an organization such as a company in the real world is composed of the personal AIs of the people who make up the organization, the digital twin of a local government in the real world is composed of the personal AIs of the people who make up the local government, the digital twin of a city in the real world is composed of the personal AIs of the people who make up the city, and the digital twin of a country in the real world is composed of the personal AIs of the people who make up the country.
[0187] In this third embodiment, a mechanism is prepared in which real countries, cities, societies, local governments, companies and other organizations and people in the real world take the lead in participating and cooperating in the construction of a mirror world as a simulation environment. Specifically, by performing various simulations within the mirror world, the personal AIs of the digital twins participating in the simulation are made to perform machine learning (e.g., reinforcement learning), and the learned personal AIs that have been more highly learned are restored (fed back) to the real world. Using the enjoyment of this merit as an incentive, organizations and people such as countries, cities, societies, local governments, and companies in the real world are directed to take the lead in participating and cooperating in the construction of the mirror world.
[0188] Referring to FIG. 28, in a data center 45 where a plurality of mirror world servers (including storage servers) 46 are installed, the data of the mirror world is stored. Since the hardware configuration of the mirror world server 46 is the same as that of the user terminal 16 shown in FIG. 1, the illustration and description thereof are omitted here to avoid repetition. In the digital twin (real country digital twin (e.g., Japan digital twin 53), city digital twin 54, society, local government, organizations such as companies, people, and earth digital twin 52) in which all the information of the real countries (e.g., Japan 49), cities 50, society, local governments, organizations such as companies, people, and the earth 48 in the real world 47 is digitized, the entire mirror world 51 is stored in the data center 45 as digital data.
[0189] In the data center 45, simulation is performed using this mirror world 51 as a simulation environment. For example, an optimal solution foreseeing the future is derived through simulation optimization. Examples of the simulation include transaction simulations in investment markets such as stock trading and futures trading, company management simulations, or consumer behavior simulations, assuming that the policies and laws (e.g., reduced tax rates accompanying consumption tax hikes, revised immigration control laws, the UK's withdrawal from the EU (European Union), partial or full adoption of basic income, amendment of Article 9 of the Japanese Constitution, etc.) that the government is trying to adopt are adopted. Furthermore, simulations of promotions of new products (including financial products and life insurance) and new services through various media may also be possible. The optimal solution derived through simulation optimization is fed back (restored) to the real world to provide the benefits of the optimal solution to the real world. Also, the learned personal AI machine-learned (e.g., reinforcement learning) through simulation is restored to the real world so that tasks can be performed by a more advanced learned personal AI.
[0190] When this personal AI and the smart contract cooperate with each other, the AI smart contract of the cooperation type described above is configured. Note that this data center 45 is connected to the Internet 1 shown in FIGS. 1 and 24. In FIG. 28, various blockchains 2, 3, 4, SNS 19, key registration center 30, etc. are not shown.
[0191] FIG. 29 shows a specific example of the urban digital twin 54 in the mirror world 51. In the city 50 of the real world 47, there are ABC Co., Ltd. 56, Taro 55 who is a person, and Taro's family 56, etc. In the corresponding urban digital twin 54, there are also ABC Co., Ltd. digital twin 59, Taro digital twin (Taro's personal AI) 57, and Taro's family digital twin 58, etc. The urban digital twin data composed of these data is stored in the mirror world server 46. If there are changes (for example, personnel changes, employment or resignation in the company, marriage or childbirth for a person, etc.) in various objects such as ABC Co., Ltd. 56, Taro 55 who is a person, and Taro's family 56 in the real world 49, the corresponding various digital twins will be updated to the changed content. Such urban digital twin data is stored in the data center 45 for each city and becomes the data of the digital twin 53 of Japan. The urban digital twin data in each country is stored in the data center 45 for each city and becomes the digital twin data of each country. All of these digital twin data together form the data of the digital twin 52 of the earth 48.
[0192] As a specific example, in the mirror world server 46, as Taro's digital twin (Taro's personal AI) 57, the name: Taro, AI identification number: 82km9, personal AI data, and Taro's personal data (for example, life log, profile, preference data, electronic medical record data, vital data, etc.) are stored. As Taro's family digital twin 58, the names: Taro, Sakura, Shiro, family composition: husband, wife, eldest son, AI identification numbers: 82km9, 11zk9, gf43y are stored. As the digital twin of ABC Co., Ltd. 59, the names: Taro, Hanako... Saburo, positions: representative director, managing director, department head... ordinary employee, AI identification numbers: 82km9, ba935, 2es14,... 9w1c2 are stored.
[0193] The flowchart of the main routine program between the user terminal 16 and the mirror world server 46 will be described based on FIGS. 30 to 33. Referring to FIG. 30A, the CPU 10 of the user terminal 16 executes a member registration request process S555 for requesting registration to participate in the mirror world 51 as a simulation environment, a simulation preparation response process S556, and a simulation response process S557. The CPU 10 of the mirror world server 46 executes a member registration process 550, a simulation preparation process S551, and a simulation process S552.
[0194] The member registration process and the member registration request process will be described based on FIG. 30B. Both of these processes are for registering members who want to participate as digital twins in a simulation with the mirror world 51 as the simulation environment. In the member registration request process, the CPU 10 of the user terminal 16 determines whether to submit a registration application according to S560. If it is determined not to submit a registration application, this member registration process ends and returns. If it is determined to submit a registration application, in S561, the predetermined matters necessary for the registration application are sent to the mirror world server 46, and if there is a person without a personal AI, the fact and the person's blockchain address are also sent to the mirror world server 46. The predetermined matters necessary for the registration application are specifically, in the digital twin of a person, the AI identification number and personal AI data of the person's personal AI, in the digital twin of a family, the family name, family composition, and each AI identification number, and in the digital twin of a company, the names, positions, and each AI identification number of the employees, etc.
[0195] The CPU 10 of the mirror world server 46 that receives it according to S565 determines whether it already owns a personal AI in S566. If the information "not having a personal AI" is included in the information sent by S561, the control proceeds to S567 to perform the generation and sales process of the personal AI. If the information "not having a personal AI" is not included, the control proceeds to S568 to register the predetermined matters including the AI identification number sent by S562 in the mirror world 51.
[0196] The generation and sales process of the personal AI shown in S567 will be described based on FIG. 31. The CPU 10 of the mirror world server 46 collects, from the blockchain, the transaction data recorded at the blockchain address (the blockchain address of a user who does not have a personal AI) received in S565 and the posted data such as SNS in S573. Next, in S574, machine learning is performed using the transaction data and the posted data such as SNS as learning data to generate a learned personal AI. Next, in S575, the learned personal AI is sold to the corresponding user.
[0197] The simulation preparation process shown in S551 and the simulation preparation response process shown in S555 will be described based on FIG. 32. The CPU 10 of the mirror world server 46 determines in S577 whether a simulation request has been received. If it is determined that no request has been received, this simulation preparation process ends and returns. If it is determined that a simulation request has been received, the control proceeds to S578, and a process of identifying a group of personal AIs and digital twins that match the requested simulation is performed. For example, in the case of the consumption behavior simulation under the reduced tax rate accompanying the aforementioned consumption tax increase, a group of personal AIs corresponding to general consumers, a group of personal AIs according to the ratio according to demographics such as gender, age, region, annual income, etc., and a manufacturer digital twin and a store digital twin of consumer goods subject to the reduced tax rate are identified. Next, a process of requesting consent for the simulation is performed to the identified group of personal AIs and digital twins. Specifically, the content of the simulation is transmitted to each user terminal 16 of the user group corresponding to the identified group of personal AIs and digital twins, and it is asked whether to consent.
[0198] The CPU 10 of each user terminal 16 corresponding to the extracted personal AI group and digital twin receives the content of the transmitted simulation at S580, and at S581, determines whether to agree to participate in the execution members of the simulation. This determination may be made by the personal AI or by the user himself / herself. If it is determined not to agree, this simulation preparation response process ends and returns. However, if it is determined to agree, at S582, a reply indicating agreement is sent back to the mirror world server 46.
[0199] The CPU 10 of the mirror world server 46 that receives it at S583 determines whether the required amount of consent has been obtained to execute the requested simulation. If it is determined that it has been obtained, at S584, the agreed AI group and digital twin are copied and registered in the mirror world 51 as simulation targets. The registered state is shown in FIG. 29 described above.
[0200] On the other hand, if it is determined that consent has not been obtained from the necessary personal AI group and digital twin, the control proceeds to S585, and a process of setting a persona group (including personas corresponding to the digital twins of manufacturers and retailers) that matches the insufficient personal AI group and digital twin is performed. At S586, a user group (including user groups engaged in manufacturers and retailers) belonging to each persona is selected. At S587, the user groups belonging to each persona are group-pinged, and transaction data (including transaction data as manufacturers and retailers) of the user groups are collected from the blockchain for each group. At S588, machine learning is performed using the transaction data as learning data to generate and supplement the learned personal AI group and digital twin for each persona, and then the process proceeds to S584. These S585 to S588 are the same processes as S344 to S347 in FIG. 9(B), and the detailed description will not be repeated here.
[0201] Next, the specific control of the simulation process shown in S552 and the simulation response process shown in S557 will be described with reference to FIG. 33. S593 to S595 are the same processes as S336, S338, S339 in FIG. 9 and S136, S138, S139 in FIG. 12 described above, and detailed descriptions thereof will be omitted here. In S596, the simulation result is notified to the requester of the simulation. Specifically, the simulation result is transmitted to the user terminal 16 of the simulation requester. Next, in S597, each personal AI (including the personal AI engaged in the digital twin of a company organization, etc.) used in the simulation is transmitted to the user terminal 16 of each owner.
[0202] The CPU 10 of the user terminal 16 that received it at S598 determines at S599 whether to delete the received personal AI. The received personal AI is a learned AI that participated in the simulation and was reinforced (machine learned), and its performance has improved accordingly, enabling it to execute advanced task processing. However, depending on the content of the simulation, there may be cases where the user has received reinforcement (machine learning) that they do not desire. In such cases, it is determined as YES at S599, and at S601, the received personal AI is deleted. On the other hand, if the simulation is the content desired by the user and it is determined that the received personal AI has received desirable reinforcement (machine learning), the control proceeds to S600, and the received learned personal AI is overwritten and saved. As a result, the user has the advantage of being able to obtain a personal AI with improved performance through desirable reinforcement (machine learning). By using the enjoyment of this advantage as an incentive, organizations and people such as real-world countries, cities, societies, local governments, companies, etc. can be encouraged to take the lead and participate in the construction of the mirror world. By overwriting and saving the personal AI at S600, in the mirror world server 46, the data is updated to the digital twin of the new personal AI and the digital twin of the organization consisting of the new personal AI after overwriting and saving (see Figure 29). Note that instead of overwriting and saving, both the existing personal AI and the learned personal AI may be stored together and used appropriately as needed.
[0203] Next, a system for deriving the optimal solution of the incentive design in a DAO by performing a simulation with the mirror world as a simulation environment will be described based on FIGS. 34 to 59. FIG. 34(A) is a schematic diagram of a multi-service DAO construction system. For example, Bitcoin is a type of DAO, but the nodes (miners) are only responsible for one type of service, namely mining (competition for the right to record transactions). By giving the incentive of awarding Bitcoin to those who succeed in mining, blocks are added and the Bitcoin system continues autonomously. In contrast, a DAO with multiple types of services is called a multi-service DAO. For example, in the case of a DAO of a company organization, there are multiple services such as procurement of materials, assembly, publicity, sales, etc. It is a difficult problem to determine what proportion and how much reward should be distributed to the nodes that execute these multiple services for an optimal incentive design. A system for deriving the optimal solution of the incentive design in such a multi-service DAO will be described.
[0204] Referring to FIG. 34(A), the mirror world server 46 that stores multi-service DAO data stores the data of the DAO agent 61, the persona agent group 62 that performs service 1, the persona agent group 63 that performs service 2, ···, the persona agent group 64 that performs service n. Further, the mirror world server 46 also stores the types of rewards r1, r2, ···, rn given to each persona agent group along with reinforcement learning.
[0205] The terminal 16 of the multi-service DAO constructor downloads and installs the DAO agent 61, the necessary persona agent group, and the types of rewards r1, r2, ··· rn from the mirror world server 46. The terminal 16 is each node 19 that constitutes the public chain 4. The digital twin 66 of the multi-service DAO 65 operated on the public chain 4 composed of each of these nodes 19 performs simulation reinforcement learning in the mirror world 51 to derive the optimal solution for the incentive design in the multi-service DAO. The optimal solution of the incentive design is applied to the actual multi-service DAO 65 in the real world 47 to create a multi-service DAO 65 with an optimal incentive design. The simulation reinforcement learning in this mirror world 51 is executed on the mirror world server 46. Its control will be described below.
[0206] Referring to FIG. 34(B), the CPU 10 of the terminal 16 performs simulation reinforcement learning preparation response processing in S606 and performs simulation reinforcement learning response processing in S607.
[0207] The CPU 10 of the mirror world server 46 performs simulation reinforcement learning preparation processing in S611, performs simulation reinforcement learning processing in S612, and performs DAO agent reinforcement learning processing in S613.
[0208] The specific controls of the simulation reinforcement learning preparation process shown in S611 and the simulation reinforcement learning preparation response process shown in S606 will be described based on FIG. 35. In the simulation reinforcement learning preparation response process, the CPU 10 of the terminal 16 determines in S615 whether to request simulation reinforcement learning. If not, this simulation learning preparation response reinforcement process ends and returns. If a request is made, the control proceeds to S616, where the multi-service DAO data is sent to and requested from the mirror world server 46. This multi-service DAO data includes the types of services. For example, in the case of the innovation induction DAO described later in FIGS. 36 to 42, there are five types of services: idea generation, improvement proposal, commercialization, infringement discovery, and token purchase, and these services are sent.
[0209] The CPU 10 of the mirror world server 46 that receives it in S620 sets, in S621, a group of personas that match each of the multi-services. For example, in the case of the above-mentioned innovation induction DAO, people who are good at coming up with inventions can be considered as the group of personas for idea generation and improvement proposal, people interested in commercialization as the group of personas for commercialization, people familiar with patent law and copyright law as the group of personas for infringement discovery, and people interested in investment as the group of personas for token purchase, etc.
[0210] Next, in S622, a group of users belonging to each persona is selected. For example, in the case of the above-mentioned innovation induction DAO, the group of users published as inventors of patent applications can be considered as the group of users belonging to the group of personas for idea generation and improvement proposal, the group of company managers as the group of users belonging to the group of personas for commercialization, the group of lawyers as the group of users belonging to the group of personas for infringement discovery, and the group of users who have purchased virtual currencies such as Bitcoin as the group of users belonging to the group of personas for token purchase, etc.
[0211] Next, in S623, for each persona, the user groups to which they belong are grouped by pinning, and the transaction data of the user groups for each group is collected from the blockchain. In S624, machine learning is performed using the transaction data as learning data to generate a learned persona agent group for each persona. These two controls are the same processes as S346 and S347 in FIG. 9(B) described above, and the repeated detailed description is omitted here. Next, in S625, the persona agent group is deployed within the multi-service DAO65 to generate a multi-service DAO digital twin 66, which is registered in the mirror world 51 as the simulation target. The state is shown in FIG. 36.
[0212] Referring to FIG. 36, a digital twin 66 of the multi-service DAO65 consisting of a public chain is constructed in the mirror world 51. In the multi-service DAO digital twin 66, the persona agent group is deployed in S625 above, and one persona agent is deployed for each node. The identification numbers of these persona agents are classified for each service (idea proposal, improvement proposal, commercialization, infringement discovery, token purchase) and stored in the mirror world server 46. For example, kc29m, 1w13a, ··· 9nad8 are stored in the mirror world server 46 as the identification numbers of the persona agents for the idea proposal service. This multi-service DAO65 is the innovation-inducing DAO described above. Hereinafter, the multi-service DAO will be described using the innovation-inducing DAO as an example.
[0213] Furthermore, the mirror world server 46 also stores a DAO agent that gives rewards (incentives) for the actions of each persona agent. By performing reinforcement learning (machine learning) on the distribution ratio and amount of the rewards given by this DAO agent, the optimal solution for incentive design is derived. The schematic system of the reinforcement learning (machine learning) is shown in FIG. 37.
[0214] Referring to FIG. 37, if the persona agent group performs the idea submissions from the origin as actions a11, a12, ··· a1n, the state S1 of the environment is input to the DAO agent 61, and rewards r11, r12, ··· r1n are given to the persona agent group 67 that performed those idea generation services. This idea generation service is a broad concept that includes the generation of dreams, ideas, business plans, technical concepts, works, etc. The state S1 of the environment is also given to the persona agent group 67 that performed the idea generation service. This state S1 of the environment is, for example, the content of the origin idea submission, the price of the fluctuating market of token A1 given as a reward to each persona agent 68 that performed the idea generation service, etc.
[0215] If the persona agent group 68 performs actions a21, a22, ··· a2 such as submitting improvement proposals for the above-mentioned origin idea, the state S2 of the environment is input to the DAO agent 61, and rewards r21, r22, ··· r2n are given to the persona agent group 68 that performed those improvement services. The state S1 of the environment is also given to the persona agent group 68 that performed the improvement service. This state S2 of the environment is, for example, the content of the improvement proposal submission, the number of "likes" given to the improvement proposal submission, etc. The entity that gives this "like" is limited to, for example, only those who purchased token A1 given as a reward for the submission of the above-mentioned origin idea (persona agent group 71). Thus, the reason for limiting (restricting) the entity that gives the "like" to stakeholders (stakeholders) is to prevent fraud. When the entity that gives the "like" is expanded without limit, for example, it is to prevent fraud such as a person who submitted an improvement proposal (persona agent group 68) colluding with a large number of people (persona agents) to get a large number of "likes". The entity that gives the "like" to the persona agent group 69 that performed the commercialization service and the persona agent group 70 that performed the infringement countermeasure service is also limited to only those who purchased token A1 (persona agent group 71) for the same reason.
[0216] If the persona agents group 69 that has performed commercialization services for the above-mentioned original idea takes actions a31, a32, ··· a3n, the state of the environment S3 is input to the DAO agent 61, and rewards r31, r32, ··· r3n are given to the persona agents group 69 that has performed those commercialization services. As actions a31, a32, ··· a3n of the persona agents group 69, for example, submission of a business plan, submission of the progress of commercialization, submission of the actual status of commercialization implementation, submission of the profit amount from the commercialized business, etc. can be considered. The state of the environment S3 is also given to the persona agents group 69 that has performed commercialization services. This state of the environment S3 is, for example, the number of "likes" given to submissions such as the submission of a business plan, the submission of the progress of commercialization, the submission of the profit amount from the commercialized business, etc.
[0217] If the persona agents group 70 that has performed infringement handling services for the above-mentioned original idea takes actions a41, a42, ··· a4n, the state of the environment S4 is input to the DAO agent 61, and rewards r41, r42, ··· r4n are given to the persona agents group 70 that has performed those infringement handling services. As actions a31, a32, ··· a3n of the persona agents group 70, for example, report submission of infringement discovery, report submission of infringement handling, report submission of license negotiation, etc. can be considered. Furthermore, it may also include report submission of patent applications that are the premise of these services and report submission services for their patenting. The state of the environment S4 is also given to the persona agents group 70 that has performed infringement handling services. This state of the environment S4 is, for example, the number of "likes" given to report submissions such as infringement discovery, infringement handling report submission, license negotiation report submission, etc.
[0218] If the persona agent group performs the services of purchasing token A1 assigned to the above-mentioned idea generation service of the origin as actions a51, a52, ··· a5n, the state S5 of the environment is input to the DAO agent 61, and rewards r51, r52, ··· r5n are given to the persona agent group 71 that has performed those token purchase services. The state S5 of the environment is also given to the persona agent group 71 that has performed the token purchase service. This state S5 of the environment is, for example, the number of tokens purchased (or the purchase amount). The persona agent group 71 consumes virtual currency (e.g., ETH of Ethereum, etc.) to purchase token A1. Note that the purchased tokens can be converted (cashed in) into virtual currency according to the price in the fluctuating market, and that virtual currency can be converted (cashed in) into legal currency such as yen or dollars according to the price in the fluctuating market.
[0219] The rewards r1 to r5 given to each persona agent group are determined by the DAO agent 61 based on the reward table (see Fig. 39(A)). For the persona agent that has performed the idea generation service, r1 = A1 + B1·b + G1·g; for the persona agent that has performed the improvement service, r2 = A2·e + B2·b + G2·g; for the persona agent that has performed the commercialization service, r3 = A3·e + B3·b; for the persona agent that has performed the infringement handling service, r4 = A4·e + B4·b + G4·g; for the persona agent that has performed the token purchase service, r5 = B5·b + G5·g are determined.
[0220] Here, A2 to A4, B1 to B5, G1, G2, G4, G5 are coefficients, and the DAO agent 61 converges to the optimal ones by reinforcement learning. A1 is a token, g is the license income, e is the number of "likes", and b is the commercialization profit.
[0221] Note that only the license income g or the commercialization income b generated after each persona agent group 68 to 71 has performed its services is considered as the rewards r2 to r5. This is to prevent improper acts such as performing improvement services or token purchase services after the origin idea for which the license income g or the commercialization income b has already occurred.
[0222] In addition, the persona agent group that has performed improvement services, commercialization services, or infringement handling services may also perform token purchase services together. Furthermore, the persona agent group 67 that has performed idea proposal services may also perform improvement services, commercialization services, or infringement handling services together.
[0223] The details of the DAO agent reinforcement learning process shown in S613 will be described based on FIG. 38. This process is for the DAO agent 61 to perform reinforcement learning by itself to optimize the rewards r1 to r5. In S630, the DAO agent 61 determines whether it has received each action a of the persona agent group. If not, it proceeds to S632, but if it determines that it has received it, the control proceeds to S631 and each received action a is memorized.
[0224] In S632, it is determined whether "like" has been given. If not, it proceeds to S634, but if it determines that "like" has been given, in S633, the "like" e is memorized for each persona agent. In S634, it is determined whether there is commercialization income. If not, it proceeds to S636, but if it determines that there is, in S635, the commercialization income b is memorized. In S636, it is determined whether there is license profit g. If not, it proceeds to S638, but if it determines that there is, in S637, the license profit g is memorized.
[0225] In S638, it is determined whether it is the reward calculation time. If not, the process proceeds to S640. If it is determined that it is the reward calculation time, in S639, each reward r1 to r5 is calculated by referring to the reward table (Fig. 39(A)) and given to the corresponding persona agent. In S640, it is determined whether it is the learning update time. If not, this DAO agent reinforcement learning process ends and returns. If it is determined that it is the learning update time, in S641, the total grant price TT of the token A1 given as a reward and the current total price TB in the fluctuating market of the given token are calculated. In S642, the reward R of the DAO agent is calculated from the value of TB / TT. For example, the value of TB / TT at the previous learning update and the value of TB / TT at the current learning update are compared. If the value of TB / TT at the current learning update is larger, a larger reward R is set; if it is smaller, a smaller reward R is set. As a result, the reward R that the DAO agent 61 can obtain becomes larger if the total price TB in the fluctuating market of the token rises, and becomes smaller if the total price TB in the fluctuating market of the token falls.
[0226] Next, in S643, based on the reward R, a process of obtaining the actions A1 to A4, B1 to B5, G1, G2, G4, G5 according to the optimal policy π * by TD learning is performed. In S644, the A1 to A4, B1 to B5, G1, G2, G4, G5 in the reward table are updated to the obtained actions A1 to A4, B1 to B5, G1, G2, G4, G5. As a result, the DAO agent 61 will learn the optimal actions A1 to A4, B1 to B5, G1, G2, G4, G5 for increasing the total price TB in the fluctuating market of the token. Note that this learning goal is just an example, and other learning goals may include increasing the number of submissions of original ideas, increasing the total number of submissions of original ideas and improvement plans, increasing the number of commercialization cases, increasing the total commercialization revenue, etc.
[0227] Next, in S645, it is determined whether the reinforcement learning has been completed. If it has not been completed yet, return. If it is determined that the learning has been completed, in S646, the learned multi-service DAO is sent to the requester of the simulation reinforcement learning.
[0228] The requester of the simulation reinforcement learning can operate the learned multi-service DAO (innovation-inducing DAO) 65 with optimized incentive design in the real world 47. As a result, in this multi-service DAO (innovation-inducing DAO) 65, the "persona agent groups 67 to 71" shown in FIG. 37 become the actual user group, and the rewards (incentives) optimally designed by the learned DAO agent 61 are distributed to the user group performing each service. At the stage of actual operation in this real world 47, the services such as each posted content and the trading content of tokens are recorded on the blockchain with a timestamp. As a result, the blockchain serves as a notary for the original idea submission content and the improvement plan submission content, and it becomes easier to apply the exception for loss of novelty (Article 30 of the Patent Law) and countermeasures against fraudulent applications (Article 49, Paragraph 1, Line 7, Article 74, Article 123, Paragraph 1, Item 2).
[0229] Also, even when operating the multi - service DAO (Innovation - inducing DAO) 65 in the real world 47, the DAO agent 61 may continue to perform machine learning (reinforcement learning), so that the incentive design becomes even more optimal to match the actual operation situation. Each learned persona agent group 67 - 71 (the learned persona agent group according to FIGS. 40(A)(B) and FIGS. 41(A)(B)) may also be included in the multi - service DAO (Innovation - inducing DAO) 65 and sent to the requester of simulation reinforcement learning, and each persona agent group 67 - 71 may function as a consultant for the user group performing each service. Furthermore, at the stage of operating the multi - service DAO (Innovation - inducing DAO) 65 in the real world 47, it may be a mixed - type multi - service DAO 65 in which both the user group and each persona agent group 67 - 71 execute each service, or it may be a persona - agent - operated multi - service DAO (Innovation - inducing DAO) 65 in which each service is executed only by each persona agent group 67 - 71. Note that this innovation - inducing DAO is not limited to being generated through the simulation reinforcement learning in the aforementioned mirror world, and may be artificially generated based on other methods, for example, artificial design. Furthermore, it may not be limited to a DAO, but may be an organization with a specific administrator or entity (for example, an ordinary stock company, etc.).
[0230] Next, based on FIG. 39(B), the main routine of the process in which the persona agent performs reinforcement learning will be described. In S648, the idea - proposal service execution process is performed. In S649, the improvement service execution process is performed. In S650, the commercialization service execution process is performed. In S651, the infringement - countermeasure service execution process is performed. In S652, the token - purchase service execution process is performed.
[0231] The details of the idea proposal service execution process shown in S648 will be described based on FIG. 40(A). In S655, it is determined whether to make an idea proposal. If not, the process returns. If it is determined to make an idea proposal, in S656, a process of creating an idea is performed. This creation of an idea utilizes, for example, an AI called DABUS. For example, the persona agent 67 and DABUS collaborate to create an idea. In S657, the submission content of the idea proposal is generated, and in S658, the idea proposal submission act a1i is executed.
[0232] In S659, it is determined whether the reward r1i has been received from the DAO agent 61. If not, the process returns. If it is determined that the reward has been received, in S660, based on the reward r1i, the optimal policy π * is obtained by TD learning. This act a will repeat and continue the idea proposal act if the received reward r1i is satisfactory, but if the reward r1i is not satisfactory, other acts (for example, improvement service, commercialization service, infringement handling service, token purchase service, or not performing any service) will be selected.
[0233] The details of the improvement service execution process shown in S649 will be described based on FIG. 40(B). In S664, it is determined whether to submit an improvement plan. If not, the process returns. If it is determined to submit, in S665, a process of creating an improvement plan is performed. The creation of the improvement plan utilizes, for example, an AI called DABUS. For example, the persona agent 68 and DABUS collaborate to perform the process of creating an improvement plan. In S666, the submission content of the improvement plan is generated, and in S667, the improvement plan submission act a2i is executed.
[0234] In S668, it is determined whether the reward r2i has been received from the DAO agent 61. If not, the process returns. If it is determined that the reward has been received, in S669, based on the reward r2i, the optimal policy π *Request for action a in accordance with this. If the received reward r2i is satisfactory, the act of submitting improvement proposals will be repeated and continued. However, if the reward r2i is not satisfactory, other actions (for example, idea generation services, commercialization services, infringement handling services, token purchase services, or no services at all) will be selected.
[0235] The details of the commercialization service execution process shown in S650 will be described based on FIG. 41(A). In S674, it is determined whether to commercialize. If not, return. If it is determined to commercialize, in S675, a business plan is generated. In S676, the act a3i of submitting the business plan is executed. In S677, the commercialization service is performed. In S678, the act a3i of submitting the execution status is executed. This act a3i of submitting the execution status also includes submitting the profits obtained from the above-mentioned commercialization.
[0236] In S679, it is determined whether the reward r3i has been received from the DAO agent 61. If not, return. If it is determined that it has been received, in S680, based on the received reward r3i, the optimal policy π * Request for action a in accordance with this. If the received reward r3i is satisfactory, the act of providing commercialization services will be repeated and continued. However, if the reward r3i is not satisfactory, other actions (for example, idea generation services, improvement services, infringement handling services, token purchase services, or no services at all) will be selected.
[0237] The details of the infringement countermeasure service execution process shown in S651 will be described based on FIG. 41(B). In S684, it is determined whether to execute the infringement countermeasure service. If not executed, the process returns. If it is determined to execute, in S685, an investigation of the infringement act is conducted. In S686, it is determined whether the infringement act has been discovered. Note that before conducting the investigation of the infringement act, as described above, patent applications or acts of obtaining patent rights may be performed. If the infringement act is not discovered, the process returns. If it is determined that the infringement act has been discovered, in S687, a warning letter to the suspected infringer is generated. In S688, the warning letter submission act a4i is executed. In S689, infringement countermeasure acts a4i such as negotiation with the suspected infringer are performed. In S690, the execution status submission act a4i is executed.
[0238] Next, in S691, it is determined whether the reward r4i has been received from the DAO agent 61. If not received, the process returns. If it is determined that the reward has been received, in S692, based on the received reward r4i, the optimal policy π * is obtained by TD learning. This act a will repeat and continue the act of the commercialization service if the received reward r4i is satisfactory. If the reward r4i is not satisfactory, other acts (for example, idea proposal service, improvement service, commercialization service, token purchase service, or no service at all) will be selected.
[0239] Next, the details of the token purchase service execution process shown in S652 will be described based on FIG. 42(A). In S969, it is determined whether to purchase a token. If not purchased, the process returns. If it is determined to purchase, in S697, the token purchase act a5i is executed. Next, in S698, it is determined whether the reward r5i has been received from the DAO agent 61. If not received, the process returns. If it is determined that the reward has been received, in S699, based on the received reward r5i, the optimal policy π *Demand act a in accordance with this. If the received reward r5i is satisfactory, the act of commercialization service will be repeated and continued. However, if the reward r5i is not satisfactory, other acts (for example, idea proposal service, improvement service, commercialization service, infringement handling service, or no service at all) will be selected.
[0240] Based on FIG. 42(B), explain the price change in the fluctuating market of token 72 accompanying the purchase of tokens by persona agent group 71. 50 tokens (total market value of 50,000 yen) 72 are given as reward A1 to persona agent 67 who has performed the idea proposal service. A part of the tokens 72 (10 tokens) is purchased by persona agent 71a by paying virtual currency equivalent to 10,000 yen. Next, 10 tokens are purchased by persona agent 71b by paying virtual currency equivalent to 15,000 yen. As a result, the value of 10 tokens soars to 15,000 yen. Persona agent 71c purchases it by paying virtual currency equivalent to 20,000 yen. As a result, the value of 10 tokens soars to 20,000 yen. Persona agent 71d purchases it by paying virtual currency equivalent to 25,000 yen. As a result, the value of 10 tokens soars to 25,000 yen. Persona agent 71e purchases it by paying virtual currency equivalent to 30,000 yen. As a result, the value of 10 tokens soars to 30,000 yen.
[0241] As a result, the 40 tokens (total market value of 40,000 yen) held by persona agent 67 soar to a total market value of 120,000 yen. These tokens soar in direct proportion to the expected value, becoming higher for more popular original ideas, higher for more popular (more likes) improvement proposals submitted, higher for more popular (more likes) commercializations submitted, and higher for more popular (more likes) infringement handling submissions.
[0242] When actually operating the multi-service DAO 65 in the real world 47, as described above, the "persona agent groups 67 to 71" in FIG. 37 become the user group in the real world. In that case, not only the tokens 72 given to the user group that proposed ideas, but also the tokens of the users themselves who perform various services (hereinafter referred to as "my tokens") may be bought and sold. When other users who viewed the posted service content expect the poster to purchase the poster's own my tokens, the price of the my tokens in the fluctuating market rises. In this case, a part of the poster's income may be distributed to the token purchasers at a rate corresponding to the purchase amount. These tokens may be issued within the multi-service DAO 65, but they may be linked to the tokens issued by a professional who issues and circulates tokens to the users, and the tokens issued by that professional may be made available for purchase and sale by the users of the multi-service DAO 65. Currently, VALU Co., Ltd. is a professional who issues and circulates tokens.
[0243] Next, a system for constructing one DAO with controlled cooperation among a plurality of functional elements will be described based on FIGS. 43 to 59. Such a DAO is hereinafter referred to as an "element-integrated DAO".
[0244] Referring to FIG. 43, this element integration DAO enables the easy construction of company organizations and the like that already exist in the real world 47 using a DAO. For each functional element, an element DAO has been generated and prepared in advance. That is, element DAOs modularized for each functional element are prepared, and by selecting and combining the required element DAOs, it is configured to enable the easy construction of a desired element integration DAO. The element DAO provider 73 is provided with a server 74 and an element DAO protocol DB 75. The element DAO protocol DB 75 stores, for example, element DAOs prepared for each functional element required for company relationships, element DAOs prepared for each functional element required for NPO (Nonprofit Organization) relationships, element DAOs prepared for each functional element required for local governments, and the like.
[0245] The element integration DAO constructor receives an order for constructing an element integration DAO from the requester and installs the element DAO corresponding to the required functional element on the PC terminal 76 via the server 74. In the example of FIG. 43, the A1 element DAO (including the A1 element agent), the A2 element DAO (including the A2 element agent), the A5 element DAO (including the A5 element agent), and the A9 element DAO (including the A9 element agent) are installed. Each of the element agents A1 to A9 is an AI for reinforcement learning (machine learning) so that the corresponding element DAO can exhibit the best performance.
[0246] In addition, a general agent is also installed on the PC terminal 76. This general agent controls the element agents of each element DAO in an integrated manner so that the entire element integrated DAO is optimized. The general agent itself also performs reinforcement learning (machine learning) to achieve overall optimization. Since each element agent is for maximizing the performance of the corresponding element DAO, relying solely on the element agents may lead to partial optimization and there is a risk that the overall optimization of the element integrated DAO cannot be achieved. Therefore, a general agent is required to control the entire element integrated DAO to be optimized. This can be said to be the same as finding the Pareto optimal solution in an incomplete information game, for example.
[0247] In order to perform simulation reinforcement learning on the element integrated DAO installed on the PC 67, using the mirror world 51 as a simulation environment, it is installed on a plurality of terminals 16, and a digital twin 2T of a blockchain composed of a private chain 2 with these terminals 16 as nodes 19 is generated within the mirror world 51.
[0248] The main routine of the simulation reinforcement learning of this element integrated DAO will be described based on FIG. 44(A). The CPU 10 of the user terminal 16 of the requester who requests the simulation reinforcement learning of the element integrated DAO performs simulation reinforcement learning preparation response processing in S674 and simulation reinforcement learning response processing in S675. The CPU 10 of the mirror world server 46 performs simulation reinforcement learning preparation processing in S679 and simulation reinforcement learning processing in S680.
[0249] The details of the simulation reinforcement learning preparation response process shown in S674 and the simulation reinforcement learning preparation process shown in S679 will be described based on FIG. 44(B). In the simulation reinforcement learning preparation response process, the CPU 10 of the user terminal 16 determines in S679 whether to request simulation reinforcement learning, and returns if not. If it is determined to request, in S680, the DAO data and the personal AI group are transmitted and requested. The DAO data is a functional element of the organization for which simulation reinforcement learning is desired. For example, in the case of a furniture assembly and sales company, it is a material procurement element, an assembly element, a promotion element, and a sales element. The personal AI group is the personal AI of the people who actually work on the element integration DAO in the real world 47. When there are workers without personal AI and when the workers have not yet been determined, as described based on S561, S565 - S568, S562, S573 - S575 above, a personal AI that matches the element integration DAO for the simulation reinforcement learning target is generated and prepared.
[0250] In the simulation reinforcement learning preparation process, the CPU 10 of the mirror world server 46 determines in S683 whether there is a request for simulation reinforcement learning, and returns if not. If it is determined that there is a request for simulation reinforcement learning, in S684, the personal AI group is copied and deployed into the element integration DAO to generate an element integration DAO digital twin, and it is registered in the mirror world 51 as the simulation target.
[0251] That state is shown in FIG. 45. The digital twin 78 of the element integration DAO 77 in the real world 47 is registered in the mirror world 51. The element integration DAO digital twin 78 shown in FIG. 45 is, for example, the element integration DAO digital twin 78 of a furniture assembly and sales company, has each functional element of material procurement, assembly, promotion, and sales, and the identification numbers of the personal AI groups of the people working on each functional element are stored in the mirror world server 46.
[0252] Regarding this integrated element DAO digital twin 78, optimal incentive design is derived through simulation-based reinforcement learning. The schematic system of the reinforcement learning (machine learning) is shown in FIG. 46.
[0253] Referring to FIG. 46, in the integrated element DAO digital twin 78, corresponding to each functional element of procurement, assembly, promotion, and sales, a procurement element agent 80 and a group of personal AIs 84 in charge of procurement, an assembly element agent 81 and a group of personal AIs 85 in charge of assembly, a promotion element agent 82 and a group of personal AIs 86 in charge of promotion, a procurement element agent 80 and a group of personal AIs 84 in charge of procurement, and a sales element agent 83 and a group of personal AIs 87 in charge of sales are formed. These element agents 80 to 83 are coordinated by a coordinating agent 79.
[0254] The group of personal AIs 84 in charge of procurement performs actions a11, a12, ··· a1n such as proposals in internal consultations, and finally executes the consolidated action a1 against the digital twin group 88 of the material suppliers. The state S1 of the digital twin group 88 of the material suppliers with respect to the action a1 is input to the procurement element agent 80 and the group of personal AIs 84 in charge of procurement. This state S1 is, for example, the number of materials requested and the number of replied materials and the replied price for the action a1 of price negotiation. Each action a11, a12, ··· a1n of the group of personal AIs 84 in charge of procurement is also input to the procurement element agent 80, and the consolidated action a1 is also input to the coordinating agent 79 and the procurement element agent 80.
[0255] Based on action a1 and state S1, the procurement element agent 80 calculates the performance p1 by the personal AI group 84 in charge of procurement, and transmits the performance p1 to the general agent 79. The general agent 79 determines the reward r1 based on the performance p1, and transmits the reward r1 to the procurement element agent 80. The procurement element agent 80 determines the reward distribution rate based on each action a11, a12, ··· a1n of the personal AI group 84 in charge of procurement, and distributes the reward r1 to each personal AI 84 in charge of procurement according to the reward distribution rate.
[0256] The personal AI group 85 in charge of assembly performs actions a21, a22, ··· a2i such as proposals in internal coordination, and finally executes the consolidated action a2 on the digital twin group 89 of the assembly equipment. The state S2 of the digital twin group 89 of the assembly equipment for the action a2 is input to the assembly element agent 81 and the personal AI group 85 in charge of assembly. This state S1 is, for example, the power consumption of the digital twin group 89 of the assembly equipment and the total working hours of the personal AI group 85 in charge of assembly who worked on the digital twin group 89 of the assembly equipment. Each action a21, a22, ··· a2i of the personal AI group 84 in charge of assembly is also input to the assembly element agent 81, and the consolidated action a2 is also input to the general agent 79 and the assembly element agent 81.
[0257] Based on action a2 and state S2, the assembly element agent 81 calculates the performance p2 by the personal AI group 85 in charge of assembly, and transmits the performance p2 to the general agent 79. The general agent 79 determines the reward r2 based on the performance p2, and transmits the reward r2 to the assembly element agent 81. The assembly element agent 81 determines the reward distribution rate based on each action a21, a22, ··· a2i of the personal AI group 85 in charge of assembly, and distributes the reward r2 to the personal AI 85 in charge of assembly according to the reward distribution rate.
[0258] The personal AI group 86 in charge of publicity conducts actions a51, a52, ··· a5j such as proposals during internal consultations, and finally executes the consolidated action a5 on the personal AI group 90 of consumers. The state S5 of the personal AI group 90 of consumers with respect to the action a5 is input to the publicity element agent 82 and the personal AI group 86 in charge of publicity. This state S5 is, for example, the presence or absence of the purchase of the product by the consumer and the purchase amount with respect to the product recommendation action a5 to the consumer. Each action a51, a52, ··· a5j of the personal AI group 86 in charge of publicity is also input to the publicity element agent 82, and the consolidated action a5 is also input to the general agent 79 and the publicity element agent 82.
[0259] Based on the action a5 and the state S5, the publicity element agent 82 calculates the performance p5 by the personal AI group 86 in charge of publicity, and transmits the performance p5 to the general agent 79. Based on the performance p5, the general agent 79 determines the reward r5, and transmits the reward r5 to the publicity element agent 82. The publicity element agent 82 determines the reward distribution rate based on each action a51, a52, ··· a5j of the personal AI group 86 in charge of publicity, and distributes the reward r5 to the personal AI 86 in charge of publicity according to the reward distribution rate.
[0260] The personal AI group 87 of the sales representatives performs actions a91, a92, ··· a9m such as proposals during internal coordination, and finally executes the consolidated action a9 on the store and the digital twin group 91 of consumers. The state S9 of the store and the digital twin group 91 of consumers with respect to the action a9 is input to the sales element agent 83 and the personal AI group 87 of the sales representatives. This state S9 is, for example, the total sales amount in the store, etc. The state S5 of the digital twin 88 of the material provider with respect to the above action a5 is also input to the sales element agent 83. Each action a91, a92, ··· a9m of the personal AI group 87 of the sales representatives is also input to the sales element agent 83, and the consolidated action a9 is input to the general agent 79 and the sales element agent 83 as well.
[0261] Based on the action a9 and the states S5, S9, the sales element agent 83 calculates the performance p9 by the personal AI group 87 of the sales representatives, and transmits the performance p9 to the general agent 79. The general agent 79 determines the reward r9 based on the performance p9, and transmits the reward r9 to the sales element agent 83. The sales element agent 83 determines the reward distribution rate based on each action a91, a92, ··· a9m of the personal AI group 87 of the sales representatives, and distributes the reward r9 to the personal AI 87 of the sales representatives according to the reward distribution rate.
[0262] The calculation methods for the above performances p1 to p9 and each reward distribution rate will be described based on FIGS. 47(A), (B), (C) and FIG. 48(A). The procurement element agent 80 stores, as knowledge, the calculation algorithm for performance p1 and the distribution rate. The calculation algorithm for performance p1 and the distribution rate will be described based on FIG. 47(A). The procurement element agent 80 sets the material purchase amount u for this time (from the previous YES time point by S689 to the current YES time point) and the current inventory number z as the state S1, and calculates performance p1 using the formula p1 = {2(average purchase amount / u)+(z / average inventory number)} / 3. The average purchase amount is the average purchase amount of materials from the start point of simulation-based reinforcement learning to the present. The average inventory number is the average inventory number of materials from the start point of simulation-based reinforcement learning to the present. As a result of this formula, if the material purchase amount u for this time becomes lower, the performance p1 becomes higher, and if the current inventory number z becomes larger, the performance p1 becomes lower.
[0263] Also, the reward distribution rate is calculated in proportion to the degree of approval for the collective action a1 when p1≥1, and conversely, when p1<1, it is calculated in inverse proportion to the degree of approval for the collective action a1. Here, it is not limited to being proportional or inversely proportional to the first power of the "degree of approval", but also includes those proportional or inversely proportional to the nth power of the "degree of approval", etc. The procurement element agent 80 obtains the optimal proportional function or inverse proportional function by performing reinforcement learning (machine learning). Also, the "degree of approval" is the highest degree of approval for the personal AI that proposed the collective action a1 itself, and the procurement element agent 80 determines (calculates) the degree of approval of each personal AI based on each action a11, a12,... a1n of the personal AI.
[0264] The calculation algorithm for the performance p2 and the distribution ratio memorized by the assembly element agent 81 as knowledge will be described based on FIG. 47(B). The assembly element agent 81 sets the current power consumption e of the assembly equipment (from the previous YES time point according to S710 to the current YES time point) and the total labor time t of the current assembly workers as the state S2, and calculates the performance p2 using the formula p2 = { (average power consumption / e) + (average total labor time / t)} / 2. The current total labor time t of the assembly workers is the total labor time of the personal AI group 85 in charge of assembly who worked on the current assembly equipment digital twin group 89. The average power consumption is the average of the power consumption of the assembly equipment from the start point of simulation reinforcement learning to the present. The average total labor time is the average of the total labor time of the assembly workers from the start point of simulation reinforcement learning to the present. As a result of this calculation formula, if the current power consumption e of the assembly equipment decreases, the performance p2 increases, and if the current total labor time t of the assembly workers increases, the performance p2 decreases.
[0265] Also, the reward distribution ratio is calculated in proportion to the degree of approval for the collective action a2 when p2 ≥ 1, and conversely, when p2 < 1, it is calculated in inverse proportion to the degree of approval for the collective action a2. Here, it is not limited to being proportional or inversely proportional to the first power of the "degree of approval", but also includes those proportional or inversely proportional to the nth power of the "degree of approval", etc. The assembly element agent 81 obtains the optimal proportional function or inverse proportional function by performing reinforcement learning (machine learning). Also, the "degree of approval" is the highest degree of approval for the personal AI that proposed the collective action a2 itself, and the assembly element agent 81 determines (calculates) the degree of approval of each personal AI based on each action a21, a22,... a2i of the personal AI.
[0266] The calculation algorithm for the performance p5 and the distribution rate, which the promotion element agent 82 stores as knowledge, will be described based on FIG. 47(C). The promotion element agent 82 sets the total purchase amount k of the recommended consumer personal AI this time (from the previous YES time point by S728 to the current YES time point) as the state S5, and calculates the performance p5 using the formula p5 = k / the average total purchase amount K of the recommended consumer personal AI. The average total purchase amount K is the average of the total purchase amounts of the group 90 of the recommended consumer personal AIs from the start point of the simulation reinforcement learning to the present. As a result of this formula, if the current total purchase amount k of the recommended consumer personal AI becomes high, the performance p5 becomes large.
[0267] Also, the reward distribution rate is calculated in proportion to the degree of approval for the collective action a5 when p5 ≧ 1, and conversely, when p5 < 1, it is calculated in inverse proportion to the degree of approval for the collective action a5. Here, it is not limited to being proportional or inversely proportional to the first power of the "degree of approval", but also includes those proportional or inversely proportional to the nth power of the "degree of approval", etc. The promotion element agent 82 obtains the optimal proportional function or inverse proportional function by performing reinforcement learning (machine learning). Also, the "degree of approval" is the highest degree of approval for the personal AI that proposed the collective action a5 itself, and the promotion element agent 82 determines (calculates) the degree of approval of each personal AI based on each action a51, a52, ··· a5j of the personal AI.
[0268] The calculation algorithm for the performance p5 and the distribution rate, which the sales element agent 83 memorizes as knowledge, will be described based on FIG. 48(A). The sales element agent 83 sets the total sales amount h and the average total sales amount H at the store this time (from the previous YES point by S749 to the current YES point) as the state S9, and calculates the performance p9 by the formula p9 = (h - k) / (H - K) based on this state S9 and the above state S5. The average total sales amount H is the average of the total sales amounts at the store from the start point of the simulation reinforcement learning to the present. Also, k is the current total purchase amount of the recommended consumer personal AI, and K is the average of the total purchase amounts of the recommended consumer personal AI group 90 from the start point of the simulation reinforcement learning to the present (see FIG. 47(C) and its description). As a result of this calculation formula, the performance p9 increases as the value obtained by subtracting the current total purchase amount k of the recommended consumer personal AI from the current total sales amount h at the store increases. The current total purchase amount k of the recommended consumer personal AI is the achievement of the personal AI group 86 in charge of promotion, and the achievement of only the personal AI group 87 in charge of sales is the value obtained by subtracting the current total purchase amount k of the recommended consumer personal AI from the current total sales amount h at the store.
[0269] Also, the reward distribution rate is calculated in proportion to the degree of approval for the collective action a9 when p9 ≥ 1, and conversely, when p9 < 1, it is calculated in inverse proportion to the degree of approval for the collective action a9. Here, it is not limited to being proportional or inversely proportional to the first power of the "degree of approval", but also includes those proportional or inversely proportional to the nth power of the "degree of approval", etc. The advertising element agent 83 obtains the optimal proportional function or inverse proportional function by performing reinforcement learning (machine learning). Also, the "degree of approval" is the highest for the personal AI that proposed the collective action a9 itself, and the sales element agent 83 determines (calculates) the degree of approval of each personal AI based on each action a91, a92, ··· a9m of the personal AI.
[0270] Next, the reward table 92 memorized as knowledge by the supervisor agent 79 will be described based on FIG. 48(B). In this reward table 92, the calculation formula for the rewards distributed by the supervisor agent 79 to each of the element agents 80 to 83 is memorized. The reward to be distributed is calculated by coefficient × (profit in the current period) × (performance sent from the target element agent) ÷ (total performance sent from all element agents). Here, the "current period" refers to the period from the previous YES point by S675 to the current YES point.
[0271] Specifically, the reward r1 distributed to the material procurement element agent 80 is r1 = A1·Lt·p1 / (p1 + p2 + p5 + p9). The reward r2 distributed to the assembly element agent 81 is r2 = A2·Lt·p2 / (p1 + p2 + p5 + p9). The reward r5 distributed to the advertising element agent 82 is r5 = A5·Lt·p5 / (p1 + p2 + p5 + p9). The reward r9 distributed to the sales element agent 83 is r9 = A9·Lt·p9 / (p1 + p2 + p5 + p9). Here, Lt is the profit in the current period, and A1, A2, A5, and A9 are coefficients as the actions determined by the supervisor agent 79.
[0272] Next, the specific content of the simulation reinforcement learning process shown in S680 will be described based on FIG. 49. The supervisor agent reinforcement learning process is executed by S687, the material procurement element agent reinforcement learning process is executed by S688, the assembly element agent reinforcement learning process is executed by S689, the advertising element agent reinforcement learning process is executed by S690, the sales agent reinforcement learning process is executed by S691, the material procurement person AI reinforcement learning process is executed by S692, the assembly person AI reinforcement learning process is executed by S693, the advertising person AI reinforcement learning process is executed by S694, and the sales person AI reinforcement learning process is executed by S695.
[0273] The details of the overall agent reinforcement learning process shown in S687 will be described based on FIG. 50. The overall agent 79 determines, in S699, whether it has received each performance p sent from each of the element agents 80 to 83. If not received, the control proceeds to S671. If it is determined that the performance p has been received, in S670, each received performance p is stored.
[0274] Next, in S671, it is determined whether each of the actions a1 to a9 has been received. If not received, the control proceeds to S673. If it is determined that the actions have been received, in S672, each received action a1 to a9 is stored. Next, in S673, it is determined whether there is an input of the state S9 sent from the store and consumer personal AI group 91. If not, the control proceeds to S675. If it is determined that there is an input, in S674, sales = ΣS9 is calculated.
[0275] Next, in S675, it is determined whether it is the reward calculation time. If not, the control proceeds to S677. If it is determined that it is the reward calculation time, in S676, the rewards r1, r2, r3, r5, r9 are calculated by referring to the reward table 92 and sent to the corresponding element agents 80 to 83.
[0276] Next, in S677, it is determined whether it is the update time of reinforcement learning (machine learning). If not, the process returns. If it is determined that it is the update time, in S687, the current period profit Lt = sales - expenses is calculated. Next, in S679, each of the rewards r1, r2, r5, r9 is calculated and distributed to the corresponding element agents 80 to 83.
[0277] Next, in S680, the reward R of the overall agent 79 is calculated from the profit Lt. This reward R is proportional to the profit Lt. Next, in S681, based on the above reward R, the optimal policy π is obtained by TD learning *Obtain the actions (coefficients) A1, A2, A5, and A9 according to [specific rule]. Next, in S682, update the A1, A2, A5, and A9 in the reward table 92 to the actions (coefficients) A1, A2, A5, and A9 obtained in S681. As a result, the overall agent 79 will learn the actions (coefficients) A1, A2, A5, and A9 that maximize the profit Lt. <> <>
[0278] <> The details of the procurement element agent reinforcement learning process shown in S688 will be described based on FIG. 51. The procurement element agent 80 performs information collection processing by the crawler in S684. A crawler is a program that periodically acquires documents, images, etc. on the web and automatically creates a database. It is also called a "bot", "spider", "robot", etc. <> <>
[0279] <> The details of this information collection processing by the crawler will be described based on FIG. 52(A). The procurement element agent 80 receives the information collected by the crawler traveling on the network in S702. Next, in S703, the received information is stored in the procurement DB 93. <> <>
[0280] <> The information stored in the procurement DB 93 is shown in FIG. 52(B). As shown in the figure, the procurement DB 93 stores various types of information required for the procurement business, such as economic information, social information, weather information, inventory information, market information,... supplier information, etc. <> <>
[0281] <> Returning to FIG. 51, the procurement element agent 80 determines in S685 whether it has received the actions a11, a12,... a1n from the personal AI group 84. If not received, the control proceeds to S687. If it is determined that the actions have been received, in S686, each received action a11, a12,... a1n is memorized. In S687, it is determined whether the state S1 has been received from the digital twin group 88 of the material suppliers. If not received, the control proceeds to S689. If it is determined that the state has been received, in S688, the received S1 is memorized. <> <>
[0282] <> In S689, it is determined whether it is the time to calculate the performance p1. If it is not the calculation time, the control proceeds to S692. If it is determined that it is the calculation time, in S690, the performance p1 = {2 (average purchase amount / u) + (z / average inventory number)} / 3 is calculated. The performance p1 is transmitted to the general agent 79 (S691).
[0283] In S692, it is determined whether the reward r1 transmitted from the general agent 79 has been received. If it has not been received, the process returns. If it is determined that it has been received, the reward distribution rate is calculated based on the algorithm of the reward distribution rate shown in FIG. 47(A) (S693). In S694, each reward r11, r12... r1n is calculated by multiplying the reward by each distribution rate. In S695, each reward r11, r12... r1n is given to each procurement person AI group 84 for materials. In S696, based on the received reward r1, the optimal policy π * according to the behavior (proportional function or inverse proportional function) obtained by TD learning. In S697, the proportional function or inverse proportional function is updated to the one obtained in S696. As a result, the procurement element agent 80 will learn the proportional function or inverse proportional function that maximizes the performance p1.
[0284] Next, the details of the assembly element agent reinforcement learning process shown in S689 will be described based on FIG. 53. The assembly element agent 81 determines in S706 whether the actions a21, a22,... a2n from the personal AI group 85 have been received. If they have not been received, the control proceeds to S708. If it is determined that they have been received, in S707, each received action a21, a22,... a2n is stored. In S708, it is determined whether the state S2 from the digital twin group 89 of the assembly equipment has been received. If it has not been received, the control proceeds to S710. If it is determined that it has been received, in S709, the received state S2 is stored.
[0285] In S710, it is determined whether it is the time to calculate the performance p2. If it is not the calculation time, the control proceeds to S713. If it is determined that it is the calculation time, in S711, the performance p2 = {(average power consumption / e) + (average total labor time / t)} / 2 is calculated. The performance p2 is transmitted to the overall agent 79 (S712).
[0286] In S713, it is determined whether the reward r2 sent from the overall agent 79 has been received. If not, the process returns. If it is determined that it has been received, the reward distribution rate is calculated based on the algorithm of the reward distribution rate shown in FIG. 47(B) (S714). In S715, each reward r11, r12... r1n is calculated by multiplying the reward by each distribution rate, and in S695, each reward r21, r22... r2i is given to the assembly - responsible personal AI group 86. In S717, based on the received reward r2, the TD learning is used to obtain the behavior (proportional function or inverse - proportional function) according to the optimal policy π * In S718, the proportional function or inverse - proportional function is updated to the one obtained in S717. As a result, the assembly element agent 81 will learn the proportional function or inverse - proportional function that maximizes the above - mentioned performance p2.
[0287] The details of the reinforcement learning process of the advertising element agent shown in S690 will be described based on FIG. 54. The advertising element agent 83 performs information collection processing by the crawler in S723. The details of this processing will be described based on FIG. 55(A). The advertising element agent 83 receives the information collected by the crawler cruising on the network in S740 and stores the received information in the advertising DB94 in S741.
[0288] The collected data stored in the promotion DB94 is shown in Fig. 55(B). The promotion DB94 stores various behavioral data of consumers such as Taro, Jiro, ... Hanako. For example, in the case of Taro, it is determined that there is a high possibility of purchasing furniture from the information "ordered a detached house", and furniture promotion is carried out for Taro. In the case of Jiro, from the information "purchased a couple pot", it is determined that there is a high possibility of purchasing furniture for a new house in the near future due to getting married soon, and furniture promotion is carried out for Jiro.
[0289] Returning to Fig. 54, the promotion element agent 83 determines in S742 whether it has received the actions from each personal AI group 86. If not received, the control proceeds to S726. If it is determined that the actions have been received, in S725, each received action is stored. In S726, it is determined whether the state S5 sent from the consumer's personal AI group 90 has been received. If not yet received, the control proceeds to S728. If it is determined that the state S5 has been received, in S727, the received state S5 is stored.
[0290] In S728, it is determined whether it is the calculation timing of the performance p5. If it is not the calculation timing of the performance p5, the control proceeds to S731. If it is determined that it is the calculation timing of the performance p5, in S729, the performance p5 = k / the average total purchase amount K of the recommended consumer personal AI is calculated. Next, in S730, the performance P5 is transmitted to the general agent 79.
[0291] In S731, it is determined whether the reward r5 sent from the general agent 79 has been received. If not yet received, it returns. If it is determined that the reward r5 has been received, in S732, the reward distribution rate is calculated based on the algorithm of the reward distribution rate shown in Fig. 47(C) (S732). In S733, each reward r51, r52... r5j is calculated by multiplying the reward by each distribution rate. In S734, each reward r51, r52... r5j is given to the personal AI group 87 in charge of promotion. In S735, based on the received reward r5, the optimal policy π is obtained by TD learning. *Obtain the behavior (proportional function or inverse proportional function) according to the following. In S736, update the proportional function or inverse proportional function to the one obtained in S735. As a result, the promotion element agent 82 will learn the proportional function or inverse proportional function that maximizes the above performance p5.
[0292] Next, the details of the sales element agent reinforcement learning process shown in S691 will be described based on FIG. 56. The sales element agent 84 performs information collection processing by the crawler in S744. The details of this processing will be described based on FIG. 57(A). The sales element agent 84 receives the information collected by the crawler traveling on the network in S760, and stores the received information in the sales DB95 in S761. Further, in S762, the POS data in the store is stored in the sales DB95.
[0293] The collected data stored in the sales DB95 is shown in FIG. 57(B). The sales DB95 stores various data such as weather data and POS data. The "by date" in the weather information is a concept that includes by day of the week. Based on the weather information (weather temperature data by date and time) and the POS data (sales product data by date and time), for example, the arrangement of display products can be changed considering the day of the week, time, and weather conditions.
[0294] Returning to FIG. 56, the sales element agent 84 determines in S745 whether it has received the actions from each personal AI group 87. If not received, the control proceeds to S747, but if it is determined that it has received, in S746, each received action is memorized. In S747, it is determined whether the state S9 sent from the personal AI groups 91 of the store and consumers has been received. If not yet received, the control proceeds to S749. If it is determined that it has received, in S748, the received state S9 is memorized.
[0295] In S749, it is determined whether it is the timing to calculate performance p9. If it is not the timing to calculate performance p9, the control proceeds to S752. If it is determined that it is the timing to calculate performance p9, then in S750, performance p9 = (h - k) / (H - K) is calculated. Next, in S751, performance p9 is transmitted to the general agent 79.
[0296] In S752, it is determined whether the reward r9 sent from the general agent 79 has been received. If it has not been received yet, the process returns. If it is determined that it has been received, then in S753, the reward distribution rate is calculated based on the algorithm of the reward distribution rate shown in Fig. 48(A) (S753). In S754, each reward r91, r92... r9m is calculated by multiplying the reward by each distribution rate. In S755, each reward r91, r92... r9m is given to the salesperson personal AI group 88. In S756, based on the received reward r9, the optimal policy π * for the behavior (proportional function or inverse proportional function) according to TD learning is obtained. In S757, the proportional function or inverse proportional function is updated to the one obtained in S756. As a result, the sales element agent 83 will learn the proportional function or inverse proportional function that maximizes the above performance p9.
[0297] Next, the details of the procurement person personal AI reinforcement learning process shown in S692 will be described based on Fig. 58(A). The procurement person personal AI group 84 determines in S765 whether to negotiate with the digital twin group 88 of the material supplier. If not, the control proceeds to S770. If it is determined to negotiate, then in S766, the stored data in the financing DB93 is browsed, and while conducting internal coordination with reference to the stored data, the action a1 is determined (S767), and negotiations are conducted with the digital twin group 88 of the material supplier (S768). In S769, it is determined whether the negotiation has ended. If it has not ended yet, the process returns to S766, and the loop of S767 → S768 → S769 → S766 is traversed. When it is determined in S769 that the negotiation has ended, the control proceeds to S770.
[0298] In S770, it is determined whether rewards r11, r12 ··· r1n are received from the procurement element agent 80. If not received, the process returns. If it is determined that the rewards are received, in S771, based on the received rewards, the optimal policy π * is used to obtain the actions (a11, a12 ··· a1n). This action a1i includes cases where, if the received reward r1i is not satisfactory, the agent may move (transfer) to another company's DAO digital twin (for example, the DAO digital twin 59 of ABC Co., Ltd. in Fig. 45). As a result of this reinforcement learning, each of the procurement person AI will learn actions that increase the aforementioned performance p1.
[0299] Next, the details of the assembly person AI reinforcement learning process shown in S693 will be described based on Fig. 58(B). The assembly person AI group 85 determines in S775 whether to conduct internal coordination. If not, the control proceeds to S779. If it is determined to conduct coordination, in S776, each assembly person AI determines the action a2 while conducting internal coordination. Next, in S777, according to the action a2, the assembly equipment digital twin group 89 is test-run to verify the validity of the action a2. In S778, it is determined whether the coordination has ended. If not yet ended, the process returns to S776, and the loop of S777 → S778 → S776 is repeated. If the action a2 is determined to be valid as a result of the test-run in S777, it is determined in S778 that the coordination has ended, and the control proceeds to S779.
[0300] In S779, it is determined whether rewards r21, r22 ··· r2n are received from the assembly element agent 81. If not received, the process returns. If it is determined that the rewards are received, in S780, based on the received rewards, the optimal policy π *Determine the actions (a21, a22 ··· a2i) according to this. This action a2i includes those that will transfer (change jobs) to the DAO digital twins of other companies (for example, the DAO digital twin 59 of ABC Co., Ltd. in Fig. 45) if the received reward r2i is not satisfactory. As a result of this reinforcement learning, each of the personal AIs in charge of assembly will learn actions that increase the above-mentioned performance p2.
[0301] Next, the details of the personal AI reinforcement learning process for the publicity department shown in S694 will be described based on Fig. 59(A). The group of personal AIs 86 in the publicity department determines in S784 whether to conduct an internal consultation. If not, the control proceeds to S789. If it is determined to conduct a consultation, in S785, each personal AI in the publicity department determines the action a5 while conducting an internal consultation. Next, in S787, the action a2 to consumers is executed. In S788, it is determined whether the consultation has ended. If it has not ended yet, the process returns to S785 and loops through the loop of S786 → S787 → S788. When it is determined in S788 that the consultation has ended, the control proceeds to S789.
[0302] In S789, it is determined whether the rewards r51, r52 ··· r5j have been received from the publicity element agent 82. If not, the process returns. If it is determined that the rewards have been received, in S790, according to the received rewards, the optimal policy π * Determine the actions (a51, a52 ··· a5j) according to this. This action a5i includes those that will transfer (change jobs) to the DAO digital twins of other companies (for example, the DAO digital twin 59 of ABC Co., Ltd. in Fig. 45) if the received reward r5i is not satisfactory. As a result of this reinforcement learning, each of the personal AIs in the publicity department will learn actions that increase the above-mentioned performance p5.
[0303] Next, the details of the salesperson personal AI reinforcement learning process shown in S695 will be described based on FIG. 59(B). The group of salesperson personal AIs 87 determines in S791 whether to conduct an internal consultation. If not, the control proceeds to S795. If it is determined to conduct a consultation, in S792, each salesperson personal AI determines action a9 while conducting an internal consultation. Next, in S793, it is determined whether the consultation has ended. If it has not ended yet, the process returns to S792, and the loop of S792→S793→S792 is repeated. When it is determined in S793 that the consultation has ended, the control proceeds to S794. In S794, the actions determined in the above consultation are executed for the consumers and stores.
[0304] Next, in S795, it is determined whether rewards r91, r92 ··· r9m have been received from the sales element agent 83. If not, the process returns. If it is determined that the rewards have been received, in S796, based on the received rewards, actions (a91, a92 ··· a9m) according to the optimal policy π* are obtained by TD learning. This action a9i includes those that will transfer (change jobs) to other company DAO digital twins (for example, the DAO digital twin 59 of ABC Co., Ltd. in FIG. 45) if the received reward r9i is not satisfactory. As a result of this reinforcement learning, each of the salesperson personal AIs will learn actions that increase the aforementioned performance p9.
[0305] The element integration DAO for which the simulation reinforcement learning has ended is operated as an actual organization in the real world 47. At that stage, the "personal AI groups 84 to 87" in FIG. 46 will be responsible for the actual humans (users) in the real world. At that time, each of the personal AI groups 84 to 87 that have completed the simulation reinforcement learning will serve as a consultant for the actual humans (users) and can provide the knowledge, experience, and know-how obtained through the simulation reinforcement learning to the actual humans (users).
[0306] The construction of the element-integrated DAO described above shows that an entire organization such as a company, NPO, or local government can be created by combining element DAOs by function. However, it is also possible to construct only a part of the organization (for example, procurement) with element DAOs instead of the entire organization.
[0307] The above-described programs that operate on the user terminal 16 and various servers may be downloaded and installed from a predetermined website or the like. However, for example, they may be recorded on a recording medium (non-transitory recording medium) such as a CD-ROM 99 and distributed, and those who purchase the CD-ROM 99 or the like may install the program on the user terminal 16 and various servers (see Fig. 60). [Modification Example]
[0308] (1) For example, in the digital twin data shown in Fig. 29, names such as Taro, Jiro, Sakura, and Saburo may use pseudonyms (anonyms) from the perspective of personal information protection, and although it is possible to identify that they are the same person, it may not be possible to identify a specific individual. In that case, an AI identification number or a blockchain address may be used as the pseudonym (anonym). Similarly, for a digital twin of a company such as ABC Co., Ltd., a pseudonym (anonym) may be used for the company name (organization name), and although it is possible to identify that they are the same company (organization), it may not be possible to identify a specific company (organization). Also, for a human digital twin, multiple digital twins by multiple personal AIs may be prepared for one person. Furthermore, one digital twin of a person may be composed of a collection of multiple personal AIs (for example, a collection of specialized personal AIs in various fields).
[0309] (2) In Figs. 34 to 59, a system for deriving the optimal solution of incentive design in a DAO by performing a simulation using a multi-service DAO with multiple types of services as an example was described. However, the system is not limited to a multi-service DAO, and it may be a system for deriving the optimal solution of incentive design by simulation for a DAO with only one type of service.
[0310] (3) In FIG. 35, a group of learned persona agents is generated for each persona. However, for each personal AI of the user group belonging to each persona, it may be selected from the existing group of personal AIs registered in the mirror world 51 and used as the persona agent group. In this case, it is necessary to inquire whether it is possible to use the personal AI for the user group belonging to each persona in the simulation and obtain consent to use it. Copy each personal AI of the user group that has given consent and use it in the simulation, and send the learned personal AI group after the completion of the simulation to each corresponding user. Each user who has received it overwrites and saves the learned personal AI with respect to the existing personal AI when determining that the learned personal AI is useful (necessary). Note that both the existing personal AI and the learned personal AI may be stored together and used appropriately as needed.
[0311] (4) As multi-agent reinforcement learning, a master agent method is shown in which a master agent (master agent) responsible for overall optimization distributes rewards to each agent and the master agent itself also performs reinforcement learning to converge the reward distribution behavior to an optimal one. However, multi-agent reinforcement learning is not limited to this. For example, D-learning that can converge to an optimal solution under a Markov decision process, or Bucket Brigade or Profit Sharing as a reinforcement learning algorithm in a Classifier System may be used.
[0312] (5) The simulation using a digital twin is not limited to the digital twin of a person or an organization composed of people (such as a corporation or an NPO). For example, in the case of an object with AI (such as an AI-equipped vacuum cleaner), a digital twin of the environment in which the object operates (for example, the interior of a user's home where an AI-equipped vacuum cleaner that moves autonomously operates) is generated in the cyber space, and the AI installed in the object is pre-simulated and reinforced (machine-learned) in the environmental digital twin, and the customized (personalized) learned AI-equipped object may be provided to the corresponding user.
[0313] Since it is possible to resolve, to the greatest extent possible, the dilemma in which the guarantee of the authenticity of the recorded information and the guarantee of the right to delete that information are in antinomy, it can be used for an information recording method having non-erasability such as a blockchain.
Explanation of Signs
[0314] 1 Internet 2 Private Chain 3 Consortium Chain 4 Public Chain 12 HDD 16 User Terminal 19 Node 30 Key Registration Center 32 Key DB 46 Mirror World Server 51 Mirror World 52 Earth Digital Twin 53 Japan Digital Twin 54 Town Digital Twin 57 Taro Digital Twin 58 Taro's Family Digital Twin 59 ABC Corporation Digital Twin 61 DAO Agent 72 Token 78 DAO Digital Twin 79 General Agent.
Claims
1. A service providing system that provides a service using an AI agent, means for preparing a group of AI agents generated according to a selected human population for a simulation environment of a predetermined theme; a simulation means for performing a simulation under the simulation environment using the group of AI agents; A service providing system comprising:
2. A service provision system as described in Claim 1, wherein the means for preparing prepares a group of AI agents that mimic the behavior of humans belonging to the population.
3. The means for preparing comprises: a selection means for selecting a group of people belonging to a plurality of personas that match the theme as the population; a collection means for grouping the group of people selected by the selection means into the plurality of personas and collecting information on legal acts performed by the group of people for each group; and a generation means for performing machine learning using the collected information on legal acts as learning data to generate a trained AI agent for each persona, The service providing system according to claim 2 , wherein the simulation means performs a simulation in the simulation environment using the group of AI agents generated by the generation means.
4. The preparing means prepares a group of AI agents generated by machine learning using information about each person belonging to the population as training data; The service providing system according to claim 2 , wherein the simulation means performs a simulation in the simulation environment using the group of prepared AI agents.
5. The simulation means executes, in a computer, a simulation in which an AI agent performs a legal act within the group of AI agents; A service provision system as described in any one of claims 1 to 4, further comprising a reinforcement learning means for causing the AI agent that performed the legal act to learn a strategy for maximizing the accumulation of the reward by giving the AI agent a reward for the performed legal act.
6. A service providing system described in any of claims 1 to 5, further comprising an assistant service providing means for providing a service that enables the AI agent used in the simulation by the simulation means to be used as an assistant to a user.