Information processing system, information processing method, data processing device, and program

Abstract

To provide an information processing system, an information processing method, a data processing device and a program which facilitate sharing and using of data between organizations.SOLUTION: In an information processing system having a data processing device and a data input / output device which manages data in each organization, the data processing device shares a schema that determines a data structure of data held by each organization between the organizations and receives a range of shared data to be shared between the organizations and a data processing proposal from each organization, the data processing device that has received the data processing proposal from each organization obtains an approval to the received data processing proposal from each organization and forms an agreement to the received data processing proposal, and the data processing device acquires the shared data indicated by the data processing proposal to which the agreement is formed from each organization and executes processing indicated by the data processing proposal to which the agreement is formed.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an information processing method, a data processing device, and a program. [Background technology]

[0002] Companies, local governments, etc. are making effective use of customer and resident data, and currently data is being analyzed and used in a variety of situations, including analyzing customer purchasing trends, improving business efficiency, and managing production and distribution. In addition, IoT, which connects various sensors and devices to a network to collect and utilize data, is attracting attention. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2015 / 114947 Summary of the Invention [Problem to be solved by the invention]

[0004] In terms of making effective use of data, one option is to share data among multiple organizations and analyze the shared data.

[0005] When sharing data, there is a desire for organizations to not allow other organizations to see their own actual data, even partially, if possible. There is also a need for a mechanism that allows organizations to reach an agreement on data sharing and use.

[0006] Patent Document 1 discloses a technology in which the data to be calculated is secretly distributed and stored among multiple computing entities, and data processing is carried out in cooperation with the other computing entities without restoring the original data. However, this technology has problems in that it imposes a high processing load and places restrictions on the description of the processing.

[0007] Methods of anonymizing data, such as masking parts of the data, statistically converting it into data, hashing it, or adding noise, may leave the actual data available to other organizations for data that has not been anonymized.

[0008] Neither approach provides a mechanism for agreeing on how data will be shared and used.

[0009] The present invention has been made in view of the above, and has an object to promote the sharing and use of data between organizations. [Means for solving the problem]

[0010] An information processing system of one embodiment of the present invention is an information processing system that shares and processes data between organizations, and has a data processing device and a data input / output device that manages data in each organization, and receives a data processing proposal indicating the range of shared data to be shared between the organizations and a process that uses the shared data as input, obtains approval for the data processing proposal from the data input / output devices of each organization, and forms an agreement on the data processing proposal, and a processing execution unit that executes the process indicated in the data processing proposal for which agreement has been reached, and the data input / output device has a proposal unit that transmits the data processing proposal to the data processing device.

[0011] In the above information processing system, the processing execution unit uses virtualization technology to construct an execution environment for executing the processing of the data processing proposal, copies the shared data indicated in the data processing proposal from each organization's data input / output device to the execution environment, executes the processing indicated in the data processing proposal, and discards the execution environment after the processing is executed. Effect of the Invention

[0012] According to the present invention, sharing and use of data between organizations can be promoted. [Brief description of the drawings]

[0013] [Figure 1]FIG. 1 is a diagram illustrating an example of an overall configuration of an information processing system. [Diagram 2] FIG. 2 is a functional block diagram illustrating an example of the configuration of the data processing device. [Diagram 3] FIG. 3 is a functional block diagram showing an example of the configuration of the data input / output device. [Figure 4] FIG. 4 is a sequence diagram illustrating an example of a processing flow of the information processing system. [Diagram 5] FIG. 5 is a sequence diagram illustrating an example of a processing flow of the information processing system. [Figure 6] FIG. 6 is a sequence diagram illustrating an example of a processing flow of the information processing system. [Figure 7] FIG. 7 is a diagram illustrating an example of a hardware configuration of a data processing device and a data input / output device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0015] The information processing system of this embodiment will be described with reference to Fig. 1. The information processing system of this embodiment provides a function for sharing and processing data between organizations A and B. More specifically, the information processing system shares a schema that defines a data structure between organizations A and B, and when approval is obtained from each of organizations A and B for a data processing proposal indicating the range of shared data shared between organizations A and B and a process using the shared data as an input, the information processing system acquires the shared data from each of organizations A and B based on the data processing proposal and executes the process indicated by the data processing proposal.

[0016] The information processing system includes a data processing device 1, data input / output devices 3A and 3B, and databases 5A and 5B. The data input / output device 3A and the database 5A belong to an organization A, and the data input / output device 3B and the database 5B belong to an organization B.

[0017] The data processing device 1 receives the schema of the data owned by each of the organizations A and B, and enables browsing of the schema of the data owned by each of the organizations A and B. The schema indicates the table structure of the databases 5A and 5B in which data is stored, and includes information such as items in the table and relationships between the tables. For example, the information included in the schema is assumed to be a user ID, time, store ID, purchased product ID, and purchase time. By referring to the schema of the data owned by the other organization, the data manager of each of the organizations A and B can know what data the other organization owns, and can grasp what information can be obtained by what processing is performed using the data owned by the organization and the data owned by the other organization.

[0018] The data processing device 1 accepts a data processing proposal indicating the range of data shared between the organizations A and B and a process for inputting the shared data, and requests each of the organizations A and B to approve the proposal.

[0019] If approval is given for the proposal, the data processing device 1 acquires the shared data from each of the organizations A and B, executes the proposed processing, and transmits the processing results to each of the organizations A and B.

[0020] The data input / output devices 3A and 3B transmit the schema of the data owned by the organizations A and B to the data processing device 1, and the schema is shared between the organizations A and B.

[0021] The data input / output devices 3A and 3B transmit a data processing proposal to the data processing device 1, and if the proposal is approved, they obtain the data to be shared from the databases 5A and 5B and transmit it to the data processing device 1, and receive the processing results from the data processing device 1.

[0022] Incidentally, data is not directly transmitted and received between the data input / output devices 3A and 3B.

[0023] The databases 5A and 5B store data managed by the organizations A and B, respectively. The schemas and shared data of the databases 5A and 5B are transmitted to the data processing device 1 via the data input / output devices 3A and 3B. The databases 5A and 5B can use relational databases.

[0024] Note that organizations A and B may be separate organizations within the same company, or may be separate companies. The number of organizations sharing data is not limited to two, and data may be shared among three or more organizations.

[0025] Next, the data processing device will be described with reference to Fig. 2. The data processing device 1 shown in the figure includes an authentication unit 11, a schema information sharing unit 12, a data processing function sharing unit 13, a consensus building unit 14, and a processing execution unit 15.

[0026] The authentication unit 11 establishes a secure session between the data processing device 1 and each of the data input / output devices 3A and 3B. For example, the authentication unit 11 establishes a secure session between the data input / output devices 3A and 3B by server-client authentication of Transport Layer Security (TLS). Communication between the data processing device 1 and each of the data input / output devices 3A and 3B is performed through the secure session.

[0027] The schema information sharing unit 12 holds the schema of the data owned by each of the organizations A and B, and transmits the schema to the data input / output devices 3A and 3B in response to a request from the data input / output devices 3A and 3B.

[0028] The data processing function sharing unit 13 manages processing of the shared data received from the data input / output devices 3A and 3B. This processing is, for example, statistical processing including a SQL JOIN statement across multiple databases 5A and 5B, and is processing for finding a correlation coefficient between columns after JOINing at a specific column. The processing performed by the data processing device 1 is not limited to the above.

[0029] The consensus building unit 14 receives a data sharing proposal from the data input / output devices 3A and 3B, obtains approval from each of the organizations A and B for the data processing proposal indicating the range of the shared data to be shared and the process for inputting the shared data, and forms an agreement on the data processing proposal. The data sharing proposal includes a conditional expression indicating the range of data to be shared from one organization and a conditional expression indicating the range of data to be shared from the other organization. The conditional expression is, for example, a SELECT statement including an SQL WHERE clause. The process for inputting the shared data included in the data processing proposal is, for example, a processing function written by the data manager proposing the data sharing.

[0030] The consensus building unit 14 transmits the data processing proposal to the data input / output devices 3A and 3B and obtains approval for the proposal. When approval is obtained from each of the organizations A and B, the consensus building unit 14 determines that an agreement has been formed between the organizations A and B and causes the processing execution unit 15 to execute the processing of the proposal.

[0031] The processing execution unit 15 executes processing according to the data processing proposal, and transmits the processing result to the data input / output devices 3A and 3B. The processing execution unit 15 uses virtualization technology to create an application execution environment that is isolated so as not to connect to any devices other than the data input / output devices 3A and 3B, and executes only the processing indicated by the data processing proposal. In the application execution environment, shared data according to a conditional expression is obtained from each of the data input / output devices 3A and 3B, and the processing indicated by the data processing proposal is executed. The application execution environment is designed so that it cannot be accessed from the outside except for input of the shared data from the data input / output devices 3A and 3B, and executes only the processing indicated by the data processing proposal. For example, a Docker container can be used for the application execution environment. As post-processing, the processing execution unit 15 deletes the Docker container and completely erases the data in a specific area by a shred command.

[0032] Next, the data input / output device will be described with reference to Fig. 3. The data input / output device 3 shown in the figure includes an authentication unit 31, a schema information sharing unit 32, a proposal unit 33, an authorization unit 34, a data transmission unit 35, and a result receiving unit 36. The data input / output devices 3A and 3B of the organizations A and B have the same configuration as the data input / output device 3 shown in Fig. 3. The databases 5 connected to the data input / output device 3 are databases 5A and 5B of the organizations A and B.

[0033] The authentication unit 31 establishes a secure session with the data processing device 1 .

[0034] The schema information sharing unit 32 transmits the schema of the database 5 of its own organization to the data processing device 1. In addition, the schema information sharing unit 32 acquires the schema of the database 5 of another organization from the data processing device 1.

[0035] The data manager describes a desired process by referring to the schema of his / her own organization and the schema of another organization acquired by the schema information sharing unit 32. There are no restrictions on the method of describing the process, and any process may be used as long as it can be executed by the process execution unit 15. For example, the process can be described in a general-purpose and widely used language such as SQL, Python, and R.

[0036] The proposal unit 33 sends a process for inputting shared data to the data processing device 1, and also sends a proposal for data sharing to the data processing device 1, the proposal including a conditional expression representing the range of data to be shared from one's own organization and a conditional expression representing the range of data desired to be shared from other organizations.

[0037] The authorization unit 34 receives the data processing proposal, presents it to the data manager of its own organization, and transmits authorization to the data processing device 1.

[0038] The data transmission unit 35 acquires the data to be shared from the database 5 and transmits it to the data processing device 1 when the agreed-upon data processing proposal is executed.

[0039] The result receiving unit 36 ​​receives the processing result from the data processing device 1.

[0040] Next, the operation of the information processing system of this embodiment will be described with reference to the sequence diagrams of FIGS.

[0041] First, the process of sharing a schema will be described with reference to the sequence diagram in FIG.

[0042] In step S11, the data input / output device 3A and the data processing device 1 perform mutual authentication and establish a secure encrypted communication path.

[0043] In step S12, the data input / output device 3B establishes a secure communication path with the data processing device 1, similar to the data input / output device 3A.

[0044] In step S13, the data input / output device 3A requests the database 5A to acquire a schema.

[0045] In step S14, the data input / output device 3A transmits the schema acquired from the database 5A to the data processing device 1. The data processing device 1 holds the schema of the database 5A of organization A and makes it possible to browse it.

[0046] Similarly, in organization B, in step S15, the data input / output device 3B requests the database 5B to acquire a schema, and in step S16, the data input / output device 3B transmits the schema acquired from the database 5B to the data processing device 1. The data processing device 1 holds the schema of the database 5B of organization B and makes it possible to browse it.

[0047] Next, the process of forming an agreement on data sharing between organizations will be described with reference to the sequence diagram in Figure 5. Here, an example is shown in which organization A makes a proposal, but the same can be applied to the case in which organization B makes a proposal.

[0048] In step S31, the data input / output device 3A transmits a schema information acquisition request to the data processing device 1, and in step S32, the data input / output device 3A receives the schema information from the data processing device 1. The schema information includes the schema of the database 5A of organization A and the schema of the database 5B of organization B held by the data processing device 1.

[0049] The data administrator of organization A refers to the schema information and writes a processing function that executes the desired processing.

[0050] In step S33, the data input / output device 3A transmits a data processing function setting request to the data processing device 1, and registers the processing function in the data processing device 1.

[0051] In step S34, the data input / output device 3A receives the data processing function setting response from the data processing device 1.

[0052] In step S35, the data input / output device 3A transmits a data processing proposal to the data processing device 1. The data processing proposal includes a conditional expression indicating the range of data to be shared from organization A, a conditional expression indicating the range of data desired to be shared from organization B, and processing content. The processing content may be information for identifying a processing function registered in the data processing device 1, or may be the processing function itself.

[0053] In step S36, the data processing device 1 transmits an authorization request for the data processing proposal to organization B, and in step S37, transmits an authorization request for the data processing proposal to organization A. Note that since the data processing proposal in this embodiment is from organization A, the process of step S37 does not need to be performed.

[0054] The data controller of organization B checks the data processing proposal included in the authorization request. The data processing proposal includes the scope of the shared data of organization A, the scope of the shared data of organization B, and the processing content.

[0055] When the data administrator of organization B is satisfied with the data processing proposal, in step S38, the data input / output device 3B notifies the data processing device 1 that the data processing proposal has been approved.

[0056] If the data manager of organization B is not satisfied with the data processing proposal, organization B may transmit a data processing proposal in which the range of shared data of organization A and the range of shared data of organization B are modified to the data processing device 1. The data processing device 1 transmits an approval request for the modified data processing proposal to organization A. Alternatively, organization B may notify the data processing device 1 of the disapproval of the data processing proposal.

[0057] In step S39, the data input / output device 3A notifies the data processing device 1 that the data administrator of organization A has approved the data processing proposal. Note that if the data processing proposal sent by organization A has not been modified, the process of step S39 may be omitted.

[0058] When approval is obtained from both organizations A and B, in step S40, the data processing device 1 assumes that an agreement has been reached on the proposal from organization A, creates an application execution environment for executing the proposed processing, and starts implementing the data processing shown in Fig. 6. The data processing device 1 may store and manage the agreed upon data processing proposal in a storage device.

[0059] Next, a process for executing the agreed-upon proposal will be described with reference to the sequence diagram of Fig. 6. The process of the data processing device 1 shown in Fig. 6 is a process executed in an application execution environment.

[0060] In step S51, the data processing device 1 requests shared data that satisfies a conditional expression that indicates the range of data to be shared from organization A to the data input / output device 3A.

[0061] In step S52, the data input / output device 3A acquires the shared data that satisfies the conditional expression from the database 5A, and transmits it to the data processing device 1.

[0062] In step S53, the data processing device 1 requests the data input / output device 3B to send shared data that satisfies the conditional expression that indicates the range of data to be shared from organization B.

[0063] In step S54, the data input / output device 3B acquires the shared data that satisfies the conditional expression from the database 5B, and transmits it to the data processing device 1.

[0064] The shared data received from each of organizations A and B is stored in a database constructed within the application execution environment.

[0065] In step S55, the data processing device 1 executes the processing of the agreed proposal.

[0066] In steps S56 and S57, the data processing device 1 transmits the processing results to the data input / output devices 3A and 3B, respectively.

[0067] After completing transmission of the processing results, the data processing device 1 deletes the shared data received from the organizations A and B as well as the application execution environment.

[0068] As described above, the information processing system of this embodiment is an information processing system that shares and processes data between organizations A and B, and includes a data processing device 1 and data input / output devices 3A and 3B that manage data in each organization. The data processing device 1 includes a schema information sharing unit 12 that shares between the organizations A and B a schema that defines the data structure of data held by each organization A and B, a consensus building unit 14 that receives a data processing proposal indicating the range of shared data shared between the organizations A and B and a process that uses the shared data as an input, obtains authorization for the data processing proposal from each organization, and forms an agreement on the data processing proposal, and a process execution unit 15 that obtains shared data indicated by the data processing proposal for which agreement has been formed from the organizations A and B, and executes the process indicated by the data processing proposal. The data input / output devices 3A and 3B include a proposal unit 33 that transmits the data processing proposal to the data processing device 1, an authorization unit 34 that transmits authorization for the data processing proposal to the data processing device 1, and a data transmission unit 35 that transmits the shared data indicated by the data processing proposal to the data processing device 1. By sharing the schema of data owned by each organization A and B, it becomes possible to understand the information that can be obtained by combining and processing the data of one organization with the data of the other organization. In addition, since organizations A and B can reach an agreement on the scope of the data to be shared and the processing of the shared data, data owners can provide data to other organizations with peace of mind.

[0069] In the information processing system of this embodiment, the process execution unit 15 uses virtualization technology to build an execution environment for executing the process of the data processing proposal, copies the shared data indicated in the data processing proposal from each of organizations A and B to the execution environment, executes the process indicated in the data processing proposal, and discards the execution environment after the process is executed. As a result, only the shared data is copied to the execution environment and discarded after the process is executed, so that the process can be executed while concealing the data held by each of organizations A and B.

[0070] The data processing device 1 and data input / output devices 3A and 3B described above can be, for example, a general-purpose computer system including a central processing unit (CPU) 901, a memory 902, a storage 903, a communication device 904, an input device 905, and an output device 906 as shown in Fig. 7. In this computer system, the data processing device 1 and the data input / output devices 3A and 3B are realized by the CPU 901 executing a predetermined program loaded onto the memory 902. This program can be recorded on a computer-readable recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, or can be distributed via a network. [Explanation of symbols]

[0071] 1...Data processing device 11. Authentication section 12…Schema information sharing section 13...Data processing function shared section 14…Consensus building department 15...Processing execution unit 3, 3A, 3B...Data input / output device 31…Authentication Department 32…Schema information sharing section 33…Proposal Department 34. Licensing Department 35...Data transmission section 36…Result receiving section 5, 5A, 5B…Database

Claims

1. An information processing system for sharing and processing data between organizations, A data processing device and a data input / output device for managing data in each organization are provided, The data processing device includes: a consensus building unit that receives a data processing proposal indicating a range of shared data to be shared between the organizations and a process using the shared data as an input, obtains approval for the data processing proposal from the data input / output devices of each organization, and builds a consensus on the data processing proposal; a processing execution unit that executes processing indicated by the data processing proposal for which an agreement has been reached; The data input / output device is a proposal unit for transmitting the data processing proposal to the data processing device; Information processing system.

2. 2. The information processing system according to claim 1, The processing execution unit uses a virtualization technology to construct an execution environment for executing the processing of the data processing proposal, copies the shared data indicated in the data processing proposal from the data input / output device of each organization to the execution environment, executes the processing indicated in the data processing proposal, and discards the execution environment after the processing is executed. Information processing system.

3. An information processing method for sharing and processing data between organizations, comprising: By the data processing device, receiving a data processing proposal indicating a range of data to be shared between the organizations and a process using the shared data as an input, obtaining approval for the data processing proposal from devices of each organization, and forming an agreement on the data processing proposal; and executing the processing indicated in the data processing proposal for which an agreement has been reached. Information processing methods.

4. 4. The information processing method according to claim 3, In the step of executing the process indicated by the data processing proposal, a virtualization technology is used to construct an execution environment for executing the process indicated by the data processing proposal, the shared data indicated by the data processing proposal is copied from the device of each organization to the execution environment, the process indicated by the data processing proposal is executed, and after the process is executed, the execution environment is discarded. Information processing methods.

5. A data processing device that shares and processes data managed in each organization, a consensus formation unit that receives a data processing proposal indicating a range of shared data to be shared between the organizations and a process using the shared data as an input, obtains approval for the data processing proposal from devices of each organization, and forms a consensus on the data processing proposal; a processing execution unit that executes the processing indicated in the data processing proposal for which an agreement has been reached; Data processing device.

6. 6. A data processing apparatus according to claim 5, The processing execution unit uses a virtualization technology to construct an execution environment for executing the processing of the data processing proposal, copies the shared data indicated in the data processing proposal from the device of each organization to the execution environment, executes the processing indicated in the data processing proposal, and discards the execution environment after the processing is executed. Data processing device.

7. A program for causing a computer to operate as each unit of the data processing device according to claim 5 or 6.

Images