Information processing system, information processing method, data processing device, and recording medium

Abstract

An information processing system sharing and processing data between organizations (A, B) has a data processing device (1) and data input / output devices (3A, 3B) managing data in each organization. The data processing device (1) has: an architecture information sharing section (12) sharing an architecture defining a data structure of data held by each organization (A, B) between the organizations (A, B); a consensus forming section (14) receiving a data processing proposal indicating a range of shared data shared between the organizations (A, B) and a process using the shared data as input, obtaining an approval for the data processing proposal from each organization, and forming a consensus for the data processing proposal; and a process executing section (15) acquiring the shared data indicated by the data processing proposal for which the consensus is formed from each organization (A, B) and executing the process indicated by the data processing proposal. The data input / output devices (3A, 3B) have: a proposal section (33) transmitting the data processing proposal to the data processing device (1); an approval section (34) transmitting the approval for the data processing proposal to the data processing device (1); and a data transmitting section (35) transmitting the shared data indicated by the data processing proposal to the data processing device (1).

Description

Technical Field

[0001] This invention relates to information processing systems, information processing methods, data processing devices, and recording media. Background Technology

[0002] The effective utilization of customer and resident data in enterprises and autonomous regions is constantly evolving. Currently, data analysis and utilization are being applied in various situations, such as analyzing customer purchasing preferences, improving business efficiency, and managing production and distribution. Furthermore, the Internet of Things (IoT), which connects various sensors, devices, and networks to collect data for flexible application, is gaining attention.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: International Publication No. 2015 / 114947 Summary of the Invention

[0006] The problem that the invention aims to solve

[0007] Regarding the effective use of data, consider sharing data among multiple organizations and parsing the shared data.

[0008] When sharing data, there is an expectation that an organization's actual data should not be partially seen by other organizations. Additionally, there is a desire for mechanisms to achieve consensus on data sharing and utilization among organizations.

[0009] Patent document 1 discloses a technique that secretly and disperses the data of a computing object in multiple computing entities, and performs data processing in collaboration with other computing entities without restoring the original data. However, this technique suffers from problems such as high processing load and limitations in the generation of processing records.

[0010] In methods of anonymizing data, such as statistical analysis, hashing, or adding noise, which mask a portion of the data, the actual data may still be visible across organizations for the unanonymized data.

[0011] Neither approach provides a mechanism for reaching consensus in the sharing and use of data.

[0012] This invention was made in view of the above circumstances, and its purpose is to promote the sharing and utilization of data among organizations.

[0013] Methods for solving problems

[0014] One aspect of the present invention is an information processing system for sharing and processing data among organizations, comprising a data processing device and a data input / output device for managing data in each organization. The data processing device includes: an architecture sharing unit that shares an architecture among organizations, the architecture defining the data structure of the data maintained by each organization; a consensus forming unit that receives a data processing proposal representing the scope of shared data shared among organizations and processing that takes the shared data as input, obtains approval from each organization for the data processing proposal, and forms a consensus on the data processing proposal; and a processing execution unit that obtains the shared data shown in the data processing proposal from each organization, and executes the processing shown in the data processing proposal. The data input / output device includes: a proposal unit that sends the data processing proposal to the data processing device; an approval unit that sends approval for the data processing proposal to the data processing device; and a sending unit that sends the shared data shown in the data processing proposal to the data processing device.

[0015] In the aforementioned information processing system, the processing execution unit uses virtualization technology to construct an execution environment for executing the data processing proposal. After copying the shared data shown in the data processing proposal from each organization to this execution environment, the processing shown in the data processing proposal is executed. After the processing is executed, the execution environment is discarded.

[0016] Invention Effects

[0017] According to the present invention, it is possible to promote the sharing and utilization of data among organizations. Attached Figure Description

[0018] Figure 1 This is a diagram illustrating an example of the overall structure of an information processing system.

[0019] Figure 2 This is a functional block diagram illustrating an example of the structure of a data processing device.

[0020] Figure 3 This is a functional block diagram illustrating an example of the structure of a data input / output device.

[0021] Figure 4 This is a sequence diagram representing an example of the processing flow of an information processing system.

[0022] Figure 5 This is a sequence diagram representing an example of the processing flow of an information processing system.

[0023] Figure 6 This is a sequence diagram representing an example of the processing flow of an information processing system.

[0024] Figure 7This is a diagram illustrating an example of the hardware structure of a data processing device and a data input / output device. Detailed Implementation

[0025] Hereinafter, embodiments of the present invention will be described using the accompanying drawings.

[0026] Reference Figure 1 The information processing system of this embodiment will be described. The information processing system of this embodiment provides the function of sharing and processing data between organizations A and B. More specifically, the information processing system shares a defined data structure architecture between organizations A and B. If approval of a data processing proposal is obtained from each organization A and B, the system obtains shared data from each organization A and B based on the data processing proposal and executes the processing indicated in the data processing proposal. This data processing proposal indicates the scope of shared data shared between organizations A and B and the processing that uses the shared data as input.

[0027] The information processing system includes a data processing device 1, data input / output devices 3A and 3B, and databases 5A and 5B. Data input / output device 3A and database 5A belong to organization A, while data input / output device 3B and database 5B belong to organization B.

[0028] Data processing device 1 receives the data schemas of organizations A and B and can view them. The schema represents the table structure of databases 5A and 5B that store the data, including information such as the items in the tables and the relationships between tables. For example, the schema might include information such as user ID, time, store ID, purchased item ID, and purchase time. By referring to the data schemas of other organizations, the data managers of organizations A and B can understand what kind of data other organizations possess and what information will be obtained from processing their own data with the data of other organizations.

[0029] Data processing device 1 accepts a data processing proposal that represents the scope of shared data to be shared between organizations A and B and the processing of input shared data, and requests approval from each organization A and B for the proposal.

[0030] When the data processing device 1 receives approval for the proposal, it obtains shared data from each organization A and B, performs the processing of the proposal, and sends the processing results to each organization A and B.

[0031] Data input / output devices 3A and 3B send the data architecture of organizations A and B to data processing device 1, and the architecture is shared between organizations A and B.

[0032] Data input / output devices 3A and 3B send data processing proposals to data processing device 1. If the proposal is approved, they retrieve shared data from databases 5A and 5B and send it to data processing device 1, and receive the processing results from data processing device 1.

[0033] In addition, data is not directly transmitted or received between data input / output devices 3A and 3B.

[0034] Databases 5A and 5B store data managed by organizations A and B respectively. The architecture of databases 5A and 5B, as well as shared data, are sent to data processing device 1 via data input / output devices 3A and 3B. Databases 5A and 5B can utilize relational databases.

[0035] Furthermore, organizations A and B can be different organizations within the same enterprise, or they can be different enterprises. The number of organizations sharing data is not limited to two; data can also be shared among three or more organizations.

[0036] Next, refer to Figure 2 The data processing apparatus is described below. The data processing apparatus 1 shown in the figure includes an authentication unit 11, an architecture information sharing unit 12, a data processing function sharing unit 13, a consensus formation unit 14, and a processing execution unit 15.

[0037] The authentication unit 11 establishes secure sessions between the data processing device 1 and each data input / output device 3A, 3B. For example, the authentication unit 11 establishes secure sessions with the data input / output devices 3A, 3B through server / client authentication using Transport Layer Security (TLS). Communication between the data processing device 1 and each data input / output device 3A, 3B is conducted through secure sessions.

[0038] The architecture information sharing unit 12 maintains the architecture of the data owned by each organization A and B, and sends the architecture to the data input / output devices 3A and 3B according to the requests from the data input / output devices 3A and 3B.

[0039] The data processing function sharing unit 13 manages the processing of shared data received from the data input / output devices 3A and 3B. This processing includes, for example, statistical processing of SQL JOIN statements spanning multiple databases 5A and 5B, and calculating the correlation coefficient between columns after a JOIN operation on a specific column. The processing performed by the data processing device 1 is not limited to the above.

[0040] The consensus-forming unit 14 receives data-sharing proposals from data input / output devices 3A and 3B, and obtains approval from organizations A and B for data processing proposals regarding the scope of shared data and the processing of input shared data, thus forming a consensus on the data processing proposals. The data-sharing proposal includes conditional expressions indicating the scope of data to be shared from this organization and conditional expressions indicating the scope of data to be shared from other organizations. The conditional expressions are, for example, SELECT statements containing SQL WHERE clauses. The processing of input shared data included in the data processing proposal is, for example, a processing function described by the data manager proposing the data sharing.

[0041] The consensus-forming unit 14 sends the data processing proposal to the data input / output devices 3A and 3B, and receives approval for the proposal. If approval is received from organizations A and B, the consensus-forming unit 14 considers that a consensus has been reached among organizations A and B, and the processing execution unit 15 executes the processing of the proposal.

[0042] The processing execution unit 15 executes processing according to the data processing proposal and sends the processing results to the data input / output devices 3A and 3B. The processing execution unit 15 uses virtualization technology to isolate itself from any connection other than the data input / output devices 3A and 3B, creating an application execution environment that only executes the processing described in the data processing proposal. Within the application execution environment, shared data according to conditional statements is obtained from the data input / output devices 3A and 3B, and the processing described in the data processing proposal is executed. The application execution environment is designed to be inaccessible from the outside except for input of shared data from the data input / output devices 3A and 3B, and only executes the processing described in the data processing proposal. For example, a Docker container can be used within the application execution environment. As post-processing, the processing execution unit 15 deletes the Docker container and performs complete data deletion of a specific region based on the shred command.

[0043] Next, refer to Figure 3 The data input / output device is described below. The data input / output device 3 shown in the figure includes an authentication unit 31, an architecture information sharing unit 32, a proposal unit 33, an approval unit 34, a data transmission unit 35, and a result receiving unit 36. The data input / output devices 3A and 3B of organizations A and B are related to... Figure 3 The data input / output device 3 shown has the same structure. The database 5 connected to the data input / output device 3 consists of databases 5A and 5B of organizations A and B.

[0044] A secure session is established between the authentication unit 31 and the data processing device 1.

[0045] The architecture information sharing unit 32 sends the architecture of its own organization's database 5 to the data processing device 1. Additionally, the architecture information sharing unit 32 obtains the architectures of other organizations' databases 5 from the data processing device 1.

[0046] The data manager, referring to the organizational structure and the structures of other organizations obtained by the Architecture Information Sharing Department 32, describes the desired processing. There are no restrictions on the method of describing the processing, as long as it is a process that the processing execution department 15 can execute. For example, the processing can be described using common and widely used languages ​​such as SQL, Python, and R.

[0047] The proposal department 33 sends the processing of input shared data to the data processing device 1, and sends a data sharing proposal to the data processing device 1, which includes a conditional expression indicating the scope of data to be shared from the organization and a conditional expression indicating the scope of data to be shared from other organizations.

[0048] The approval department 34 receives the data processing proposal and prompts the organization's data manager to send the approval to the data processing device 1.

[0049] When executing the data processing proposal after consensus, the data sending unit 35 retrieves the shared data from the database 5 and sends it to the data processing device 1.

[0050] The result receiving unit 36 ​​receives the processing result from the data processing device 1.

[0051] Next, use Figures 4 to 6 The timing diagram illustrates the operation of the information processing system in this embodiment.

[0052] First, refer to Figure 4 The sequence diagram illustrates the processing of the shared architecture.

[0053] In step S11, the data input / output device 3A and the data processing device 1 authenticate each other to establish an encrypted and secure communication path.

[0054] In step S12, similar to data input / output device 3A, data input / output device 3B establishes a secure communication path with data processing device 1.

[0055] In step S13, the data input / output device 3A requests the database 5A to obtain the schema.

[0056] In step S14, the data input / output device 3A sends the schema obtained from the database 5A to the data processing device 1. The data processing device 1 maintains the schema of the database 5A of organization A and sets it to be viewable.

[0057] Similarly, in step S15, organization B requests the schema from database 5B, and in step S16, data input / output device 3B sends the schema obtained from database 5B to data processing device 1. Data processing device 1 maintains the schema of organization B's database 5B and makes it viewable.

[0058] Next, refer to Figure 5 The sequence diagram illustrates the process of establishing consensus on data sharing between organizations. An example of a proposal from organization A is shown here, but the same principle applies to a proposal from organization B.

[0059] In step S31, the data input / output device 3A sends a request to the data processing device 1 to obtain architecture information. In step S32, the data input / output device 3A receives architecture information from the data processing device 1. The architecture information includes the architecture of database 5A of organization A and the architecture of database 5B of organization B, which are maintained by the data processing device 1.

[0060] The data manager of organization A refers to the architecture information and describes the processing functions that perform the desired processing.

[0061] In step S33, the data input / output device 3A sends a data processing function setting request to the data processing device 1 and registers the processing function in the data processing device 1.

[0062] In step S34, the data input / output device 3A receives a data processing function setting response from the data processing device 1.

[0063] In step S35, the data input / output device 3A sends a data processing proposal to the data processing device 1. The data processing proposal includes a conditional expression indicating the scope of data to be shared from organization A, a conditional expression indicating the scope of data to be shared from organization B, and processing content. The processing content may be information used to determine the processing function registered in the data processing device 1, or it may be the processing function itself.

[0064] In step S36, data processing device 1 sends an approval request for the data processing proposal to organization B, and in step S37, it sends an approval request for the data processing proposal to organization A. Alternatively, since the data processing proposal in this embodiment originates from organization A, step S37 may be omitted.

[0065] Organization B's data manager confirms the data processing proposal included in the approval request. The data processing proposal includes the scope of shared data from Organization A, the scope of shared data from Organization B, and the processing content.

[0066] When the data manager of organization B receives a data processing proposal, in step S38, the data input / output device 5B notifies the data processing device 1 that it has approved the data processing proposal.

[0067] Furthermore, if Organization B's data manager does not agree to the data processing proposal, Organization B may also send the data processing proposal, which modifies the scope of shared data in Organization A and the scope of shared data in Organization B, to Data Processing Device 1. Data Processing Device 1 sends an approval request for the modified data processing proposal to Organization A. Alternatively, Organization A may notify Data Processing Device 1 of its disapproval of the data processing proposal.

[0068] In step S39, the data input / output device 5A notifies the data processing device 1 that the data manager of organization A has approved the data processing proposal. Alternatively, if the data processing proposal sent by organization A has not been modified, step S39 can be omitted.

[0069] When approval is obtained from both organizations A and B, in step S40, data processing device 1 considers the consensus on the proposal for organization A to be established, generates an application execution environment for processing the proposal, and begins... Figure 6 The data processing is illustrated in the diagram. Data processing device 1 can also store the consensus-reached data processing proposals in a storage device for management.

[0070] Next, refer to Figure 6 The sequence diagram illustrates the processing of proposals after consensus is reached. Figure 6 The data processing device 1 shown is a process performed in an application execution environment.

[0071] In step S51, the data processing device 1 requests shared data from the data input / output device 3A that conforms to the conditional expression representing the range of data shared from organization A.

[0072] In step S52, the data input / output device 3A obtains shared data that meets the conditions from the database 5A and sends it to the data processing device 1.

[0073] In step S53, the data processing device 1 requests shared data from the data input / output device 3B that conforms to the conditional expression representing the range of data shared from organization B.

[0074] In step S54, the data input / output device 3B obtains shared data that meets the condition from the database 5B and sends it to the data processing device 1.

[0075] Shared data received from each of organizations A and B is stored in a database built within the application execution environment.

[0076] In step S55, the data processing device 1 performs the processing of the consensus proposal.

[0077] In steps S56 and S57, the data processing device 1 sends the processing results to the data input / output devices 3A and 3B, respectively.

[0078] When the processing result is sent, the data processing device 1 deletes the shared data received from organizations A and B, as well as the application execution environment.

[0079] As described above, the information processing system of this embodiment is an information processing system that shares and processes data between organizations A and B, and includes a data processing device 1 and data input / output devices 3A and 3B that manage data in each organization. The data processing device 1 includes: an architecture information sharing unit 12, which shares an architecture defining the data structure of the data held by each organization A and B; a consensus forming unit 14, which receives a data processing proposal indicating the scope of shared data shared between organizations A and B and processing using that shared data as input, obtains approval from each organization for the data processing proposal, and forms a consensus on the data processing proposal; and a processing execution unit 15, which obtains the shared data shown in the data processing proposal from each organization A and B, and executes the processing shown in the data processing proposal. The data input / output devices 3A and 3B include: a proposal unit 33 that sends a data processing proposal to the data processing device 1; an approval unit 34 that sends approval for the data processing proposal to the data processing device 1; and a data sending unit 35 that sends the shared data shown in the data processing proposal to the data processing device 1. By sharing the data owned by organizations A and B, it becomes possible to grasp the information obtained by combining and processing data from other organizations. Furthermore, organizations A and B can establish a scope for shared data and a consensus on the processing of that shared data, thus allowing data owners to confidently provide data to other organizations.

[0080] In the information processing system of this embodiment, the processing execution unit 15 uses virtualization technology to construct an execution environment for executing the data processing proposal. The shared data shown in the data processing proposal is copied from organizations A and B to the execution environment, the processing shown in the data processing proposal is executed, and the execution environment is discarded after the processing is completed. Thus, only the shared data is copied to the execution environment and discarded after processing, thereby enabling processing to be performed while concealing the data held by each organization A and B.

[0081] In the data processing device 1 and data input / output devices 3A and 3B described above, for example, it is possible to use Figure 7The above describes a general-purpose computer system equipped with a central processing unit (CPU) 901, a memory 902, a storage device 903, a communication device 904, an input device 905, and an output device 906. In this computer system, the CPU 901 executes a predetermined program loaded onto the memory 902, thereby implementing the data processing device 1 and the data input / output devices 3A and 3B. This program can be recorded on a computer-readable recording medium such as a disk, optical disk, or semiconductor memory, or it can be distributed via a network.

[0082] Symbol Explanation

[0083] 1…Data processing device

[0084] 11…Certification Department

[0085] 12…Architecture Information Sharing Department

[0086] 13…Data Processing Function Sharing Section

[0087] 14… Consensus Formation Department

[0088] 15…Processing and Execution Department

[0089] 3, 3A, 3B... Data input / output devices

[0090] 31…Certification Department

[0091] 32…Architecture Information Sharing Department

[0092] 33…Proposal Department

[0093] 34…Accreditation Department

[0094] 35…Data Transmission Department

[0095] 36…Results Receiving Department

[0096] 5, 5A, 5B... database.

Claims

1. An information processing system for sharing and processing data across organizations, characterized in that, The information processing system includes a data processing device and a data input / output device for managing data in various organizations. The data processing device has: The architecture sharing department is responsible for sharing architectures among organizations, which define the data structure of the data maintained by each organization. The consensus-forming department receives data processing proposals that indicate the scope of shared data to be shared among organizations and the processing of such shared data as input, obtains the approval of the data processing proposals from the organizations, and forms a consensus on the data processing proposals. as well as The processing execution unit obtains the shared data as indicated by the consensus-reaching data processing proposal from each organization, and executes the processing indicated by the data processing proposal. The execution of this processing is carried out while the shared data obtained from each organization remains hidden from other organizations within those organizations. The data input / output device has: The proposal department sends the data processing proposal to the data processing device. The approval department sends its approval of the data processing proposal to the data processing device; and The sending unit sends the shared data shown in the data processing proposal to the data processing device.

2. The information processing system according to claim 1, characterized in that, The processing execution unit uses virtualization technology to construct an execution environment for executing the data processing proposal. After copying the shared data shown in the data processing proposal from each organization to the execution environment, the processing shown in the data processing proposal is executed. After the processing is executed, the execution environment is discarded.

3. The information processing system according to claim 1, characterized in that, The data processing proposal includes: a first conditional expression representing the range of data to be shared from one of the organizations, a second conditional expression representing the range of data to be shared from another organization, and processing content, which includes information about processing functions.

4. An information processing method for sharing and processing data between organizations, characterized in that, The information processing method comprises the following steps based on a data processing device: An architecture is shared among organizations, which specifies the data structure of the data maintained by each organization; Receive data processing proposals outlining the scope of shared data to be shared among organizations and the processing of that shared data as input; obtain approval from each organization for the data processing proposals; and reach a consensus on the data processing proposals. The shared data, as indicated by the consensus-reaching data processing proposal from each organization, is obtained, and the processing indicated by the data processing proposal is executed, wherein the execution of the processing is carried out in a state where the shared data obtained from each organization is concealed from other organizations within those organizations. The information processing method comprises the following steps based on a data input / output device: Send the data processing proposal to the data processing device; Sending approval of the data processing proposal to the data processing device; and The shared data shown in the data processing proposal is sent to the data processing device.

5. The information processing method according to claim 4, characterized in that, In the steps of executing the processing described in the data processing proposal, virtualization technology is used to construct an execution environment for executing the processing described in the data processing proposal. After the shared data described in the data processing proposal is copied from each organization to the execution environment, the processing described in the data processing proposal is executed. After the processing is executed, the execution environment is discarded.

6. The information processing method according to claim 4, characterized in that, The data processing proposal includes: a first conditional expression representing the range of data to be shared from one of the organizations, a second conditional expression representing the range of data to be shared from another organization, and processing content, which includes information about processing functions.

7. A data processing apparatus for sharing and processing data managed in various organizations, characterized in that, The data processing device has: The architecture sharing department is responsible for sharing architectures among organizations, which define the data structure of the data maintained by each organization. The consensus-forming department receives data processing proposals that indicate the scope of shared data to be shared among organizations and the processing of such shared data as input, obtains the approval of the data processing proposals from the organizations, and forms a consensus on the data processing proposals. as well as The processing execution unit obtains the shared data as indicated by the data processing proposal that has reached a consensus among the organizations, and executes the processing indicated by the data processing proposal. The execution of the processing is carried out in a state where the shared data obtained from the organizations is concealed from other organizations among the organizations.

8. The data processing apparatus according to claim 7, characterized in that, The processing execution unit uses virtualization technology to construct an execution environment for executing the data processing proposal. After copying the shared data shown in the data processing proposal from each organization to the execution environment, the processing shown in the data processing proposal is executed. After the processing is executed, the execution environment is discarded.

9. The data processing apparatus according to claim 7, characterized in that, The data processing proposal includes: a first conditional expression representing the range of data to be shared from one of the organizations, a second conditional expression representing the range of data to be shared from another organization, and processing content, which includes information about processing functions.

10. A recording medium, characterized in that, The recording medium contains a program that causes the computer to operate as a component of the data processing apparatus as described in claim 7 or 8.

Images