Cross-domain data fusion analysis method based on distributed oblivious transfer

Abstract

The present invention belongs to the field of IT and software development / platform technology, and discloses a cross-domain data fusion analysis method based on distributed oblivious transmission, S1. different business domains persist business data in a local database through transactions; S2. one or more of the multiple business domains are selected as the calculation initiator. The present invention directly completes the analysis calculation by using the analysis side of the HTAP database, without the need to rebuild the analysis environment; the overall architecture naturally expands with the expansion of the distributed database, inherits its elastic computing capabilities, does not need to redesign the elastic architecture for secure computing, and has strong computing power. In summary, the proposed method has great advantages in solving the cross-domain data fusion analysis needs of privacy protection for analysis initiators in the modern Internet environment, and provides a fast, convenient, secure and highly scalable new method for the general application needs of both privacy protection for analysis initiators and cross-domain data fusion analysis in the modern Internet environment.

Description

Technical Field

[0001] The present invention belongs to the field of IT and software development / platform technology, and specifically relates to a cross-domain data fusion analysis method based on distributed oblivious transmission. Background Art

[0002] Data often needs to be integrated across multiple business domains to realize its true value. The modern Internet environment provides convenience for this demand. However, the requirement of privacy protection means that the parties that own business data do not have legal or internal and external regulatory permission to conduct data integration. Even if permission is obtained, it is necessary to perform outbound operations on the data already in the database, and then change or even redesign and build the application analysis environment, and then become familiar with and choose to use technical methods that are completely different from the database to implement analysis and calculations. Even if privacy computing is used at this time, these links cannot be avoided; talents and teams in various aspects need to be reserved; at the same time, the elasticity of privacy computing needs to be specially redesigned and implemented, resulting in low overall efficiency, cumbersome processes, and too many links bringing more insecurity, poor feasibility, and high costs.

[0003] In addition, the cross-domain data fusion methods in the existing technologies require the warehousing, reconstruction of the analysis environment, establishment of new technical methods, establishment of new technical teams, etc., which are inefficient, cumbersome, unsafe, and have poor practicality and promotion. Summary of the invention

[0004] The purpose of the present invention is to provide a cross-domain data fusion analysis method based on distributed oblivious transfer to solve the problems raised in the above background technology.

[0005] In order to achieve the above object, the present invention provides the following technical solution: a cross-domain data fusion analysis method based on distributed oblivious transmission,

[0006] S1. Use transactions to persist business data from different business domains into a local database;

[0007] S2. Select one or more of the multiple business domains as the calculation initiator and set the recipient of the calculation result;

[0008] S3. The calculation initiator selects data units (tables, fields) from other business domains to participate in the calculation by viewing the global metadata;

[0009] S4. The computing initiator writes the cross-domain analysis and computing requirements in SQL statements, obtains the data source outside the local domain in the analysis and computing, selects the UDF operator DOT implemented by the oblivious transfer algorithm, uses the cross-domain data unit participating in the computing selected in S3 as the input parameter of the UDF function DOT, and executes the call;

[0010] S5. The cross-domain analysis and computing requirements are executed on the HTAP analysis side of the computing initiator. The execution plan is controlled by the database node. The external domain field data involved in the oblivious transfer algorithm DOT function is obtained securely in plain text by the oblivious transfer algorithm OT operator wrapped by the UDF operator.

[0011] S6. The OT operator executes the Oblivious Transfer calculation process according to the selected external domain field;

[0012] S7. The calculation initiator database completes the calculation process according to the execution calculation, obtains the analysis results, and shares them with the participants who can obtain the results according to the settings.

[0013] Preferably, the data units participating in the calculation of the other business domains include data tables and fields.

[0014] Preferably, the metadata list of each business domain integrated in the global metadata can be manually selected in an offline Excel spreadsheet manner.

[0015] Preferably, the OT protocol algorithm adopts n-choose-1 OT protocol algorithm which can be used to implement the cross-domain data fusion analysis method based on distributed oblivious transfer.

[0016] Preferably, the n-choose-1 OT protocol algorithm implementation steps include:

[0017] S1. Generate random numbers;

[0018] S2. Encrypt the random number with the public key PKx corresponding to the pre-set external domain field and transmit it to the corresponding external domain database. The external domain database has a private key list (SKx, SKy) to decrypt the random number and perform XOR calculation with each field to obtain (Ex, Ey);

[0019] S3. Transmitted back to the calculation initiation domain, the calculation initiation domain database uses the original random number XOR with the value transmitted from the external domain to obtain (Mx, My), and securely obtains the plaintext Mx of the external domain field.

[0020] The beneficial effects of the present invention are as follows:

[0021] The present invention designs the entire cross-domain data fusion process as a natural functional characteristic of the database, and the original database operation and developers can directly use the federated computing mode to achieve it, which is convenient and easy to use; the oblivious transfer algorithm is embedded in the database UDF to shield the learning cost of new technologies, and there is no need to build a new technical team for this purpose; all calculations are completed in the database, and the business data itself is in the database, and no special data migration cost is required, which is safe and efficient; the analysis and calculation are also directly completed by the analysis side of the HTAP database, and there is no need to rebuild the analysis environment; the overall architecture naturally expands with the expansion of the distributed database, inherits its elastic computing capabilities, and does not need to redesign the elastic architecture for secure computing, and has strong computing power. In summary, the proposed method has great advantages in solving the cross-domain data fusion analysis needs of the analysis initiator privacy protection in the modern Internet environment, and provides a fast, convenient, secure and scalable new method for the general application needs of both the analysis initiator privacy protection and cross-domain data fusion analysis in the modern Internet environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 Schematic diagram of the analytical method of the present invention. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0024] like Figure 1 As shown, the embodiment of the present invention provides a cross-domain data fusion analysis method based on distributed oblivious transfer, 1. In an interconnected Internet or industry alliance network environment, different business domains persist business data in a local database through transactions;

[0025] 2. Select one (or several) of the multiple business domains as the calculation initiator, and set the recipient of the calculation results;

[0026] 3. The calculation initiator can select data units (tables, fields) from other business domains to participate in the calculation by viewing the global metadata (Note: the global metadata integrates the metadata list of each business domain, which can be realized in a graphical visualization way in the present invention, or can be manually selected in an offline Excel table way);

[0027] 4. The computing initiator writes cross-domain analysis and computing requirements in SQL statements. The analysis and computing capabilities are limited to the analysis capabilities of the HTAP database analysis side. The data sources outside the local domain are obtained during the analysis and computing. The UDF operator (DOT) implemented by the Oblivious Transfer algorithm is selected. That is, the cross-domain data units (tables, fields) participating in the calculation selected in step 3 are used as input parameters of the UDF function DOT and the call is executed.

[0028] 5. The cross-domain analysis and computing requirements are executed on the HTAP analysis side of the computing initiator. The execution plan is controlled by the database node. The external domain field data involved in the oblivious transfer algorithm DOT function is obtained securely in plain text by the oblivious transfer algorithm OT operator wrapped by the UDF operator, as shown in step 6 below.

[0029] 6. The OT operator executes the Oblivious Transfer calculation process according to the selected external domain field (according to the application implementation of the present invention, the n-choose-1 OT protocol method can be adopted. The present invention takes the 2-choose-1 OT algorithm as an example to illustrate, for example, if you want to securely obtain the external domain field Mx,): generate a random number, encrypt the random number with the pre-set public key PKx corresponding to the external domain field, and transmit it to the corresponding external domain database. The external domain database has a private key list (SKx, SKy) to decrypt the random number, and perform XOR calculation with each field to obtain (Ex, Ey), which is transmitted back to the calculation initiation domain. The calculation initiation domain database uses the original random number XOR with the value transmitted from the external domain to obtain (Mx, My), and securely obtains the plaintext Mx of the external domain field;

[0030] 7. The calculation initiator database completes the calculation process according to the execution calculation, obtains the analysis results, and shares them with the participants who can obtain the results according to the settings.

[0031] Working principle and usage process:

[0032] When data from multiple different businesses are persisted in multiple cross-domain databases, the analytical capabilities of the HTAP database are used to directly use SQL statements to perform fusion analysis of cross-domain data in the database UDF calculation mode. The entire calculation process ensures that all data sources (including cross-domain) selected by the calculation initiator are available but invisible to the distributed participants, thereby protecting the privacy of the calculation party's intentions and specifying the participants who have the right to obtain the calculation results.

[0033] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0034] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. Cross-domain data fusion analysis method based on distributed oblivious transfer, Features: S1. Use transactions to persist business data from different business domains into a local database; S2. Select one or more of the multiple business domains as the calculation initiator and set the recipient of the calculation result; S3. The calculation initiator selects data units from other business domains to participate in the calculation by viewing the global metadata; S4. The computing initiator writes the cross-domain analysis and computing requirements in SQL statements, obtains the data source outside the local domain in the analysis and computing, selects the UDF operator DOT implemented by the oblivious transfer algorithm, uses the cross-domain data unit participating in the computing selected in S3 as the input parameter of the UDF function DOT, and executes the call; S5. The cross-domain analysis and computing requirements are executed on the HTAP analysis side of the computing initiator. The execution plan is controlled by the database node. The external domain field data involved in the oblivious transfer algorithm DOT function is obtained securely in plain text by the oblivious transfer algorithm OT operator wrapped by the UDF operator. S6. The OT operator executes the Oblivious Transfer calculation process according to the selected external domain field; S7. The calculation initiator database completes the calculation process according to the execution calculation, obtains the analysis results, and shares them with the participants who can obtain the results according to the settings; The OT protocol algorithm adopts n-choose-1 OT protocol algorithm which can be used to implement the cross-domain data fusion analysis method based on distributed oblivious transmission; The n-choose-1 OT protocol algorithm implementation steps include: S1. Generate random numbers; S2. Encrypt the random number with the public key PKx corresponding to the pre-set external domain field and transmit it to the corresponding external domain database. The external domain database has a private key list (SKx, SKy) to decrypt the random number and perform XOR calculation with each field to obtain (Ex, Ey); S3. Transmitted back to the calculation initiation domain, the calculation initiation domain database uses the original random number XOR with the value transmitted from the external domain to obtain (Mx, My), and securely obtains the plaintext Mx field of the external domain field.

2. According to claim 1, the cross-domain data fusion analysis method based on distributed oblivious transfer, Features: The data units participating in the calculation of other business domains include data tables and fields.

3. According to claim 1, the cross-domain data fusion analysis method based on distributed oblivious transfer, Features: The metadata list of each business domain integrated by the global metadata can be manually selected in an offline Excel spreadsheet manner.

Images