Distributed privacy computing method, system, electronic device and storage medium

Abstract

Embodiments of the present invention relate to a method, system, electronic device and storage medium for distributed privacy computing, wherein a privacy computing access terminal receives a privacy computing request and obtains the steps of privacy computing; the privacy computing access terminal sequentially executes the steps of privacy computing, allocates the computing steps that can be completed by a time series database to the time series database to complete the computing, and reads the computing results of the time series database; after the privacy computing access terminal completes the steps of privacy computing, it returns the final result of the privacy computing. The present invention allocates part of the computing tasks to the time series database through the privacy computing access terminal, realizes the joint computing of the two, and utilizes the computing function of the time series database itself to perform computing based on the data stored therein. The amount of data read by the time series database is reduced, the interaction time of reading data is saved, and the speed of privacy security computing is improved.

Description

Technical Field

[0001] The present invention relates to the field of privacy computing technology, and in particular to a distributed privacy computing method, system, electronic device and storage medium. Background Art

[0002] Privacy-safe computing refers to a collection of technologies that implement data analysis and computing while protecting the data from external disclosure, so as to achieve the goal of making data "available but invisible"; and to achieve the transformation and release of data value while fully protecting data and privacy security. The amount of data sent on the Internet every day is very large, and privacy-safe computing faces the challenge of reading and computing a large amount of data.

[0003] The full name of the time series database is time series database. Time series database refers to the data mainly used to process data with time tags, which is also called time series data. Time series data is mainly collected and generated by various types of real-time monitoring, inspection and analysis equipment in the power industry, chemical industry, meteorological industry, geographic information, etc. The typical characteristics of these industrial data are: fast generation frequency, heavy dependence on collection time, large number of measurement points and large amount of information. Conventional real-time monitoring systems have thousands of monitoring points, which generate data every second, and generate tens of GB of data every day.

[0004] The time series big data solution uses a special storage method to efficiently store and quickly process massive time series big data, which is an important technology for solving massive data processing. Currently, the use of time series databases is only focused on distributed storage of data, and the time series database reads data for further calculations, which results in a large amount of data being read and takes a long time. Summary of the invention

[0005] In response to the problems existing in the prior art, the present invention provides a method, system, electronic device and storage medium for distributed privacy computing, so that some calculation steps in joint privacy computing are completed by a time series database, and the calculation function of the time series database itself is used to complete the calculation and directly give the calculation results, thereby reducing the amount of data read from the time series database and improving the calculation speed of the joint calculation.

[0006] To achieve the above object, the present invention provides a distributed privacy computing method, comprising:

[0007] The privacy computing access end receives the privacy computing request and obtains the privacy computing steps;

[0008] The privacy computing access terminal sequentially executes the privacy computing steps, allocates the computing steps that can be completed by the time series database to the time series database to complete the computing, and reads the computing results of the time series database;

[0009] After the privacy computing access end completes the steps of the privacy computing, it returns the final result of the privacy computing.

[0010] Furthermore, the time series database has functional functions FS0, FS1, ... FSm. The privacy computing access terminal determines the calculations that the time series database can complete based on the functional function list of the time series database, and assigns the corresponding steps to the time series database to complete the calculations.

[0011] Furthermore, the time series database completes the calculation, including:

[0012] Periodically synchronize the data required for function calculation with the data source;

[0013] Receive the calculation step i initiated by the privacy computing access terminal; extract the data required to calculate the calculation step i, call the corresponding function, complete the calculation of the calculation step i, and form a calculation result.

[0014] Furthermore, the privacy computing access terminal sequentially performs the steps of the privacy computing, further comprising:

[0015] The calculation steps that the time series database cannot complete or the calculation steps that use data that need to be protected are executed by the privacy computing access terminal; the privacy computing access terminal reads the required data from the time series database, reads the calculation results of the previous step, and completes the calculation of this step.

[0016] Furthermore, the privacy computing steps, the first step and the last step are calculated by the privacy computing access terminal.

[0017] On the other hand, a distributed privacy computing system is provided, including several distributed terminals

[0018] The distribution end includes a privacy computing access end and a time series database;

[0019] The privacy computing access end receives the privacy computing request sent by the privacy computing center end, obtains the steps of privacy computing, allocates the computing steps that the time series database can execute to the time series database to complete the calculation, and reads the calculation results of the time series database; after completing the steps of the privacy computing, returns the final result of the privacy computing.

[0020] Furthermore, the time series database has functional functions FS0, FS1, ... FSm; the privacy computing access terminal determines the calculations that the time series database can complete based on the functional function list of the time series database, and allocates the corresponding steps to the time series database to complete the calculations.

[0021] Furthermore, the time series database completes the calculation, including:

[0022] Periodically synchronizes the data source with the data source to calculate the data required by the function

[0023] Receive the calculation step i initiated by the privacy computing access terminal; extract the data required to calculate the calculation step i, call the corresponding function, complete the calculation of the calculation step i, and form a calculation result.

[0024] The third aspect provides an electronic device, including a processor and a memory, wherein the memory is used to store program instructions, and the processor is used to call the program instructions to execute the distributed privacy computing method.

[0025] The fourth aspect provides a computer-readable storage medium having a computer program stored thereon, which implements the distributed privacy computing method when executed by a processor.

[0026] The above technical solution of the present invention has the following beneficial technical effects:

[0027] (1) The present invention allocates part of the computing tasks to the time series database through the privacy computing access terminal, realizes the joint computing of the two, and uses the computing function of the time series database itself to perform calculations based on the data stored in it. This reduces the amount of data read by the time series database, saves the interaction time of reading data, and thus improves the speed of privacy-safe computing.

[0028] (2) The present invention utilizes the fast computing characteristics of time series databases to greatly improve the completion speed of each step of privacy-safe computing. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 is a flow chart of a method for distributed privacy computing provided by some embodiments;

[0030] Figure 2 A schematic diagram of the distributed privacy computing system provided in some embodiments;

[0031] Figure 3 A schematic diagram of the electronic device composition. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical scheme and advantages of the present invention clearer, the present invention is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings. It should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present invention. In addition, in the following description, the description of well-known structures and technologies is omitted to avoid unnecessary confusion of the concept of the present invention.

[0033] In some embodiments, a method for distributed privacy computing is provided, combining Figure 1 , including the following steps:

[0034] S100 The privacy computing access terminal receives the privacy computing request and obtains the privacy computing steps.

[0035] The privacy computing request sent by the privacy computing center includes several steps. Each step contains a corresponding calculation.

[0036] S200 The privacy computing access terminal sequentially executes the steps of the privacy computing, allocates the computing steps that can be completed by the time series database to the time series database to complete the computing, and reads the computing results of the time series database.

[0037] Traditional privacy computing steps are all completed by the privacy computing access end, which needs to constantly obtain the stored data from the time series database, and the reading of data takes a lot of time. After the time series database loads some functional functions, it can directly perform calculations on the stored data. For example, the mean function calculates the average value, the max function finds the maximum value, the min function finds the minimum value, and the count function counts the number.

[0038] If a certain calculation step is to calculate the mean of some basic data, then after the time series database completes the mean calculation, the mean will be sent to the privacy computing access end. On the one hand, it saves the time of the privacy computing access end in reading the basic data. On the other hand, it can utilize the fast calculation function of the time series database itself, greatly speeding up the privacy computing.

[0039] A privacy computing request includes N privacy computing steps: F1, F2…Fi…FN. Each computing step completes the calculation based on the calculation result of the previous step and the read data.

[0040] The time series database has function functions FS0, FS1, ... FSm, Gn is the function of the time series database, Gn = Gn (FS0, FS1, ... FSm), and the time series database calls one or more function functions to complete the corresponding calculation. Furthermore, the function functions of the time series database can be configured according to the needs of privacy computing, so that the time series database can perform more calculation steps.

[0041] The privacy computing access terminal configures the functional functions of the time series database, determines the calculations that the time series database can complete, and assigns the corresponding steps to the time series database to complete the calculations. The calculation steps that the time series database cannot complete or the calculation steps that use data that need to be protected are executed by the privacy computing access terminal. The privacy computing access terminal reads the required data from the time series database, reads the calculation results of the previous step, and completes the calculation of this step. The calculations that cannot be completed are calculations that do not have corresponding functional functions. In order to ensure the security of the data, calculations involving privacy data are concentrated on the privacy computing access terminal for privacy calculations.

[0042] The time series database periodically calculates and stores the data of the data source required for the synchronization function. Receive the calculation step i initiated by the privacy computing access terminal; extract the data required for the calculation step i, call the corresponding function, complete the calculation of the calculation step i, and form a calculation result. The data required for step i includes the calculation result of step i-1 and the data of the synchronization data source required for the calculation of the function function of this step.

[0043] The synchronization methods include active reading and passive receiving of time series database.

[0044] In one embodiment, the first step F1 and the last step F4 are completed by the privacy computing access terminal, and the second step F2 and the third step F3 are completed by the time series database. After completing F1, the privacy computing access terminal outputs the calculation result f1 to the time series database; the time series database calls the corresponding function or function combination according to the calculation requirements of step F2, and obtains the result f2 based on f1 and the read data calculation; the time series database calls the corresponding function or function combination according to the calculation requirements of step F3, and obtains the result f3 based on f2 and the read data calculation; the privacy computing access terminal reads f3, performs the calculation of step F4 to obtain the final calculation result f4.

[0045] The database provides more than 1,000 built-in functions, such as using the count function to count data, using the mean function to calculate the mean of data, using the sub function to calculate the difference of data, using the prod function to calculate the product of data, and using the log function to calculate the product of data.

[0046] The calculations provided by the database include algorithms built into the database, or algorithms implemented by time series database programming, such as using SQL statements to implement commonly used elimination algorithms, such as the least frequently used algorithm LFU, the least recently used algorithm LRU, the adaptive cache replacement algorithm ARC, the first-in-first-out algorithm FIFO, and the most recently used algorithm MRU.

[0047] S300 After the privacy computing access end completes the steps of the privacy computing, it returns the final result of the privacy computing.

[0048] In some embodiments, a distributed privacy computing system is provided, in combination with Figure 2 , including several distribution ends.

[0049] The distribution end includes a privacy computing access end 2 and a time series database 3.

[0050] The privacy computing access end receives the privacy computing request sent by the privacy computing center end, obtains the steps of privacy computing, allocates the computing steps that the time series database can execute to the time series database to complete the calculation, and reads the calculation results of the time series database; after completing the steps of the privacy computing, returns the final result of the privacy computing.

[0051] The time series database has function functions FS0, FS1, ... FSm; the privacy computing access terminal determines the calculations that the time series database can complete based on the function list of the time series database, and assigns the corresponding steps to the time series database to complete the calculations. The calculation steps that the time series database cannot complete are performed by the privacy computing access terminal; the privacy computing access terminal reads the required data from the time series database, reads the calculation results of the previous step, and completes the calculation of this step.

[0052] The time series database completes the calculation, including: periodically synchronizing with the data source and storing the data required for the function calculation; receiving the calculation step i sent by the privacy computing access terminal; extracting the data required for the calculation step i, calling the corresponding function, and forming the calculation result. The data required for step i includes the calculation result of step i-1 and the data of the synchronized data source required for the function calculation of this step.

[0053] The calculation steps that the time series database cannot complete or the corresponding function functions need to call data across databases, and the calculation steps are executed by the privacy computing access terminal; the privacy computing access terminal reads the required data from the time series database, reads the calculation results of the previous step, and completes the calculation of this step.

[0054] In some embodiments, the privacy computing access end and the time series database of each distribution end use the same container (Docker), and each distribution end forms an independent container.

[0055] In some embodiments, an electronic device is provided, in combination with Figure 3 , including a processor and a memory, the memory is used to store program instructions, and the processor is used to call the program instructions to execute the distributed privacy computing method.

[0056] The memory may be a read-only memory (ROM), a static storage device, a dynamic storage device or a random access memory (RAM). The memory may store a program. When the program stored in the memory is executed by the processor, the processor executes each step of the image processing method of the embodiment of the present application. For example, the processor may execute Figure 1 The method of distributed privacy computing of the illustrated embodiment.

[0057] The processor can be a general-purpose central processing unit (CPU), a microprocessor, an application specific integrated circuit (ASIC), or one or more integrated circuits to execute relevant programs to implement the image processing method of the method embodiment of the present application.

[0058] The processor may also be an integrated circuit chip with signal processing capability. In the implementation process, each step of the image processing method of the embodiment of the present application may be completed by an integrated logic circuit of hardware in the processor or by instructions in the form of software.

[0059] The processor may also be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The methods, steps, and logic block diagrams disclosed in the embodiments of the present application may be implemented or executed. The general purpose processor may be a microprocessor or the processor may be any conventional processor, etc.

[0060] The steps of the method disclosed in the embodiment of the present application can be directly embodied as being executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a random access memory, flash memory, read-only memory, programmable read-only memory or electrically erasable programmable memory, registers, and other mature storage media in the art. The storage medium is located in the memory, and the processor reads the information in the memory and completes the functions required to be executed by the units included in the image processing device in the embodiment of the present application in combination with its hardware, or the image processing method of the method embodiment of the present application can be executed. Figure 1 Distributed privacy computing of the illustrated embodiment.

[0061] In addition, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores program instructions, and when the program instructions are executed by a processor, a method for implementing distributed privacy computing is implemented. The method at least includes:

[0062] The privacy computing access end receives the privacy computing request and obtains the privacy computing steps.

[0063] The privacy computing access terminal sequentially executes the privacy computing steps, allocates the computing steps that can be completed by the time series database to the time series database to complete the computing, and reads the computing results of the time series database

[0064] After the privacy computing access end completes the steps of the privacy computing, it returns the final result of the privacy computing.

[0065] The computer-readable storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer-readable storage medium may be any combination of one or more computer-readable storage media.

[0066] In summary, the embodiments of the present invention relate to a method, system, electronic device and storage medium for distributed privacy computing, wherein the privacy computing access terminal receives a privacy computing request and obtains the steps of privacy computing; the privacy computing access terminal sequentially executes the steps of the privacy computing, allocates the computing steps that can be completed by the time series database to the time series database to complete the computing, and reads the computing results of the time series database; after the privacy computing access terminal completes the steps of the privacy computing, it returns the final result of the privacy computing. The present invention allocates part of the computing tasks to the time series database through the privacy computing access terminal, realizes the joint privacy computing of the two, and utilizes the computing function of the time series database itself to perform calculations based on the data stored therein. The amount of data read by the time series database is reduced, the interaction time for reading data is saved, and the speed of privacy security computing is improved.

[0067] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0068] It should be understood that the above specific embodiments of the present invention are only used to illustrate or explain the principles of the present invention, and do not constitute a limitation of the present invention. Therefore, any modifications, equivalent substitutions, improvements, etc. made without departing from the spirit and scope of the present invention should be included in the protection scope of the present invention. In addition, the appended claims of the present invention are intended to cover all changes and modifications that fall within the scope and boundaries of the appended claims, or the equivalent forms of such scope and boundaries.

Claims

1. A distributed privacy computing method, characterized in that: include: The privacy computing access end receives the privacy computing request and obtains the privacy computing steps; The privacy computing access end sequentially executes the steps of the privacy computing, allocates the computing steps that can be completed by the time series database to the time series database to complete the computing, and reads the computing results of the time series database; the time series database has function functions FS0, FS1, ... FSm, and the privacy computing access end determines the computing that can be completed by the time series database according to the function function list of the time series database, and allocates the corresponding steps to the time series database to complete the computing; After the privacy computing access end completes the steps of the privacy computing, it returns the final result of the privacy computing.

2. The method for distributed privacy computing according to claim 1, characterized in that: The time series database completes the calculation, including: Periodically synchronize the data required for function calculation with the data source; Receive the calculation step i initiated by the privacy computing access terminal; extract the data required to calculate the calculation step i, call the corresponding function, complete the calculation of the calculation step i, and form a calculation result.

3. The method for distributed privacy computing according to claim 2, characterized in that: The privacy computing access terminal sequentially performs the steps of the privacy computing, further comprising: The calculation steps that the time series database cannot complete or the calculation steps that use data that need to be protected are executed by the privacy computing access terminal; the privacy computing access terminal reads the required data from the time series database, reads the calculation results of the previous step, and completes the calculation of this step.

4. The method for distributed privacy computing according to claim 1, characterized in that: The privacy computing steps, the first step and the last step are calculated by the privacy computing access terminal.

5. A distributed privacy computing system, characterized in that: including several distribution terminals; The distribution end includes a privacy computing access end and a time series database; The privacy computing access end receives the privacy computing request sent by the privacy computing center end, obtains the privacy computing steps, assigns the computing steps that the time series database can execute to the time series database to complete the computing, and reads the computing results of the time series database; the time series database has functional functions FS0, FS1,...FSm; the privacy computing access end determines the computing that the time series database can complete based on the functional function list of the time series database, and assigns the corresponding steps to the time series database to complete the computing; after completing the steps of the privacy computing, the final result of the privacy computing is returned.

6. The distributed privacy computing system according to claim 5, characterized in that: The time series database completes the calculation, including: Periodically synchronizes the data source with the data source to calculate the data required by the function Receive the calculation step i initiated by the privacy computing access terminal; extract the data required to calculate the calculation step i, call the corresponding function, complete the calculation of the calculation step i, and form a calculation result.

7. An electronic device comprising a processor and a memory, wherein the memory is used to store program instructions, characterized in that: The processor is used to call the program instructions to execute the distributed privacy computing method as described in any one of claims 1-4.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for distributed privacy computing as described in any one of claims 1 to 4 is implemented.

Images