Data processing system, data processing method and device
By designing a data processing system that includes interactive units, database units and encryption processing units, the problem of insufficient data security in data fusion computing is solved, and the available and invisible data and the application scope are expanded.
Patent Information
- Application Number
- CN202411885663.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-19
- Publication Date
- 2025-04-18
AI Technical Summary
The prior art cannot effectively protect the data security of data holders, resulting in the limitation of the application scope of data fusion computing.
A data processing system is designed, including an interactive unit, a database unit and a processing unit. The interactive unit receives the client's data and instructions, the database unit stores data backup of the second data holder, and the processing unit performs fusion processing of the two parties in an encrypted state based on the data processing instructions.
Through encryption processing and independent system design, data security and privacy are ensured, data availability and invisibility are realized, and the application scope of data fusion computing is expanded.
Smart Images

Figure CN119848760A_ABST
Abstract
Description
Technical Field
[0001] One or more embodiments of the present specification relate to the field of database technology, and in particular, to a data processing system, a data processing method, and a data processing device. Background Art
[0002] With the rapid development of artificial intelligence technology and database technology, we have entered the era of Big Data. Big Data has become an important tool in many fields such as business decision-making, scientific research, and social governance. Big data refers to data sets with very large volume, fast growth rate, and a wide variety of data. These characteristics make it difficult for traditional data processing applications to effectively manage and analyze them. Big data not only refers to a large amount of data, but also covers the technologies and methods for collecting, storing, processing, and analyzing these data.
[0003] For a certain field or a certain matter, the relevant data may be owned by different data holders, and integrating the data held by these different data holders for computational analysis is often very useful and can bring huge value. However, data holders have security concerns about their own data, that is, they do not want their own data to be leaked, and hope that the data can be available but not visible.
[0004] However, the technology of performing fusion calculation on data owned by different data holders in related technologies cannot effectively protect the data security of data holders, resulting in that the application scope of fusion calculation is greatly restricted. Summary of the invention
[0005] In view of this, one or more embodiments of the present specification provide a data processing system, a data processing method, and an apparatus.
[0006] To achieve the above objectives, one or more embodiments of this specification provide the following technical solutions:
[0007] According to a first aspect of one or more embodiments of this specification, a data processing system is provided, the system comprising:
[0008] An interaction unit, configured to receive first data to be processed and a data processing instruction of a first data holder sent by a client;
[0009] A database unit, used for storing second data to be processed of a second data holder;
[0010] A processing unit is used to perform fusion processing on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction received by the interaction unit to obtain a processing result.
[0011] In a possible embodiment of the present specification, the second data to be processed stored in the database unit is a backup of part or all of the data of the second data holder.
[0012] In a possible embodiment of the present specification, the system further includes an approval unit;
[0013] The processing unit is used to send the processing result to the approval unit;
[0014] The approval unit is used to send the processing result to the client if the processing result passes the approval.
[0015] In a possible embodiment of the present specification, the interaction unit, the database unit, the processing unit and the approval unit are all arranged on a device in a data center of the second data holder.
[0016] In a possible embodiment of the present specification, the interaction unit is used to receive the first data to be processed and the data processing instruction of the first data holder sent by the client through SFTP.
[0017] In a possible embodiment of the present specification, the processing unit is generated based on TEE technology; the processing unit is independent of other units of the system at both the software and hardware levels.
[0018] In a possible embodiment of this specification, the processing unit includes a management and control module and a computing database;
[0019] The control module is used to receive the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, and input the received first data to be processed and the data processing instruction into the computing database;
[0020] The control module is used to receive the second data to be processed input locally, and input the received second data to be processed into the computing database, or the computing database is used to read the second data to be processed in the database unit;
[0021] The calculation database is used to perform fusion calculation on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction.
[0022] In a possible embodiment of the present specification, the control module is used to send the authority verification data input locally to the database unit, so that the database unit verifies the authority verification data;
[0023] The computing database is used to read the second data to be processed in the database unit when the database unit successfully verifies the authority verification data.
[0024] In a possible embodiment of the present specification, the first data to be processed includes land remote sensing data and authorized user data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the authorized user data includes identity information of the authorized user;
[0025] The second data to be processed includes land remote sensing data and land title confirmation data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land title confirmation data includes land owner, land area and land location;
[0026] The processing result includes the identity information of the authorized user and the land information, wherein the land information includes the crop type, the planting area, the land area and the land location.
[0027] In a possible embodiment of the present specification, the processing unit is used for:
[0028] Determining unified remote sensing data according to the land remote sensing data in the first data to be processed and the land remote sensing data in the second data to be processed;
[0029] A processing result is generated based on the unified remote sensing data and the land title confirmation data.
[0030] According to a second aspect of one or more embodiments of this specification, a data processing method is proposed, the method comprising:
[0031] receiving the first data to be processed and the data processing instruction sent by an interaction unit, or the first data to be processed and the data processing instruction input locally;
[0032] receiving the second data to be processed input locally, or reading the second data to be processed in a database unit;
[0033] Based on the data processing instruction, the first data to be processed and the second data to be processed are fused in an encrypted state.
[0034] According to a third aspect of one or more embodiments of this specification, a data processing device is provided, the device comprising:
[0035] A first data import module, used for receiving the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally;
[0036] A second data import module, used for receiving the second data to be processed input locally, or reading the second data to be processed in a database unit;
[0037] A fusion processing module is used to perform fusion processing on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction.
[0038] According to a fourth aspect of one or more embodiments of this specification, a computer program product is proposed, comprising a computer program / instruction, which implements the steps of the method described in the second aspect when executed by a processor.
[0039] According to a fifth aspect of one or more embodiments of this specification, an electronic device is provided, including:
[0040] processor;
[0041] a memory for storing processor-executable instructions;
[0042] The processor implements the method as described in the second aspect by running the executable instructions.
[0043] According to a sixth aspect of one or more embodiments of the present specification, a computer-readable storage medium is provided, on which computer instructions are stored, and when the instructions are executed by a processor, the steps of the method described in the second aspect are implemented.
[0044] The technical solutions provided by the embodiments of this specification may have the following beneficial effects:
[0045] The data processing system provided in the embodiment of this specification includes an interaction unit, a database unit and a processing unit. The interaction unit is used for interacting with the first data holder to obtain the data to be processed and the data processing instructions sent by the first data holder through the client. The database unit is used to back up or store the data to be processed owned by the second data holder, and the processing unit can perform fusion processing on the data to be processed owned by the first data holder and the data to be processed owned by the second data holder in an encrypted state based on the above data processing instructions to obtain the processing result. In this system, the interaction unit used to interact with the first data holder to obtain data, the database unit used to back up or store the data owned by the second data holder, and the processing unit actually used for encryption calculation are independent of each other, so that while fusing the data owned by the above two data holders, the data security is protected, and the data is available but invisible. Therefore, the system can be applied to data fusion calculations of different data holders to expand the application scope of fusion calculations. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] Figure 1is a schematic diagram of a data processing system provided by an exemplary embodiment.
[0047] Figure 2 is a schematic diagram of a processing unit provided by an exemplary embodiment.
[0048] Figure 3 is a flowchart of a data processing method provided by an exemplary embodiment.
[0049] Figure 4 It is a structural schematic diagram of a device provided by an exemplary embodiment.
[0050] Figure 5 is a block diagram of a data processing device provided by an exemplary embodiment. DETAILED DESCRIPTION
[0051] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of this specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the appended claims.
[0052] It should be noted that: in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may be combined into a single step for description in other embodiments.
[0053] Based on the above technical problems, at least one embodiment of the present specification provides a data processing system, which can perform fusion calculations on data of different data holders and protect the data security of data holders during the fusion calculation process, thereby achieving the availability and invisibility of data, expanding the application scope of data fusion calculations, and improving data utilization.
[0054] The data holders mentioned in this specification may be individuals, businesses, functional departments, etc. In one example, the data of agricultural users of a banking institution and the land data of an agricultural functional department are integrated and calculated to determine the credit assessment results of the banking institution on the agricultural user. In this example, the banking institution and the agricultural functional department are two different data holders. When describing the data processing system below, this example can be used as an example for explanation. For the convenience of description, this example is referred to as the agricultural user credit assessment example below.
[0055] Please refer to the attached Figure 1 , which exemplarily shows a structural diagram of the data processing system, wherein the system includes an interaction unit, a database unit and a processing unit.
[0056] The interaction unit is described in detail below.
[0057] The interaction unit is used to receive the first data to be processed and the data processing instructions of the first data holder sent by the client. In other words, the interaction unit and the client are both applications of the first data holder. The interaction unit can serve as the server of the application of the first data holder, and the client can serve as the client of the application of the first data holder. It can be understood that the first data holder interacts with the data processing system through the client and instructs the data processing system to process the data with the data processing instructions. Then the first data holder is the demander of the data fusion calculation, and the second data holder mentioned below is the data supporter of the fusion calculation.
[0058] For example, the interaction unit may be used to receive the first data to be processed and the data processing instruction of the first data holder sent by the client via SFTP (SSH File Transfer Protocol or Secure File Transfer Protocol). SFTP is a network protocol for secure file transfer via SSH protocol, which not only provides file transfer function, but also supports various operations of remote file system, such as creating, deleting, renaming files and directories, etc.
[0059] For example, taking the above-mentioned agricultural user credit assessment example, the first data holder may be a banking institution. The first data to be processed is the data of agricultural users of the banking institution, such as land remote sensing data and authorized user data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land identification may be a land number; the authorized user data includes the identity information of the authorized user, and the authorized user refers to a user whose authorization status is authorized (i.e., the banking institution is authorized to obtain the user's identity information, land information, etc. for credit assessment), and the identity information may be name, certificate number, contact information, etc. The data processing instruction is used to instruct the data processing system to perform a fusion calculation on the data of the banking institution and the agricultural functional department to obtain the credit assessment result of the authorized user.
[0060] Land remote sensing data can be divided according to crops. The land remote sensing data of each crop can be represented by a geotif file. The integer value of each pixel in the file represents whether the crop is planted, that is, 0 represents unplanted and 1 represents planted. For example, compress the geotif file into a 2048*2048 png format, and the file name contains parameters such as the upper left corner coordinates and resolution.
[0061] Alternatively, land remote sensing data may not be divided according to crops. The land remote sensing data is represented by a geotif file. The integer value of each pixel in the file represents whether crops are planted and the type of crops planted, that is, 0 represents no crops, and 1, 2, 3, ..., n represent a crop respectively.
[0062] The database unit is described in detail below.
[0063] The database unit is used to store the second data to be processed of the second data holder. For example, the second data to be processed stored in the database unit is a backup of part or all of the data of the second data holder. As mentioned above, if the second data holder is a data supporter of the fusion calculation, it only needs to provide the data required for the fusion calculation, and the data required for the calculation can be provided by backing up to a separate database, that is, the database unit in the system.
[0064] For example, the database unit can be used as a temporary database or a distributed database. The database type is not limited and can be a database of Oracle, MySQL, Postgres, etc., or a CSV file.
[0065] For example, taking the agricultural user credit assessment example, the second data holder may be an agricultural functional department. The second data to be processed includes land remote sensing data and land title confirmation data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land title confirmation data includes land owner, land area and land location.
[0066] Please refer to the attached Figure 2 , the processing unit is described in detail below.
[0067] The processing unit is used to perform fusion processing on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction received by the interaction unit to obtain a processing result.
[0068] Optionally, the processing unit is generated based on TEE (Trusted Execution Environment) technology; the processing unit is independent of other units of the system at both the software and hardware levels, forming a TEE secret space-time computing system, which adopts a single isolation technology, only accepts file input and business instruction input, and does not directly return data or data files to the external system. TEE is a technical architecture that provides a secure and isolated environment in which code can be executed and data can be processed, ensuring that sensitive data and code remain secure even if the operating system or virtual machine hypervisor is compromised. TEE combines the security features of hardware and software and is widely used in protecting privacy, enhancing security, and supporting trusted computing scenarios. For example, a processing unit can be generated based on specific TEE technologies such as Intel SGX (Software Guard Extensions), ARM TrustZone, AMD SEV (Secure Encrypted Virtualization), Microsoft Windows Defender Application Guard, and Google Asylo.
[0069] Preferably, a TEE OS (Operating System) is built based on Occlum technology and various functional modules are deployed on the TEE OS to implement the processing unit. Occlum is an open source TEE OS developed based on the Rust language, supporting Intel SGX (Software Guard Extensions) and AMD SEV (Secure Encrypted Virtualization), etc., and can create secure containers called enclaves on computers. These containers are a trusted execution environment (TEE) in which applications and data can be protected from malware and hackers. In enclaves, all code and data are encrypted, and the encryption algorithm uses national secret SM2, SM4 and other algorithms, and only legitimate applications can access these data. Even if the operating system is attacked, the data in the enclave cannot be obtained. The TEE secret space-time computing system built based on Occlum technology supports file encryption and computational encryption, can protect memory security, achieve efficient multi-process, and has performance at least 1000 times faster than other open source SGX OS.
[0070] Exemplarily, the processing unit includes a management and control module and a computing database. The management and control module is used to receive the first data to be processed and the data processing instruction sent by the interactive unit, or the first data to be processed and the data processing instruction input locally, and input the received first data to be processed and the data processing instruction into the computing database. The management and control module is used to receive the second data to be processed input locally, and input the received second data to be processed into the computing database, or the computing database is used to read the second data to be processed in the database unit. The computing database is used to perform fusion calculation on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction.
[0071] For example, the computing database and the control module can be deployed on the TEE OS in the processing unit to implement the module functions in an encrypted state in a trusted execution environment. For example, the module functions are executed in enclaves provided by Occlum technology to complete the data processing tasks of the processing unit.
[0072] For example, the computing database may be a distributed spatiotemporal computing database, such as a database built based on open source Postgresql. It should be understood that the database unit may be the same as the architecture of the computing database. The control module may provide functions such as operator identity authentication, data import and export, computing control, and authority verification. The operator identity authentication function refers to identifying the identity of the operator based on the identity, password, and other information input by the operator, and judging whether the operator is a legitimate operator. If the operator is a legitimate operator, the operator is allowed to operate the control module to perform functions within the scope of his authority. If the operator is not a legitimate operator, the operator is refused to operate the control module. The data import and export function refers to the import of data into the computing database via the control module, or the export of the computing database via the control module. The computing control function refers to the execution of calculations and analyses on the data in the computing database. The authority verification function refers to enabling the computing database to submit an authority verification request to other databases (such as the database unit in the system) to read the data in other databases after passing the verification, so as to realize the plug-in of the data table of the computing database, increase the flexibility of data utilization, and avoid the workload of data import.
[0073] In this example, the first data to be processed and the data processing instructions are input into the computing database by the control module for the computing database to perform fusion calculations. The operation of migrating the first data to be processed and the data processing instructions from the interactive unit to the control module can be achieved by manual copying or automated communication. Manual copying refers to the control module receiving the first data to be processed and the data processing instructions input locally, and inputting the received first data to be processed and the data processing instructions into the computing database; that is, after receiving the first data to be processed and the data processing instructions sent by the client, the interactive unit can generate a prompt message; the legal operator can use a storage medium such as a hard disk to copy the first data to be processed to the control module, and control the control module to import the first data to be processed into the computing database through the data import function, and the operator inputs the data processing instructions into the computing database through the control module. Automated communication means that the management and control module receives the first data to be processed and the data processing instructions sent by the interactive unit, and inputs the received first data to be processed and the data processing instructions into the computing database; that is: after receiving the first data to be processed and the data processing instructions sent by the client, the interactive unit transmits the first data to be processed and the data processing instructions to the management and control module through a communication connection, so that the management and control module receives the first data to be processed and the data processing instructions and inputs them into the computing database after receiving the authorization of the legal operator.
[0074] In this example, the second data to be processed can be input into the computing database by the control module for the computing database to perform fusion calculations. The operation of migrating the second data to be processed from the interactive unit to the control module can be achieved by manual copying. Manual copying means that the control module receives the second data to be processed input locally and inputs the received second data to be processed into the computing database; that is, a legitimate operator can use a storage medium such as a hard disk to copy the second data to be processed to the control module, and control the control module to import the second data to be processed into the computing database through the data import function.
[0075] In this example, the second data to be processed can be read by the computing database by mounting the database unit as an external table. For example, the control module is used to send the permission verification data input locally to the database unit so that the database unit verifies the permission verification data; the database unit verifies based on the received permission verification data, and allows the computing database to read the data in the database unit if the verification passes, and does not allow the computing database to read the data in the database unit if the verification fails; the computing database is used to read the second data to be processed in the database unit if the database unit verifies the permission verification data.
[0076] For example, taking the agricultural user credit assessment example, the processing result may include the identity information and land information of the authorized user, wherein the land information includes the crop type, planting area, land area and land location. The processing unit performs fusion processing on the first data to be processed and the second data to be processed in the following manner:
[0077] First, unified remote sensing data is determined according to the land remote sensing data in the first data to be processed and the land remote sensing data in the second data to be processed.
[0078] The data processing instruction may include data range information such as region code and crop category. Therefore, land remote sensing data within the range indicated by the data processing instruction may be obtained from the first data to be processed, such as land remote sensing data of a specific region and a specific crop, and land remote sensing data within the range indicated by the data processing instruction may be obtained from the second data to be processed, such as land remote sensing data of a specific region and a specific crop. Then, the land remote sensing data obtained from the first data to be processed and the land remote sensing data obtained from the second data to be processed are cross-combined and calculated to fuse the land identification, crop type, planting area and land area in the land remote sensing data, so as to correct each other and obtain accurate unified remote sensing data. The unified remote sensing data includes land identification, crop type, planting area, land area and land location.
[0079] Next, a processing result is generated based on the unified remote sensing data and the land title confirmation data.
[0080] Among them, the land rights confirmation data of the specific area indicated by the data processing instruction can be obtained from the second data to be processed. Then, the acquired land rights confirmation data is matched with the unified remote sensing data obtained in the above steps, that is, the land area and land location in the land rights confirmation data are matched with the land area and land location in the unified remote sensing data, so as to obtain a matching result including the land owner, land area, land location, land identification, crop type, and planting area; then, the above matching results are screened based on the authorized user to obtain the processing result, that is, the identity information and land information of the authorized user, wherein the land information includes crop type, planting area, land area and land location. In addition, the data processing instruction can also include an acreage threshold, and if so, the records with a planting area less than the acreage threshold can also be deleted in the processing result.
[0081] For example, the planted area can be expressed as the area range it belongs to, thereby simplifying the processing results and reducing the amount of data.
[0082] For example, the processing result may further include the crop coverage ratio calculated based on the planting area and the land area. The crop coverage ratio may also be represented by the coverage ratio interval to simplify the processing result and reduce the amount of data.
[0083] For example, the location of a piece of land may be expressed in terms of the longitude and latitude of the center of the land.
[0084] As concluded from the above analysis, the first data holder is the demander of data fusion computing, and the second data holder is the data supporter of fusion computing. Then the interaction unit, the database unit and the processing unit of the data processing system can be arranged on the equipment of the data center of the second data holder, such as multiple devices in the computer room of the second data holder. It is preferred to choose Haiguang 7360 to deploy the processing unit.
[0085] Taking the above-mentioned agricultural user credit assessment example as an example, the interaction unit and processing unit provided by the banking institution can be deployed on multiple devices in the computer room of the data center of the agricultural functional department, and the database unit can be provided by the agricultural functional department or by the banking institution, and also needs to be deployed on multiple devices in the computer room of the data center of the agricultural functional department.
[0086] In this case, the first data holder can prepare equipment, install an interaction unit and a processing unit on the equipment, and input the first data to be processed into the processing unit in advance; then the prepared equipment can be arranged in the data center of the second data holder, such as a computer room. This can reduce the transmission of the first data to be processed and improve the efficiency of importing the first data to be processed. Of course, the first data to be processed carried by the equipment before it is arranged in the database center of the second data holder is the initialization data, and the subsequent supplementary data needs to be transmitted to the data processing system through the interaction unit.
[0087] The data processing system provided in the embodiment of the present specification comprises an interaction unit for interacting with the first data holder to obtain data, a database unit for backing up or storing data owned by the second data holder, and a processing unit actually used for encryption calculations, which are independent of each other, thereby protecting data security while fusing the data owned by the above two data holders, and making the data available but invisible. Therefore, the system can be applied to data fusion calculations of different data holders to expand the application scope of fusion calculations.
[0088] In some embodiments of this specification, please refer to the attached Figure 2 The data processing system further includes an approval unit; the processing unit is further configured to send a processing result to the approval unit; the approval unit is configured to send the processing result to the client if the processing result is approved.
[0089] As concluded from the previous analysis, the first data holder is the demander of data fusion calculation, and the second data holder is the data supporter of fusion calculation. The approval unit can also be deployed on the equipment of the data center of the second data holder so that the authorized approval personnel of the second data holder can approve the processing results.
[0090] Of course, if there is authorization from the second data holder, the approval unit may also be set on other authorized devices so that the authorized approval personnel can approve the processing results.
[0091] The approval results can be sent to the client via SFTP or email.
[0092] The processing results can be in the form of CSV files.
[0093] This embodiment can further protect the data security of the second data holder by setting up an approval unit, and prevent the data that should not be disclosed from being sent out and leaked.
[0094] In some embodiments of this specification, please refer to the attached Figure 2The data processing system also includes a key module for generating, managing and verifying keys, etc. The key module can be set in a trusted execution environment, such as deployed on a TEE OS, to improve the security of the key.
[0095] For example, when the client sends the first data to be processed and the data processing instructions to the interaction module, the first data to be processed and the data processing instructions can be encrypted based on the key generated by the key module for this path, and the interaction unit can decrypt the received first data to be processed and the data processing instructions based on the key, and then perform subsequent operations.
[0096] For example, the processing unit may encrypt the data in the computing database based on the key generated by the key module for the processing unit, and perform data computing in an encrypted state.
[0097] For example, when the processing unit sends the processing result to the approval unit, the processing result may be encrypted based on the key generated by the key module for the path, and the approval unit may decrypt the processing result based on the key before approval.
[0098] For example, when sending the processing result to the client, the approval unit may encrypt the processing result based on the key generated by the key module for the path, and the client may decrypt the processing result based on the key for reuse.
[0099] The keys generated by the key module for the above scenarios can be read by legitimate operators through the management and control module and manually transmitted to the encryption party and / or decryption party to protect the key security.
[0100] At least one embodiment of this specification also provides a data processing method, which can be applied to the processing unit of the data processing system in the above embodiment. Figure 3 , the method comprising:
[0101] In step S301, the first data to be processed and the data processing instruction sent by an interaction unit, or the first data to be processed and the data processing instruction input locally are received.
[0102] In step S302, the second data to be processed input locally is received, or the second data to be processed in the database unit is read;
[0103] In step S303, based on the data processing instruction, the first data to be processed and the second data to be processed are fused in an encrypted state.
[0104] In one embodiment of the present specification, the receiving the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, includes:
[0105] The management and control module receives the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, and inputs the received first data to be processed and the data processing instruction into the computing database;
[0106] The receiving the second data to be processed that is locally input includes:
[0107] receiving the second data to be processed input locally, and inputting the received second data to be processed into the computing database;
[0108] The step of reading the second data to be processed in the database unit includes:
[0109] The control module sends the authority verification data input locally to the database unit so that the database unit verifies the authority verification data;
[0110] The computing database reads the second data to be processed in the database unit when the database unit successfully verifies the authority verification data.
[0111] In one embodiment of the present specification, the first data to be processed includes land remote sensing data and authorized user data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the authorized user data includes identity information and authorization status of the authorized user;
[0112] The second data to be processed includes land remote sensing data and land title confirmation data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land title confirmation data includes land owner, land area and land location;
[0113] The processing result includes the identity information and land information of the authorized user, wherein the land information includes the crop type, planting area, land area and land location;
[0114] The step of performing fusion calculation on the first to-be-processed data and the second to-be-processed data in an encrypted state based on the data processing instruction includes:
[0115] Determining unified remote sensing data according to the land remote sensing data in the first data to be processed and the land remote sensing data in the second data to be processed;
[0116] A processing result is generated based on the unified remote sensing data and the land title confirmation data.
[0117] The above steps of the method have been introduced in detail in the above data processing system and will not be repeated here.
[0118] Figure 4 is a schematic structural diagram of a device provided by an exemplary embodiment. Figure 4 At the hardware level, the device includes a processor 402, an internal bus 404, a network interface 406, a memory 408, and a non-volatile memory 410, and may also include hardware required for other tasks. One or more embodiments of this specification may be implemented based on software, such as the processor 402 reading the corresponding computer program from the non-volatile memory 410 into the memory 408 and then running it. Of course, in addition to the software implementation, one or more embodiments of this specification do not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.
[0119] Please refer to Figure 5 , the data processing device can be applied to Figure 4 The data processing device may include:
[0120] A first data import module 501 is used to receive the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally;
[0121] A second data import module 502, used for receiving the second data to be processed input locally, or reading the second data to be processed in a database unit;
[0122] The fusion processing module 503 is used to perform fusion processing on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction.
[0123] In one embodiment of the present specification, the first data import module is used to:
[0124] The management and control module receives the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, and inputs the received first data to be processed and the data processing instruction into the computing database;
[0125] When the second data import module is used to receive the second data to be processed input locally, it is used to:
[0126] receiving the second data to be processed input locally, and inputting the received second data to be processed into the computing database;
[0127] When the second data import module is used to read the second data to be processed in the database unit, it is used to:
[0128] The control module sends the authority verification data input locally to the database unit so that the database unit verifies the authority verification data;
[0129] The computing database reads the second data to be processed in the database unit when the database unit successfully verifies the authority verification data.
[0130] In one embodiment of the present specification, the first data to be processed includes land remote sensing data and authorized user data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the authorized user data includes identity information and authorization status of the authorized user;
[0131] The second data to be processed includes land remote sensing data and land title confirmation data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land title confirmation data includes land owner, land area and land location;
[0132] The processing result includes the identity information and land information of the authorized user, wherein the land information includes the crop type, planting area, land area and land location;
[0133] The fusion processing module is used for:
[0134] Determining unified remote sensing data according to the land remote sensing data in the first data to be processed and the land remote sensing data in the second data to be processed;
[0135] A processing result is generated based on the unified remote sensing data and the land title confirmation data.
[0136] One or more embodiments of the present specification also propose a computer program product, including a computer program / instruction, which implements the steps of the method provided in the second aspect when the computer program / instruction is executed by a processor.
[0137] One or more embodiments of the present specification also propose a computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method described in the second aspect.
[0138] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer, which may be in the form of a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, a game console, a tablet computer, a wearable device or a combination of any of these devices.
[0139] In a typical configuration, a computer includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0140] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0141] Computer-readable media include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, disk storage, quantum memory, graphene-based storage media or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.
[0142] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0143] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0144] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0145] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this manual are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0146] It should be understood that although the terms first, second, third, etc. may be used to describe various information in one or more embodiments of this specification, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".
[0147] The above description is merely a preferred embodiment of one or more embodiments of the present specification and is not intended to limit one or more embodiments of the present specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of one or more embodiments of the present specification shall be included in the scope of protection of one or more embodiments of the present specification.
Claims
1. A data processing system, the system comprising: An interaction unit, configured to receive first data to be processed and a data processing instruction of a first data holder sent by a client; A database unit, used for storing second data to be processed of a second data holder; A processing unit is used to perform fusion processing on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction received by the interaction unit to obtain a processing result.
2. The data processing system according to claim 1, wherein the second data to be processed stored in the database unit is a backup of part or all of the data of the second data holder.
3. The data processing system according to claim 2, further comprising an approval unit; The processing unit is used to send the processing result to the approval unit; The approval unit is used to send the processing result to the client if the processing result passes the approval. 4 . The data processing system according to claim 3 , wherein the interaction unit, the database unit, the processing unit and the approval unit are all arranged on a device in a data center of the second data holder.
5. The data processing system according to claim 1, wherein the interaction unit is used to receive the first data to be processed and the data processing instruction of the first data holder sent by the client through SFTP.
6. According to the data processing system of claim 1, the processing unit is generated based on TEE technology; the processing unit is independent of other units of the system at both software and hardware levels.
7. The data processing system according to claim 1, wherein the processing unit comprises a management and control module and a computing database; in, The management and control module is used to receive the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, and input the received first data to be processed and the data processing instruction into the computing database; The control module is used to receive the second data to be processed input locally, and input the received second data to be processed into the computing database, or the computing database is used to read the second data to be processed in the database unit; The calculation database is used to perform fusion calculation on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction.
8. The data processing system according to claim 7, wherein the control module is used to send the permission verification data input locally to the database unit so that the database unit verifies the permission verification data; The computing database is used to read the second data to be processed in the database unit when the database unit successfully verifies the authority verification data.
9. The data processing system according to claim 1, wherein the first data to be processed includes land remote sensing data and authorized user data, wherein: The land remote sensing data includes land identification, crop type, planting area, land area and land location, and the authorized user data includes the identity information of the authorized user; The second data to be processed includes land remote sensing data and land title confirmation data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land title confirmation data includes land owner, land area and land location; The processing result includes the identity information of the authorized user and the land information, wherein the land information includes the crop type, the planting area, the land area and the land location.
10. The data processing system according to claim 9, wherein the processing unit is configured to: Determining unified remote sensing data according to the land remote sensing data in the first data to be processed and the land remote sensing data in the second data to be processed; A processing result is generated based on the unified remote sensing data and the land title confirmation data.
11. A data processing method, the method comprising: Receiving first data to be processed and a data processing instruction sent by an interaction unit, or first data to be processed and a data processing instruction input locally; Receiving second data to be processed input locally, or reading second data to be processed in a database unit; Based on the data processing instruction, the first data to be processed and the second data to be processed are fused in an encrypted state.
12. The data processing method according to claim 11, wherein the receiving the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, comprises: The management and control module receives the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally, and inputs the received first data to be processed and the data processing instruction into the computing database; The receiving the second data to be processed that is locally input includes: receiving the second data to be processed input locally, and inputting the received second data to be processed into a computing database; The step of reading the second data to be processed in the database unit includes: The control module sends the authority verification data input locally to the database unit so that the database unit verifies the authority verification data; The computing database reads the second data to be processed in the database unit when the database unit successfully verifies the authority verification data.
13. The data processing method according to claim 11, wherein the first data to be processed includes land remote sensing data and authorized user data, wherein: The land remote sensing data includes land identification, crop type, planting area, land area and land location, and the authorized user data includes the identity information and authorization status of the authorized user; The second data to be processed includes land remote sensing data and land title confirmation data, wherein the land remote sensing data includes land identification, crop type, planting area, land area and land location, and the land title confirmation data includes land owner, land area and land location; The processing result includes the identity information and land information of the authorized user, wherein the land information includes the crop type, planting area, land area and land location; The step of performing fusion calculation on the first to-be-processed data and the second to-be-processed data in an encrypted state based on the data processing instruction includes: Determining unified remote sensing data according to the land remote sensing data in the first data to be processed and the land remote sensing data in the second data to be processed; A processing result is generated based on the unified remote sensing data and the land title confirmation data.
14. A data processing device, comprising: A first data import module, used for receiving the first data to be processed and the data processing instruction sent by the interaction unit, or the first data to be processed and the data processing instruction input locally; A second data import module, used for receiving the second data to be processed input locally, or reading the second data to be processed in a database unit; A fusion processing module is used to perform fusion processing on the first data to be processed and the second data to be processed in an encrypted state based on the data processing instruction.
15. A computer program product comprising a computer program / instructions, which, when executed by a processor, implement the steps of the method according to any one of claims 11 to 13.
16. An electronic device, comprising: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 11 to 13 by running the executable instructions.
17. A computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the method according to any one of claims 11 to 13.