Data processing method, device and system

Abstract

Embodiments of the present application provide a data processing method, device and system. In the embodiments, collaborative data provided by a plurality of data parties is determined; the collaborative data is transformed to obtain virtual data; the virtual data is submitted to a development component, so that the plurality of data parties perform data processing based on the virtual data in the development component; processing logic of a first data party is determined, and the collaborative data is processed according to the processing logic to obtain result data. The technical solution provided by the embodiments of the present application is safe and reliable for data collaborative development.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, server, client, device and system. Background Technology

[0002] Currently, considering privacy and security issues, data providers typically implement strict isolation measures for their data, with different data providers developing data independently. However, this is not conducive to realizing the value of the data, hence the growing demand for cross-data provider collaborative data development. Summary of the Invention

[0003] This application provides a data processing method, apparatus, device, and system that enables secure and reliable collaborative data development.

[0004] In a first aspect, embodiments of this application provide a data processing method, including:

[0005] Identify collaborative data provided by multiple data providers;

[0006] The collaborative data is transformed to obtain virtual data;

[0007] The virtual data is submitted to the development component so that the multiple data parties can perform data processing based on the virtual data in the development component.

[0008] Determine the processing logic of the first data party, and process the collaborative data according to the processing logic to obtain the result data.

[0009] Secondly, this application provides a data processing method, including:

[0010] Provide a registration interface;

[0011] In response to the collaboration trigger operation in the registration interface, a collaboration request is sent to the server. The server determines the collaboration data based on the collaboration requests sent by multiple data parties, transforms the collaboration data to obtain virtual data, and submits the virtual data to the development component.

[0012] Provide the development interface corresponding to the aforementioned development components;

[0013] In response to the processing operation in the development interface, the corresponding processing logic is sent to the server so that the server can process the collaborative data according to the processing logic.

[0014] Thirdly, this application provides a data processing system, including a server and a user terminal;

[0015] The user terminal is used to provide a registration interface and send a collaboration request to the server based on the collaboration trigger operation of the data party on the registration interface; it also provides a development interface corresponding to the development component and sends the corresponding processing logic to the server in response to the processing operation on the development interface.

[0016] The server is configured to determine collaboration data based on collaboration requests sent by multiple user terminals; transform the collaboration data to obtain virtual data; submit the virtual data to the development component; and process the collaboration data to obtain result data according to the processing logic sent by the first user terminal.

[0017] Fourthly, this application provides a server in its embodiments, including:

[0018] The control component is used to determine the collaborative data provided by multiple data parties, transform the collaborative data to obtain virtual data, and submit the virtual data to the development component;

[0019] A development component is provided for multiple data parties to perform data processing based on the virtual data; the processing logic of the first data party is determined.

[0020] A production component is used to process the collaborative data to obtain result data based on the processing logic.

[0021] Fifthly, this application provides a user terminal, including:

[0022] The display component is used to provide the registration interface and the development interface corresponding to the development component;

[0023] The processing component is used to send a collaboration request to the server in response to the collaboration trigger operation in the registration interface. The server determines the collaboration data based on the collaboration requests sent by multiple data parties, transforms the collaboration data to obtain virtual data, and submits the virtual data to the development component. In response to the processing operation in the development interface, the processing component sends the corresponding processing logic to the server so that the server can process the collaboration data according to the processing logic.

[0024] Sixthly, this application provides a computing device, including a processor and a memory;

[0025] The memory stores one or more computer instructions; the one or more computer instructions are invoked and executed by the processor to implement the data processing method as described in the first aspect above.

[0026] In a seventh aspect, embodiments of this application provide an electronic device, including a display, a processor, and a memory;

[0027] The memory stores one or more computer instructions; the one or more computer instructions are invoked and executed by the processor to implement the data processing method as described in the second aspect above.

[0028] In this application embodiment, a data processing platform is provided. For collaborative data from multiple data parties, virtual data is obtained through transformation processing and submitted to a development component. Multiple data parties perform data processing based on the virtual data in the development component. For any data party, the collaborative data is processed according to its data processing logic to obtain the result data. Data parties develop data based on virtual data and do not see the real collaborative data. Then, they actually process the real collaborative data according to the processing logic. This realizes collaborative data development and effectively ensures data security.

[0029] These or other aspects of this application will become more apparent in the following description of the embodiments. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0031] Figure 1 A flowchart of one embodiment of the data processing system provided in this application is shown;

[0032] Figure 2 A flowchart of one embodiment of a data processing method provided in this application is shown;

[0033] Figure 3 A flowchart of one embodiment of a data processing method provided in this application is shown;

[0034] Figure 4 This application provides a schematic diagram illustrating the structure of one embodiment of a server.

[0035] Figure 5 This application provides a schematic diagram illustrating the structure of one embodiment of a user terminal.

[0036] Figure 6 This illustration shows an interactive scenario of an embodiment of this application in a practical application;

[0037] Figure 7 This application provides a schematic diagram illustrating the structure of one embodiment of a computing device.

[0038] Figure 8 A schematic diagram of the structure of an embodiment of an electronic device provided in this application is shown. Detailed Implementation

[0039] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0040] In some of the processes described in the specification, claims, and accompanying drawings of this application, multiple operations appearing in a specific order are included. However, it should be clearly understood that these operations may not be executed in the order they appear herein, or may be executed in parallel. The operation numbers, such as 101, 102, etc., are merely used to distinguish different operations and do not themselves represent any execution order. Furthermore, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should be noted that the descriptions such as "first," "second," etc., in this document are used to distinguish different messages, devices, modules, etc., and do not represent a chronological order, nor do they limit "first" and "second" to different types.

[0041] The technical solution of this application is applicable to any scenario where multiple data parties have data collaboration development needs. In the embodiments of this application, the data parties can refer to enterprises or other organizations, or project parties within enterprises or other organizations. Multiple data parties can belong to the same industry or the same field, and the interaction and use of their data can have greater value.

[0042] Due to concerns about data privacy and security, data providers often implement strict isolation measures to prevent data leaks, creating data silos that hinder data exchange and value extraction. The inventors' research revealed that the conventional data collaboration development method involves risk approval, where partners review and approve data before providing the full dataset. This method carries the risk of secondary leaks and still cannot guarantee data security.

[0043] To achieve collaborative data development and ensure data security, the inventors, after a series of studies, proposed the technical solution of this application. In the embodiments of this application, collaborative data provided by multiple data parties is transformed to obtain virtual data. This virtual data is then submitted to a development component, allowing multiple data parties to process the data based on the virtual data within the development component. The resulting data is then obtained by processing the collaborative data according to the processing logic of each data party. Since the data parties develop data based on the virtual data and do not see the actual collaborative data, they then process the actual collaborative data according to the processing logic. This approach achieves collaborative data development while effectively ensuring data security.

[0044] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0045] First, a brief introduction to the system architecture to which the technical solution of this application applies will be given, such as... Figure 1 The diagram shown is a structural schematic of a data processing system provided in this application. The system may include a server 101 and a user terminal 102. The user terminal can be an app or browser for use by the data provider. The server 101 can be deployed in the cloud or configured on one or more physical machines; this application does not impose specific limitations on this.

[0046] Among them, the user terminal 102 can provide a registration interface and send a collaboration request to the server based on the collaboration trigger operation of the data party on the registration interface; it can also provide a development interface corresponding to the development component, and send the corresponding processing logic to the server in response to the processing operation of the data party in the development interface.

[0047] Server 101 can determine collaboration data based on collaboration requests sent by multiple user terminals 102; transform the collaboration data to obtain virtual data; submit the virtual data to the development component; and process the collaboration data to obtain result data according to the processing logic sent by the first user terminal 102.

[0048] The first user terminal can refer to any user terminal; it is simply named the first user terminal for the sake of easy distinction in description.

[0049] The technical solutions of the embodiments of this application are mainly based on Figure 1 The data processing system shown is implemented through... Figure 1 The data processing system shown enables collaborative data development and ensures data security.

[0050] The specific execution operations on the server and user sides will be described in detail in the corresponding method embodiments below.

[0051] Figure 2 This is a flowchart of an embodiment of a data processing method provided in this application. The technical solution of this embodiment can be derived from... Figure 1 The server-side execution in the illustrated embodiment may include the following steps:

[0052] 201: Identify collaborative data provided by multiple data providers.

[0053] Here, "multiple data parties" refers to the data parties participating in collaborative data development. This collaborative data may include target data provided by multiple data parties that can be used for collaborative data development. Different target data can be distinguished by data identifiers. In practical applications, when the target data exists in the form of a data table, the data identifier can specifically refer to the table name.

[0054] Optionally, collaborative data can be determined based on collaboration requests sent separately by multiple data parties. Collaboration requests can be sent by the user terminal in response to a corresponding collaboration triggering operation by the data party. Therefore, registration interfaces can be provided on the user terminals corresponding to each of the multiple data parties; thus, collaboration requests can be received from multiple user terminals in response to collaboration triggering operations within the registration interface.

[0055] In practical applications, the server can store data from different data providers, and this data is isolated from each other to ensure data security. Data from different data providers can be synchronized to the server from their respective data systems. Alternatively, the server can directly function as a data system for different data providers, storing data generated from any data processing procedure. Therefore, the collaboration request can include data location information, such as storage path information. Thus, the target data indexed by the data location information provided by multiple data providers can be used as the collaboration data.

[0056] In addition, as another option, the collaboration request can also include target data provided by the data provider for participating in data collaboration development. The target data can come from the user's local device, etc.

[0057] In this system, registration interfaces can be provided on the user terminals corresponding to multiple data providers; thus, it can receive collaboration requests sent by multiple user terminals in response to collaboration trigger operations in the registration interface.

[0058] 202: Transform the collaborative data to obtain virtual data.

[0059] 203: Submit virtual data to the development component so that multiple data parties can process the data based on the virtual data in the development component.

[0060] In this embodiment, the collaborative data is transformed. For ease of description, the result of the transformation is named virtual data. Only the virtual data is submitted to the development component, so that each data party can perform data processing based on the virtual data without seeing the real collaborative data, thus ensuring data security.

[0061] Collaborative data can include data of at least one data category. Each data category consists of a data category and at least one corresponding data value. For example, the data category could be "Name," and data values ​​could include "Zhang San," "Li Si," etc. The data category identifies the data values. Alternatively, the collaborative data can be transformed by changing the data values ​​while keeping the data category unchanged. For instance, "Zhang San" under the data category "Name" might be transformed into "AA," and "Li Si" might be transformed into "BB." When the data provider develops data based on virtual data, they only cannot see the actual data values; they can still process the transformed data values ​​based on the data category without affecting the processing logic.

[0062] In practical applications, collaborative data exists in the form of data tables, and data categories can specifically refer to the fields in the data tables.

[0063] Optionally, transforming the data values ​​of collaborative data can be done by obfuscating the data values. For example, this can be achieved by changing the data length, adding redundant information, replacing data values, or by using modulo, remainder, or hash operations.

[0064] As another alternative, transforming collaborative data can also involve transforming the data structure of the collaborative data. For example, if the collaborative data exists in the form of a data table, the transformation of the data structure can be to adjust the row / column positions of the data values ​​in the data table, such as swapping the data values ​​in the first column with the data values ​​in the second column.

[0065] Specifically, the user side can provide a development interface corresponding to the development component, allowing data providers to perform processing operations on the virtual data within the interface. Therefore, submitting virtual data to the development component can be achieved by: submitting the virtual data directly to the development component; or by providing corresponding development interfaces on the user sides of multiple data providers.

[0066] 204: Determine the processing logic of the first data party, and process the collaborative data according to the processing logic to obtain the result data.

[0067] The processing logic can include data processing methods, such as data fusion, data addition / subtraction, or data statistics. The processing logic of the first data party can be determined by the first user client based on the processing operations performed by the first data party on the virtual data and sent to the server. Therefore, determining the processing logic of the first data party can be done by obtaining the processing logic sent by the first user client in response to the processing operations in the development interface. The server then processes the collaborative data based on the processing logic to ensure that the actual result data can be obtained.

[0068] In this case, the data development by the first data provider may only involve virtual data corresponding to at least a portion of the target data provided by some data providers. Therefore, the processing logic may also include the data identifier of the target data used, as well as data names, etc. Based on the processing logic, at least a portion of the collaborative data involved in the data development by the first data provider can be determined, and the processing logic is specifically used to process this at least portion of the collaborative data to obtain the result data. For example, when the collaborative data includes multiple data tables, the processing logic may include table names, etc.

[0069] In this embodiment, the data provider develops data based on virtual data and does not see the real collaborative data. Then, the real collaborative data is actually processed according to the processing logic, which realizes data collaborative development and effectively ensures data security.

[0070] In some embodiments, after obtaining the result data, the method may further include:

[0071] The results are provided to the first data provider, allowing them to easily view the outcomes of the data development.

[0072] Since the resulting data is obtained based on collaborative data processing, and this collaborative data may involve multiple data parties, in order to further improve data security, in some embodiments, providing the resulting data to the first data party includes:

[0073] Receive the first data provider's request for obtaining the result data;

[0074] Send an audit notification for the retrieval request to at least one second data party involved in the result data;

[0075] Upon receiving an acknowledgment request from at least one second data party, the result data is provided to the first data party.

[0076] The result data is provided as a data service. The result data is provided to the first data party only after it has been reviewed and approved by at least one second data party to ensure data security.

[0077] The second data party refers to the data party involved in the result data. For ease of description, it is named the second data party.

[0078] To further ensure data security, in some embodiments, the method may further include:

[0079] Based on the data requirements of the primary data provider, the resulting data was processed to obtain anonymized data;

[0080] Provide the anonymized data to the first data provider.

[0081] The data request of the first data party can be confirmed and obtained by other data parties with which it collaborates. The data request may include, for example, the data name of the requested data to specify the data value corresponding to a certain data name, or a pre-defined processing method for the result data, so that the user can obtain the data after the result data has been pre-processed.

[0082] For example, when the collaborative data is table data, the data request can specifically include field names, or specify the statistical processing method for a certain column of data corresponding to a certain field, such as summation, or specify the aggregation processing method for data of several fields, such as calculating the ratio of data of field 1 and field 2. For example, if field 1 is the resource consumption and field 2 is the total resource, the resource consumption ratio can be calculated based on field 1 and field 2.

[0083] According to the data requirements of the first data party, the result data can be processed to obtain de-identified data, and only the de-identified data can be provided to the first data party. Specifically, the de-identified data can be sent to the first user terminal corresponding to the first data party.

[0084] The collaboration request sent by the first data party can include the data requirements of the first data party, so that after obtaining the result data, the result data can be processed according to the data requirements.

[0085] Alternatively, one could process the resulting data based on the data requirements in the data anonymization request after receiving the anonymization request from the first data provider.

[0086] Furthermore, to further ensure data security, in some embodiments, providing de-identified data to the first data provider may include:

[0087] Receive the first data provider's request to obtain de-identified data;

[0088] Send an audit notification for the retrieval request to at least one second data party involved in the result data;

[0089] Upon receiving a confirmation request from at least one second data party, the de-identified data is provided to the first data party.

[0090] Similarly, data anonymization is used, and the anonymized data is provided to the primary data provider only after being reviewed and approved by the collaborating data provider.

[0091] To further ensure data security, in some embodiments, providing de-identified data to the first data provider includes:

[0092] Perform security verification on the anonymized data;

[0093] If the verification passes, the anonymized data will be provided to the first data provider.

[0094] Optionally, security verification of anonymized data may include:

[0095] Identify at least one second data party involved in the resulting data;

[0096] Security verification is performed on the anonymized data in accordance with the collaboration requirements provided by at least one second data party.

[0097] The collaboration request may include collaboration requirements, which may include de-identification requirements for the first data party. Specifically, the de-identified data may be subjected to security verification in accordance with the de-identification requirements provided by at least one second data party.

[0098] For example, data anonymization may include at least one first data identifier and / or at least one data category set by the second data party. Based on the collaboration requirements, it can be verified whether the first data category set by at least one second data party includes the data category corresponding to the anonymized data, or whether the anonymized data is obtained by processing the target data corresponding to the first data identifier set by at least one second data party.

[0099] In some embodiments, after obtaining the processing logic of the first data party, the method may further include:

[0100] Determine the descriptive information of the data processed by the first data provider;

[0101] Based on the description information, perform permission verification on the first data party;

[0102] The result data obtained by processing collaborative data according to the processing logic may include:

[0103] The processing logic for obtaining the first data source;

[0104] Once the first data source passes verification, the collaborative data is processed according to the processing logic to obtain the result data.

[0105] The description information of the processed data may include data identifiers. When the target data provided by each data party is a data table, the description information refers to the table name.

[0106] The first data party is subject to permission verification to check whether it has development permissions for the data corresponding to the description information. If the verification passes, it indicates that the first data party has development permissions. Then, the collaborative data is processed according to the processing logic to obtain the result data.

[0107] Optionally, based on the first description information, the permission verification for the first data party includes:

[0108] Identify at least one third data party involved in the data processed by the first data party;

[0109] Based on the collaboration requirements provided by at least one third data party, the first data party's permissions are verified according to the description information.

[0110] The collaboration request may include collaboration requirements, which may include permission requirements for the first data party. Specifically, the permission requirements may be provided by at least one third data party, and the permission of the first data party may be verified based on the description information.

[0111] The permission requirements may include, for example, at least one second data identifier set by a third data party. The permission verification of the first data party based on the description information may be to verify whether the target data corresponding to at least one second data identifier set by a third data party includes the data processed by the first data party.

[0112] In some embodiments, after obtaining the result data, the method may further include: transforming the result data; and submitting the transformed result data as virtual data to the development component.

[0113] After the result data is transformed and processed, it is also submitted as virtual data to the development component so that it can continue to participate in downstream data development, etc.

[0114] In some embodiments, after obtaining the result data, the method may further include:

[0115] Receive the processing request sent by the first data provider;

[0116] Based on the processing request, the processing result data.

[0117] This allows for further application of the resulting data without requiring a primary data provider, ensuring data security. The processing request can include specific processing methods to handle the resulting data accordingly. For example, the resulting data can be deployed online or further processed based on it.

[0118] Figure 3 This is a flowchart illustrating another embodiment of a data processing method provided in this application. This embodiment describes the technical solution of this application from the user's perspective. The method may include the following steps:

[0119] 301: Provides a registration interface.

[0120] 302: In response to the collaboration trigger action on the registration page, a collaboration request is sent to the server.

[0121] The server can determine the collaboration data based on collaboration requests sent by multiple data parties, transform the collaboration data to obtain virtual data, and submit the virtual data to the development component. For specific implementation details, please refer to [link / reference needed]. Figure 2 The embodiments shown are described herein and will not be repeated here.

[0122] The collaboration request may include collaboration requirements, as well as data party identifiers for collaborative development. The collaboration requirements may include specific permission requirements and anonymization requirements for a particular data party. For details on the implementation, please refer to the previous text, which will not be repeated here.

[0123] 303: Provides the development interface corresponding to the development component.

[0124] 304: In response to the processing operation in the development interface, the corresponding processing logic is sent to the server.

[0125] The server can process the collaborative data according to the processing logic. For details on the implementation, please refer to [link / reference]. Figure 2 The embodiments shown are described herein and will not be repeated here.

[0126] In some embodiments, the method may further include:

[0127] Provide a request interface;

[0128] In response to the request trigger operation in the request interface, a retrieval request is sent to the server, so that the server can send an audit notification for the retrieval request to at least one second data party involved in the result data, and receive a confirmation request from at least one second data party, and provide the result data to the first data party.

[0129] Retrieve the result data provided by the server and display the result data on the request interface.

[0130] Since the server can process the result data based on collaboration requirements to obtain de-identified data, specifically by providing the de-identified data to the data provider, in some embodiments, the method may further include:

[0131] Provide a request interface;

[0132] In response to a request-triggered operation in the request interface, a retrieval request is sent to the server so that the server can send an audit notification for the retrieval request to at least one second data party involved in the result data; and upon receiving a confirmation request from at least one second data party, the de-identified data is provided to the first data party.

[0133] Obtain the anonymized data provided by the server and display the anonymized data on the request interface.

[0134] like Figure 4As shown in the embodiments of this application, a server is also provided. This server can be a computing platform provided by the backend, and may include:

[0135] The control component 401 is used to identify collaborative data provided by multiple data parties, transform the collaborative data to obtain virtual data, and submit the virtual data to the development component.

[0136] Development component 402 is used to enable multiple data parties to perform data processing based on virtual data; determine the processing logic of the first data party; the development component may provide a development interface to the user end, and perform corresponding data processing based on the data development requests triggered by the data party's data development operations in the development interface.

[0137] Production component 403 is used to process collaborative data to obtain result data based on processing logic.

[0138] The server-side component can also include a storage component to isolate and store the data from multiple data providers.

[0139] The processing logic can be provided to the generating component by the development component.

[0140] In addition, in some embodiments, the server may further include:

[0141] Service components are used to provide the resulting data to the first data provider.

[0142] Optionally, the service component may specifically receive the first data party's request for obtaining the result data and forward the request to the management component;

[0143] The control component is also used to send an audit notification for the acquisition request to at least one second data party involved in the result data; upon receiving a confirmation request from at least one second data party, the service component provides the result data to the first data party.

[0144] In some embodiments, the server may further include:

[0145] The data anonymization component is used to process the result data according to the data requirements of the first data provider to obtain anonymized data;

[0146] The service component is specifically used to provide anonymized data to the first data provider.

[0147] In some embodiments, the de-identification component is also used to submit the de-identified data to the control component;

[0148] The control component is also used to perform security verification on the de-identified data; if the verification is successful, the de-identified data is then provided to the first data provider through the service component.

[0149] In some embodiments, the development component is also used to send an access control request to the management component, which determines the description information of the data processed by the first data party; performs access control verification on the first data party based on the description information; after the verification is successful, sends a verification success notification to the development component; and after receiving the verification success notification, the development component provides the processing logic to the production component.

[0150] In some embodiments, the control component performs permission verification on the first data party based on the first description information, including: determining at least one third data party involved in the data processed by the first data party; and performing permission verification on the first data party based on the description information according to the collaboration requirements provided by the at least one third data party.

[0151] In some embodiments, the control component transforms the collaborative data to obtain virtual data by transforming at least one of the data values ​​and data structures of the collaborative data.

[0152] In some embodiments, the collaborative data includes a data table. The control component performs transformation processing on at least one of the data values ​​and data structures of the collaborative data to obtain virtual data. This may include: obfuscating the data values ​​in the data table and / or adjusting the row / column positions of the data values ​​in the data table to obtain virtual data.

[0153] In some embodiments, the control component determines the collaborative data provided by multiple data parties by: receiving collaborative requests sent by the multiple data parties respectively; the collaborative requests include data location information; and using the target data indexed by the data location information provided by the multiple data parties as the collaborative data.

[0154] In some embodiments, the control component is also used to transform the result data; and submit the transformed result data as virtual data to the development component.

[0155] Figure 4 The server can specifically execute... Figure 2 The implementation principle and technical effects of the data processing method described in the illustrated embodiments will not be repeated here. The specific methods of the various components involved in the server side in the above embodiments have been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0156] In addition, embodiments of this application also provide a user terminal, such as... Figure 5 The above may include:

[0157] The display component is used to provide the registration interface and the development interface corresponding to the development component;

[0158] The processing component is used to respond to the collaboration trigger operation in the registration interface, send a collaboration request to the server, and the server determines the collaboration data based on the collaboration requests sent by multiple data parties, transforms the collaboration data to obtain virtual data, and submits the virtual data to the development component; in response to the processing operation in the development interface, it sends the corresponding processing logic to the server so that the server can process the collaboration data according to the processing logic.

[0159] In some embodiments, the display component is also used to provide a request interface;

[0160] The processing component is also used to respond to the request-triggered operation in the request interface, send a retrieval request to the server, and retrieve the result data provided by the server.

[0161] The display component is also used to display the resulting data.

[0162] Figure 4 The user terminal can specifically execute Figure 3 The implementation principle and technical effects of the data processing method described in the illustrated embodiments will not be repeated here. The specific methods of the various components involved in the user terminal in the above embodiments have been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0163] The components mentioned above can be software modules. The various components included in the server can be configured on one or more physical machines; this application does not specifically limit this.

[0164] To further facilitate understanding of the technical solution of this application, such as Figure 6 In the interactive scenario diagram shown, taking the collaborative development of data by two data parties as an example, the management component 61 in the server receives the collaboration request submitted by data party 1 through user terminal 601 and the collaboration request submitted by data party 2 through user terminal 602.

[0165] The control component 61 can determine the target data 1 requested by data party 1 for collaborative development, and the target data 2 requested by data party 2 for collaborative development. Target data 1 and target data 2 are used as collaborative data. The control component 61 transforms target data 1 and target data 2 respectively to obtain virtual data 1 and virtual data 2, and submits virtual data 1 and virtual data 2 to the development component 62.

[0166] The development component 62 can determine the processing logic for each data party based on the processing operations of data party 1 and data party 2 respectively. The development component 62 can request the management component 61 to perform permission verification on data party 1 and data party 2. If the verification is successful, it can provide the processing logic of each data party to the production component 63. The production component 63 then processes target data 1 and target data 2 based on their respective processing logic. Let's assume that it processes target data 1 to obtain result data 3.

[0167] The desensitization component 64 can process the result data 3 to obtain desensitized data, and can submit the desensitized data to the control component 61, which will then perform security verification on the desensitized data.

[0168] Assuming that service component 65 receives a request from data party 1 submitted through user terminal 601, service component 65 will notify the management component to perform authentication. That is, management component 61 will send an audit notification to user terminal 602, so that data party 2 can audit data party 1's request. Data party 2 can send a confirmation request through user terminal 602. After management component 61 receives the confirmation request and the de-identified data is verified, service component 65 will then provide the de-identified data to user terminal 601.

[0169] The resulting data can also be transformed to obtain virtual data 3 and submitted to the development component for subsequent data development.

[0170] The data processing system provided in this application enables collaborative data development. By isolating data development and data production, the security of collaborative data development is ensured. Furthermore, the system uses management components to perform permission and security checks and provides authentication services. The system provides result data in the form of data services, further ensuring data security and making the data visible but not removable, usable but not visible.

[0171] In a practical application, the technical solution of this application can be applied to scenarios where content is recommended to a specific audience. The data provider is the recommender, and the target data it provides can be audience data. In a scenario where multiple recommenders collaborate on development, assuming recommender 1 and recommender 2 need to collaborate on data development, recommender 1's data development can involve merging and filtering the audience data provided by recommender 1 and recommender 2 to obtain target audience data. Thus, the first data provider can provide recommended content, i.e., it can send recommended content based on the target audience for content recommendation. Since audience data often involves user privacy, the technical solution of this application can effectively ensure security.

[0172] Of course, the technical solution of this application can also be applied to any scenario of data collaborative development. The target data provided by the data provider can be in the form of a data table, and data development can involve merging, adding, subtracting, statistically processing, etc., data from multiple data tables. This application does not impose specific limitations in this regard.

[0173] In addition, this application also provides a computing device, such as Figure 7 As shown, it may include a processor 701 and a memory 702. The memory stores one or more computer instructions, which are to be adjusted and executed by the processor to implement the above. Figure 2 The data processing method shown.

[0174] Of course, computing devices may also include other components, such as input / output interfaces and communication components.

[0175] Input / output interfaces provide interfaces between processing components and peripheral interface modules, which can be output devices, input devices, etc.

[0176] The communication components are configured to facilitate wired or wireless communication between computing devices and other devices.

[0177] In practical applications, the computing device can be an elastic computing host provided by a cloud computing platform, which is a cloud server. The processor, memory, etc. mentioned above can be basic server resources rented or purchased from the cloud computing platform.

[0178] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, can perform the above-described functions. Figure 2 The data processing method of the embodiment shown.

[0179] In addition, this application also provides an electronic device, such as Figure 8 As shown, the system may include a processor 701, a memory 702, and a display 703. The memory stores one or more computer instructions, which are executed by the processor to implement the data processing method described in section 3 above. The display specifically provides a corresponding interface to sense corresponding operations or display corresponding content, etc.

[0180] Of course, electronic devices may also include other components, such as input / output interfaces and communication components.

[0181] Input / output interfaces provide interfaces between processing components and peripheral interface modules, which can be output devices, input devices, etc.

[0182] The communication component is configured to facilitate wired or wireless communication between electronic devices and other devices.

[0183] In practical applications, electronic devices can be mobile phones, tablets, personal computers, or other portable mobile terminals.

[0184] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, can perform the above-described functions. Figure 3 The data processing method of the embodiment shown.

[0185] In the corresponding embodiments described above, the processor can be a central processing unit (CPU). Alternatively, it can be implemented using one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to execute the above methods.

[0186] The memory is configured to store various types of data to support operations on the terminal. The memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0187] The display can be an electroluminescent (EL) element, a liquid crystal display or a microdisplay with a similar structure, or a retina-direct display or a similar laser scanning display, etc.

[0188] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0189] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0190] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0191] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A data processing method, characterized in that, include: Identify collaborative data provided by multiple data providers; The collaborative data is transformed to obtain virtual data; The virtual data is submitted to the development component so that the multiple data parties can perform data processing based on the virtual data in the development component. Determine the processing logic of the first data party, and process the collaborative data according to the processing logic to obtain the result data; The process of transforming the collaborative data to obtain virtual data includes: At least one of the data values ​​and data structures of the collaborative data is transformed to obtain virtual data. The data value transformation processing of the collaborative data includes obfuscation processing.

2. The method according to claim 1, characterized in that, Also includes: The resulting data is provided to the first data provider.

3. The method according to claim 2, characterized in that, The step of providing the result data to the first data provider includes: Receive the first data provider's request to obtain the result data; Send an audit notification for the acquisition request to at least one second data party involved in the result data; Upon receiving the confirmation request from the at least one second data party, the result data is provided to the first data party.

4. The method according to claim 1, characterized in that, Also includes: According to the data requirements of the first data provider, the result data is processed to obtain de-identified data; The de-identified data is provided to the first data provider.

5. The method according to claim 4, characterized in that, The step of providing the de-identified data to the first data provider includes: The de-identified data is subjected to security verification; If the verification passes, the de-identified data will be provided to the first data provider.

6. The method according to claim 5, characterized in that, The security verification of the de-identified data includes: Identify at least one second data party involved in the resulting data; The de-identified data is subjected to security verification according to the collaboration requirements provided by at least one second data party.

7. The method according to claim 1, characterized in that, After determining the processing logic for the first data party, the method further includes: Determine the descriptive information of the data processed by the first data provider; Based on the description information, the first data party is subject to permission verification; The process of processing the collaborative data according to the processing logic to obtain the result data includes: Once the first data party passes the verification, the collaborative data is processed according to the processing logic to obtain the result data.

8. The method according to claim 7, characterized in that, The permission verification of the first data party based on the description information includes: Identify at least one third data party involved in the data processed by the first data party; Based on the description information, the first data party is subject to permission verification according to the collaboration requirements provided by at least one third data party.

9. The method according to claim 1, characterized in that, The collaborative data includes data tables; The process of transforming at least one of the data values ​​and data structures of the collaborative data to obtain virtual data includes: Obfuscate the data values ​​in the data table and / or adjust the row / column positions of the data values ​​in the data table to obtain virtual data.

10. The method according to claim 1, characterized in that, The determination of collaborative data provided by multiple data providers includes: Receive collaboration requests sent by multiple data parties; the collaboration requests include data location information; The target data indexed by the data location information provided by the multiple data providers is used as collaborative data.

11. The method according to claim 10, characterized in that, The receiving of collaboration requests sent by multiple data parties; A registration interface is provided on the user terminal corresponding to each of the multiple data providers; Receive collaboration requests from multiple users in response to collaboration triggering actions on the registration interface.

12. The method according to claim 11, characterized in that, Submitting the virtual data to the development component includes: Submit the virtual data to the development component; Each of the multiple data providers provides a corresponding development interface on its user terminal. The processing logic for determining the first data party includes: The processing logic sent by the first user terminal corresponding to the first data party in response to the processing operation in the development interface.

13. The method according to claim 1, characterized in that, Also includes: The resulting data is then transformed. The transformation results of the stated data are submitted as virtual data to the development component.

14. The method according to claim 1, characterized in that, Also includes: Receive the processing request sent by the first data provider; The result data is processed based on the processing request.

15. A data processing system, characterized in that, Including both server-side and user-side components; The user terminal is used to provide a registration interface and send a collaboration request to the server based on the collaboration trigger operation of the data party on the registration interface; it also provides a development interface corresponding to the development component and sends the corresponding processing logic to the server in response to the processing operation on the development interface. The server is used to determine collaboration data based on collaboration requests sent by multiple user terminals. At least one of the data values ​​and data structures of the collaborative data is transformed to obtain virtual data. The data value change processing of the collaborative data includes obfuscation processing; submitting the virtual data to the development component; and processing the collaborative data to obtain result data according to the processing logic sent by the first user terminal.

16. A computing device, characterized in that, Including the processor and memory; The memory stores one or more computer instructions; the one or more computer instructions are to be invoked and executed by the processor to implement the data processing method as described in any one of claims 1 to 14.

Images