Data processing method, data transmission method, device, medium, product and equipment

Abstract

This application discloses a data processing method, data transmission method, apparatus, medium, product, and equipment. The data processing method includes: generating summary information based on first data product information from a data provider, wherein the summary information includes at least one of a file identifier, a content summary, and a content supplementary summary; adding the summary information to the first data product information to form second data product information, thereby enabling the identification of whether the data product information has been sold repeatedly through the summary information added to the data product information, thus protecting the legitimate rights and interests of the original data provider.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a data processing method, data transmission method, apparatus, medium, product and equipment. Background Technology

[0002] In existing technologies, data transactions are primarily conducted through data exchanges, which mainly provide data files or data interface APIs (Application Programming Interfaces) to the data purchasers, thereby facilitating the data transaction. However, in this method of data transaction, the data purchaser can resell the purchased data, making it difficult to effectively protect the rights and interests of the data provider. Summary of the Invention

[0003] To address the aforementioned technical problems, embodiments of this application propose a data processing method, data transmission method, apparatus, medium, product, and equipment that can identify whether data product information has been sold repeatedly by using summary information added to the data product information, thereby protecting the legitimate rights and interests of the original data provider.

[0004] To achieve the above objectives, embodiments of this application provide a data processing method, including:

[0005] Based on the first data product information from the data provider, summary information is generated, wherein the summary information includes at least one of the following: file identifier, content summary, and content supplementary summary;

[0006] The summary information is added to the first data product information to form the second data product information.

[0007] Furthermore, the summary information includes the file identifier, and the generation of summary information based on the first data product information from the data provider includes:

[0008] An irreversible encryption algorithm is used to encrypt the content of the data file carried by the first data product information to obtain a file content digest;

[0009] By combining the identity information of the data provider, the submission time of the first data product information, and the document content summary, a first splicing result is obtained;

[0010] An irreversible encryption algorithm is used to encrypt the first concatenation result to generate the file identifier.

[0011] Furthermore, the summary information includes the content summary and / or the content supplementary summary, and the generation of summary information based on the first data product information from the data provider includes:

[0012] Read at least one string of data from the first data product information according to the preset reading rules, and split each string of data into several data elements according to the delimiter corresponding to each string of data.

[0013] Based on all the data elements extracted from each data string, generate a content summary and / or additional content summary corresponding to each data string.

[0014] Furthermore, the content summary corresponding to each data string is generated through the following steps for that data string:

[0015] The length of each data element extracted from the string of data is compared with the preset content length, and the data value corresponding to each data element is extracted from each data element according to the comparison result;

[0016] The identity information of the data provider and the data values ​​corresponding to each of the data elements extracted from the string of data are concatenated to obtain a second concatenation result;

[0017] An irreversible encryption algorithm is used to encrypt the second concatenation result, generating a content digest corresponding to the string of data.

[0018] Furthermore, the content summary corresponding to each data string includes a content header summary and / or a content footer summary; wherein,

[0019] When the content length is the content header length, and the data values ​​corresponding to each data element split from the string of data are all extracted from the data elements according to the content header truncation direction, the generated content digest is the content header digest.

[0020] When the content length is the content tail length, and the data values ​​corresponding to each data element split from the string are all extracted from the data elements according to the content tail truncation direction, the generated content summary is the content tail summary.

[0021] Furthermore, all data elements extracted from each data string have a sequential order;

[0022] The content summary corresponding to each data string is generated through the following steps for that data string:

[0023] Based on the data elements extracted from the string of data, T content append summaries corresponding to the string of data are generated. The t-th content append summary is generated by concatenating and encrypting one or more target data elements. The encryption process is performed using an irreversible encryption algorithm.

[0024] The one or more target data elements are selected from the data elements split from the string of data according to a preset rule. The preset rule is determined by an increasing sequence, an arithmetic sequence, or a geometric sequence. The preset rule takes t as input, where t and T are both positive integers and 1≤t≤T.

[0025] Furthermore, the order is a user-defined order.

[0026] Furthermore, adding the summary information to the first data product information to form the second data product information includes:

[0027] The file identifier is placed into the filename of the first data product information to obtain the third data product information;

[0028] The content summary and / or additional content summary corresponding to each string of data are respectively placed into each string of data to form the fourth data product information;

[0029] The second data product information is determined based on the third data product information and / or the fourth data product information.

[0030] This application embodiment also provides a data transmission method applicable to a secondary node in a data trading system, wherein the data trading system further includes a primary node, and the data transmission method includes:

[0031] Receive the first data product information sent by the data provider;

[0032] The first data product information is processed using any of the data processing methods described above to obtain the second data product information.

[0033] Send an application request carrying the second data product information to the first-level node, wherein the application request is used to apply for a data product certificate;

[0034] In response to receiving the data product certificate sent by the primary node, the data product certificate is sent to the data provider.

[0035] Furthermore, the application request is specifically used to instruct the first-level node, if it confirms based on the inspection results that it has not stored the credential corresponding to the application request, to generate a data product credential corresponding to the application request and send it to the second-level node;

[0036] The inspection result is used to indicate the result of the inspection of the application request by the first-level node.

[0037] Furthermore, the application request also carries information about the data provider, the data product name, and a data product description;

[0038] The data product credential corresponding to the application request is generated based on an internal credential digest. The internal credential digest is obtained by the first-level node by concatenating and encrypting the data product name, the data product description, the digest information, the information of the data provider, and the key corresponding to the information of the data provider. The key is pre-stored in the first-level node.

[0039] Furthermore, in response to receiving the data product certificate sent by the primary node, the data transmission method further includes at least one of the following:

[0040] Store the data product credentials;

[0041] The first data product information is uploaded to the data trading hall of the data trading system.

[0042] This application also provides a data processing apparatus, including:

[0043] The summary information generation module is used to generate summary information based on first data product information from a data provider, wherein the summary information includes at least one of file identifier, content summary, and content supplementary summary;

[0044] An information adding module is used to add the summary information to the first data product information to form the second data product information.

[0045] This application embodiment also provides a data transmission device suitable for a secondary node in a data trading system, wherein the data trading system further includes a primary node, and the data transmission device includes:

[0046] The information receiving module is used to receive the first data product information sent by the data provider;

[0047] The data processing module is used to process the first data product information using any of the data processing methods described above to obtain the second data product information.

[0048] The request module is used to send an application request carrying the second data product information to the first-level node, wherein the application request is used to apply for a data product certificate;

[0049] The distribution module is used to distribute the data product certificate to the data provider in response to receiving the data product certificate sent by the primary node.

[0050] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the data processing method or the steps of the data transmission method described in any of the above claims.

[0051] This application also provides a computer program product, including computer instructions that, when executed by a processor, implement the steps of the data processing method or the data transmission method described in any of the above claims.

[0052] This application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the steps of the data processing method described in any of the above claims, or the steps of the data transmission method described in any of the above claims.

[0053] In summary, the embodiments of this application have at least the following beneficial effects:

[0054] By employing the embodiments of this application, summary information is generated based on first data product information from a data provider. The summary information includes at least one of file identifier, content summary, and content supplementary summary. The summary information is added to the first data product information to form second data product information. This allows for the identification of whether the data product information has been sold repeatedly by using the summary information added to the data product information, thereby protecting the legitimate rights and interests of the original data provider. Attached Figure Description

[0055] Figure 1 This is a flowchart illustrating a data processing method provided in an embodiment of this application;

[0056] Figure 2 This is a flowchart illustrating a data transmission method provided in an embodiment of this application;

[0057] Figure 3 This is a schematic diagram of the structure of a data processing device provided in an embodiment of this application;

[0058] Figure 4 This is a schematic diagram of the structure of a data transmission device provided in an embodiment of this application;

[0059] Figure 5 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application;

[0060] Figure 6 This is a schematic diagram of data transmission provided in an embodiment of this application;

[0061] Figure 7 This is a schematic diagram illustrating the generation of the summary information provided in the embodiments of this application;

[0062] Figure 8 This is a schematic diagram of the second data product information provided in the embodiments of this application;

[0063] Figure 9 This is a schematic diagram of data transmission provided in an embodiment of this application. Detailed Implementation

[0064] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0065] In the description of this application, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more. In the description of this application, the term "comprising" and its variations are open-ended, meaning "including but not limited to." The term "based on" means "at least partially based on." The term "according to" means "at least partially according to." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments."

[0066] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0067] In the description of this application, it should be noted that, unless otherwise defined, all technical and scientific terms used in this application have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this application is for the purpose of describing specific embodiments only and is not intended to limit the application. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0068] See Figure 1 The diagram shows a flowchart of a data processing method provided in an embodiment of this application. The data processing method includes steps S11-S12, as follows:

[0069] S11, Based on the first data product information from the data provider, generate summary information, wherein the summary information includes at least one of the following: file identifier, content summary, and content supplementary summary;

[0070] S12, the summary information is added to the first data product information to form the second data product information.

[0071] It should be noted that the following explanations of some terms and concepts involved in the embodiments of this application are provided by way of example, but it should be understood that the following explanations are only for the purpose of understanding and are not limited thereto:

[0072] A file identifier can be a set of characters or symbols used to uniquely identify and reference a file, typically including the filename and file path, to ensure that each file has a unique identifier in the system. For example, a file identifier can refer to a file fingerprint (FF), which can be a cryptographic hash value used to identify the first data product information. For instance, a file fingerprint can be a string generated by hashing the first data product information. It can be used to ensure the integrity and authenticity of the first data product information, and can also be used for version control, data verification, and preventing data tampering.

[0073] Content summaries can be used to characterize a brief overview of the first data product information. For example, if the first data product information is text information and / or voice information, then methods such as natural language understanding technology can be used to extract the corresponding content summaries from the text information and / or voice information.

[0074] Content Attachment Degist (CAD) can be additional content beyond the main content summary, tailored to different user needs. These user needs can be determined by factors such as the industry of the data provider and / or the intended use of the data products provided.

[0075] In this embodiment, after adding the file identifier, content summary, and / or additional content summary to the first data product information to form the second data product information, users who obtain the second data product information can compare the file identifier, content summary, and / or additional content summary added to the second data product information with the file identifier, content summary, and / or additional content summary corresponding to the data product information that has been put on the market and sold and is pre-stored in the database, or query whether the summary information contains the relevant copyright information of the data provider. This allows users to determine whether the second data product information has been sold repeatedly, and enables the data provider or regulatory agency to collect evidence to protect the legitimate rights and interests of the data provider.

[0076] For example, in step S11, generating summary information based on the first data product information from the data provider may include:

[0077] The first data product information is input into a pre-trained summary generation model to obtain the summary information output by the summary generation model. The summary generation model can be obtained by training a machine learning model based on the collected sample data. The machine learning model can be built based on a deep learning framework (such as TensorFlow, PyTorch, etc.) and use network structures such as RNN, LSTM or Transformer.

[0078] The summary generation model has the ability to extract summary information from input information and output it. For example, the summary generation model can extract keywords from input text information and output summary information based on the keywords. Alternatively, the input information can also be voice information, image information, etc., which are not specifically limited here.

[0079] In one optional implementation, the summary information includes the file identifier, and the generation of summary information based on first data product information from the data provider includes:

[0080] An irreversible encryption algorithm is used to encrypt the content of the data file carried by the first data product information to obtain a file content digest;

[0081] By combining the identity information of the data provider, the submission time of the first data product information, and the document content summary, a first splicing result is obtained;

[0082] An irreversible encryption algorithm is used to encrypt the first concatenation result to generate the file identifier.

[0083] For example, the identity information of the data provider may be the data provider's ID number, or any other information that can indicate the identity of the data provider (such as its IP address).

[0084] Specifically, in this embodiment, an irreversible encryption algorithm (IEA) is first used to encrypt the file content (FC) into a file content digest FC_DEGIST. Then, the data provider (DPR) ID (DPR_ID), the submission time of the first data product information (e.g., submission date, in the format YYYYMMDDHHmmss, where YYYY, MM, DD, HH, mm, and ss are used to indicate year, month, day, hour, minute, and second, respectively), and the file content digest FC_DEGIST are concatenated to obtain a first concatenation result. Finally, the irreversible encryption algorithm (IEA) is used to encrypt the first concatenation result into a file identifier. It should be understood that the order of the multiple objects spliced ​​in the splicing process in this embodiment is not strictly limited, but for ease of understanding, the following formula for generating the file identifier is given as an example: File identifier = IEA(DPR_ID+YYYYMMDDHHmmss+IEA(FC)).

[0085] Optionally, the irreversible encryption algorithm includes MD5 (Message-Digest Algorithm 5), SHA-2 (Secure Hash Algorithm 2), and / or SM3 (a cryptographic hash function standard).

[0086] In this embodiment, the data file content can be irreversibly encrypted first, and then irreversibly encrypted a second time after concatenating the first encryption result with the data provider's identity information and submission time. This can significantly improve the reliability of the generated file identifier and ensure that all kinds of information stored in the file identifier are difficult to modify.

[0087] In one optional implementation, the summary information includes the content summary and / or the content supplementary summary, and the generation of summary information based on the first data product information from the data provider includes:

[0088] Read at least one string of data from the first data product information according to the preset reading rules, and split each string of data into several data elements according to the delimiter corresponding to each string of data.

[0089] Based on all the data elements extracted from each data string, generate a content summary and / or additional content summary corresponding to each data string.

[0090] For example, the preset reading rules may include reading by row or reading by column, and correspondingly, each string of data may be row data or column data.

[0091] In some cases, for ease of understanding, unless otherwise specified, this embodiment and the following content will use text data and line-by-line reading as examples (in which case, string data is line data). However, it should be understood that the implementation process of column-by-column reading or other reading rules is similar and will not be repeated here. In text data, the text data is first read line by line. At this time, each line of data can be stored as a string. Then, in each line of data, the line of data is split into several data elements using the corresponding delimiter. At this time, the same delimiter can be used in each line of data. For example, a specified punctuation mark can be used as the delimiter (comma, period, etc.). Finally, since the split data elements in text data can also indicate text information, methods such as natural language understanding technology can be used to generate a content summary and / or content supplement summary corresponding to each line of data based on all the data elements split from each line of data.

[0092] For example, generating a content summary and / or additional content summary corresponding to each data string based on all data elements split from each data string may include: inputting all data elements split from each data string into a pre-trained summary generation model to obtain the content summary and / or additional content summary output by the summary generation model.

[0093] In this embodiment, since the data in the first data product information is first split into data elements in each string of data, it is equivalent to preprocessing the first data product information to obtain more detailed data elements compared to the first data product information. This enables the generated content summary and / or content supplement summary to more accurately represent the relevant situation of the first data product information.

[0094] In one alternative implementation, a content summary corresponding to each data string is generated through the following steps for that data string:

[0095] The length of each data element extracted from the string of data is compared with the preset content length, and the data value corresponding to each data element is extracted from each data element according to the comparison result;

[0096] The identity information of the data provider and the data values ​​corresponding to each of the data elements extracted from the string of data are concatenated to obtain a second concatenation result;

[0097] An irreversible encryption algorithm is used to encrypt the second concatenation result, generating a content digest corresponding to the string of data.

[0098] Optionally, extracting the data value corresponding to each data element from each data element based on the comparison result includes:

[0099] If the comparison result indicates that the length of each data element is not less than the content length, then a value with a number of bits equal to the content length is extracted from each data element and used as the data value corresponding to each data element.

[0100] If the comparison result indicates that the length of each data element is less than the content length, then a value with a length equal to the length of each data element is extracted from each data element and used as the data value corresponding to each data element.

[0101] It should be noted that the content length in this embodiment can be set by the user, for example, it can be any number from 1 to 10. Since the larger the content length value, the more content will be extracted from each data element (or when the content length is greater than the length of the data element, it will include all the content of the data element itself), the higher the accuracy of the final generated content summary will be.

[0102] In this embodiment, for each string of data, a truncation operation is performed on the data elements extracted from the string to obtain the corresponding data values. These values ​​are then concatenated and encrypted with the identity information of the data provider to obtain a content summary that accurately records the main content information of the string of data.

[0103] In one optional implementation, the content digest corresponding to each string of data includes a content header digest and / or a content tail digest; wherein,

[0104] When the content length is the content header length, and the data values ​​corresponding to each data element split from the string of data are all extracted from the data elements according to the content header truncation direction, the generated content digest is the content header digest.

[0105] When the content length is the content tail length, and the data values ​​corresponding to each data element split from the string are all extracted from the data elements according to the content tail truncation direction, the generated content summary is the content tail summary.

[0106] It is understood that the main difference between the content header summary and the content tail summary in this embodiment is the different preset content lengths and the different truncation directions selected when truncating the data element (DEL) (the content header summary is truncated according to the content header truncation direction, and the content tail summary is truncated according to the content tail truncation direction).

[0107] For example, if the preset reading rule is to read line by line, the content header truncation direction can be from left to right, and the content tail truncation direction can be from right to left;

[0108] If the preset reading rule is to read by column, then the content header truncation direction can be from top to bottom, and the content tail truncation direction can be from bottom to top.

[0109] For example, the Content Header Degist (CHD) corresponding to each data string can be generated using the following formula, but it should be understood that the concatenation order is not limited:

[0110] CHD=IEA(DRP_ID+DEL_1+DEL_2+....+DEL_N)

[0111] Wherein, DRP_ID is the identity information of the data provider, DEL_i is the data value corresponding to the i-th data element split from the string and extracted according to the content header truncation direction, IEA() represents the irreversible encryption algorithm, and i = 1, 2, ..., N. It should be understood that the numbering of each data element in this embodiment is only for ease of explanation and does not represent a limitation on the order.

[0112] For example, the Content Tail Degist (CTD) corresponding to each data string can be generated using the following formula, but it should be understood that the concatenation order is not limited:

[0113] CTD=IEA(DRP_ID+DEL_T1+DEL_T2+....+DEL_TN)

[0114] Wherein, DRP_ID is the identity information of the data provider, DEL_Ti is the data value extracted according to the content tail truncation direction corresponding to the i-th data element split from the string, IEA() represents the irreversible encryption algorithm, and i = 1, 2, ..., N. It should be understood that the numbering of each data element in this embodiment is only for ease of explanation and does not represent a limitation on the order.

[0115] In one alternative implementation, all data elements split from each data string have a sequential order;

[0116] The content summary corresponding to each data string is generated through the following steps for that data string:

[0117] Based on the data elements extracted from the string of data, T content append summaries corresponding to the string of data are generated. The t-th content append summary is generated by concatenating and encrypting one or more target data elements. The encryption process is performed using an irreversible encryption algorithm.

[0118] The one or more target data elements are selected from the data elements split from the string of data according to a preset rule. The preset rule is determined by an increasing sequence, an arithmetic sequence, or a geometric sequence. The preset rule takes t as input, where t and T are both positive integers and 1≤t≤T.

[0119] It is understandable that in this embodiment, when only one target data element is selected, since concatenating one data element will result in that single data element, concatenating and encrypting that single data element can be understood as directly encrypting that single data element. Furthermore, T can be a number of content appended summaries that the user sets according to their needs.

[0120] For example, if the preset reading rule is to read by row, the order can be from left to right; if the preset reading rule is to read by column, the order can be from top to bottom.

[0121] For example, if the preset rule is determined by an increasing sequence, then the one or more target data elements selected in the t-th content appended digest can refer to the first t data elements split from the string of data. However, it should be understood that the preset rule in this embodiment only needs to conform to an increasing sequence.

[0122] For example, if the preset rules are determined by an arithmetic or geometric sequence, then the one or more target data elements selected in the t-th content appended summary can refer to the first a data elements extracted from the string. t There are 10 data elements, where a t It is an arithmetic or geometric sequence. In this embodiment, the arithmetic sequence can be a... t =1 + (t-1) × 2, the geometric sequence can be a t =2 t-1 .

[0123] In some cases, see Figure 7Taking a summary that simultaneously includes a file identifier, a content header summary, a content footer summary, and T additional content summaries as an example, after generating the file identifier, content header summary, and content footer summary in sequence (it should be understood that this is only an illustrative example and not a specific limitation on the generation order), the additional content summaries can be generated one by one (if T=0, the generation of additional content summaries can be skipped) until enough additional content summaries are generated.

[0124] In one alternative implementation, the order is a user-defined order.

[0125] It should be noted that user-defined order refers to the order in which the data elements extracted from each data string are arranged (this arrangement can be understood as just a numbering system, and does not necessarily require actually changing the position of the data elements in each data string).

[0126] In this embodiment, T additional content summaries corresponding to each string of data can be generated in different sequences, thereby giving users greater autonomy and enabling them to adjust the generated additional content summaries according to different needs.

[0127] In one optional implementation, adding the summary information to the first data product information to form the second data product information includes:

[0128] The file identifier is placed into the filename of the first data product information to obtain the third data product information;

[0129] The content summary and / or additional content summary corresponding to each string of data are respectively placed into each string of data to form the fourth data product information;

[0130] The second data product information is determined based on the third data product information and / or the fourth data product information.

[0131] It is understandable that the second data product information can be generated based on the third and fourth data product information (in this case, it is equivalent to adding a file identifier to the file name of the first data product information, and adding the corresponding content summary and / or content supplementary summary to each string of data in the first data product information), thereby improving the richness of the summary information in the generated second data product information so that it can be more easily identified and achieve better protection of rights.

[0132] It can also be understood that the second data product information can be determined by either the third or fourth data product information (in this case, the second data product information can be either the third or fourth data product information itself), thereby reducing the computing power and processing time required to generate the second data product information.

[0133] It should be noted that, see Figure 8 In this case, taking the file identifier as the file fingerprint and the string data as the row data as an example, regarding the fourth data product information in this embodiment, if it is selected to put the content summary into each string data, it can be further selected to put the content header summary and / or the content tail summary. For example, when putting the content header summary, the content tail summary and the content append summary, the string data, the content header summary, the content tail summary and the content append summary can be concatenated from left to right.

[0134] See Figure 2 The diagram illustrates a data transmission method according to an embodiment of this application. This data transmission method is applicable to a secondary node in a data trading system, which also includes a primary node. The data transmission method includes steps S21-S24, as follows:

[0135] S21, Receive the first data product information sent by the data provider;

[0136] S22, the first data product information is processed using any of the above-described data processing methods to obtain the second data product information;

[0137] S23, send an application request carrying the second data product information to the first-level node, wherein the application request is used to apply for a data product certificate;

[0138] S24, in response to receiving the data product certificate sent by the primary node, the data product certificate is sent to the data provider.

[0139] Furthermore, in related technologies, since data transactions are mainly conducted through data exchanges, which are usually single nodes, it is difficult to achieve data interoperability between multiple regions, thus creating a single point of risk. It is difficult to prevent data purchasers from reselling the purchased data through data exchanges in other regions.

[0140] Therefore, this embodiment configures the data trading system as a system with primary and secondary nodes. For example, there can be only one primary node in the entire data trading system (or multiple primary nodes that can synchronize and communicate with each other), while multiple secondary nodes can be set up according to region, industry, etc. Each secondary node connects to its corresponding data provider (for example, when secondary nodes are set up according to region, each data provider can send the first data product information to the secondary node set up in its own region). The data transmission method in this embodiment can be applied to any secondary node, thereby decoupling the primary node (regulator), secondary node (data processor), and data provider (trading party) in the data trading system. The final data product certificate is uniformly confirmed by the primary node, and the primary node does not need to directly connect to the data provider to avoid interference, further ensuring a one-to-one correspondence between the data product certificate and the data product information, and better protecting the legitimate rights and interests of the data provider. Furthermore, it can be understood that the data trading system can also be configured with three or more levels of nodes, and a certain level of node can also execute the data transmission method described in this embodiment.

[0141] It is understandable that in step S24, if the secondary node can receive the data product certificate sent by the primary node for the application request, it means that the second data product information carried in the application request has not been sold for the first time, that is, the corresponding data provider is not selling it repeatedly.

[0142] Optionally, after step S23, the data transmission method may further include: in response to the secondary node receiving duplicate submission information sent by the primary node regarding the application request, the secondary node confirms that the first data product information is a duplicate submission based on the duplicate submission information, wherein the duplicate submission information is generated by the primary node when it confirms that the application request does not meet the requirements for generating a data product certificate. In this embodiment, the duplicate submission information can be used to indicate that the first data product information is a duplicate submission of the same data product information by the data provider, therefore the primary node will not generate a corresponding data product certificate for the application request.

[0143] For example, this embodiment can be applied to, for example, Figure 6 and / or Figure 9 In any of the secondary nodes of the data trading system shown, it should be understood that data provider A in this embodiment refers to all data providers that are connected to a secondary node A, and the same applies to other data providers.

[0144] In one optional implementation, the application request is specifically used to instruct the first-level node to generate a data product certificate corresponding to the application request and send it to the second-level node if it confirms from the inspection results that it has not stored a certificate corresponding to the application request.

[0145] The inspection result is used to indicate the result of the inspection of the application request by the first-level node.

[0146] It should be noted that the primary nodes pre-store data product credentials corresponding to a large amount of data product information. For example, each time it is confirmed that a data product credential corresponding to an application request can be generated, the generated data product credential is stored in the primary node itself. Therefore, this check result can indicate whether the primary node itself has stored the data product credential corresponding to the application request.

[0147] Optionally, the first-level node's inspection of the application request may include: the first-level node checking the data product name, the summary information, and the data provider information in the application request to search for the existence of a corresponding data product certificate in its stored certificates, and obtaining the inspection result. For example, the summary information may include a file identifier, a content header summary, a content footer summary, and / or a content appendix summary, and the data provider information may include the data provider's identity information, DPR_ID.

[0148] In this embodiment, the credibility of the inspection results and the scope of the inspection can be maximized by storing past data product credentials in the primary node.

[0149] In one optional implementation, the application request also carries information about the data provider, the data product name, and a data product description;

[0150] The data product credential corresponding to the application request is generated based on an internal credential digest. The internal credential digest is obtained by the first-level node by concatenating and encrypting the data product name, the data product description, the digest information, the information of the data provider, and the key corresponding to the information of the data provider. The key is pre-stored in the first-level node.

[0151] Specifically, in this embodiment, the primary node can concatenate the data product name, data product description, digest information, data provider information, and the key DRP_SECRET corresponding to the data provider information in a given order, and then encrypt them using an irreversible encryption algorithm to obtain an internal credential digest. Based on this internal credential digest, a data product credential corresponding to the application request is then generated. For example, the digest information may include a file identifier, a content header digest, a content footer digest, and / or a content appendix digest, and the data provider information may include the data provider's identity information DPR_ID.

[0152] In this embodiment, when a primary node confirms the need to generate a data product certificate, it can instruct the primary node to concatenate and encrypt all the information related to the data provider and its provided data product information carried in the application request, thereby generating a data product certificate containing a large amount of content related to the data provider and its provided data product information, further ensuring the uniqueness of the data product certificate.

[0153] Optionally, each data product credential may include a unique credential number and a corresponding data product credential certificate, wherein the credential number may be visible to the data provider. In this embodiment, after receiving the credential number and data product credential certificate returned by the primary node, the secondary node may choose to issue the data product credential certificate to the data provider.

[0154] In one optional implementation, in response to receiving the data product certificate sent by the primary node, the data transmission method further includes at least one of the following:

[0155] Store the data product credentials;

[0156] The first data product information is uploaded to the data trading hall of the data trading system.

[0157] It is understood that in this embodiment, when it is necessary to store data product credentials and / or when it is necessary to put the first data product information on the shelf, the storage operation and / or shelf operation can be performed asynchronously relative to the distribution operation.

[0158] In this embodiment, the generated data product certificate can be stored in the secondary node, so that the submitted first data product information can be checked directly at the secondary node. Only after passing the check of the secondary node will the primary node perform a second check, which is equivalent to a preliminary screening at the secondary node, improving the checking efficiency and avoiding frequent calls to the checking function of the primary node (because a primary node may connect to a large number of secondary nodes); and / or, the first data product information corresponding to the data product certificate confirmed by the primary node can be uploaded to the data trading hall for other users (data purchasers) to purchase.

[0159] Accordingly, this application also provides a data processing apparatus capable of implementing all the processes of the data processing method provided in the above embodiments.

[0160] See Figure 3 The diagram shows a schematic representation of the data processing apparatus provided in an embodiment of this application, including:

[0161] The summary information generation module 301 is used to generate summary information based on the first data product information from the data provider, wherein the summary information includes at least one of the following: file identifier, content summary, and content supplementary summary;

[0162] The information adding module 302 is used to add the summary information to the first data product information to form the second data product information.

[0163] In one optional implementation, the summary information includes the file identifier, and the generation of summary information based on first data product information from the data provider includes:

[0164] An irreversible encryption algorithm is used to encrypt the content of the data file carried by the first data product information to obtain a file content digest;

[0165] By combining the identity information of the data provider, the submission time of the first data product information, and the document content summary, a first splicing result is obtained;

[0166] An irreversible encryption algorithm is used to encrypt the first concatenation result to generate the file identifier.

[0167] In one optional implementation, the summary information includes the content summary and / or the content supplementary summary, and the generation of summary information based on the first data product information from the data provider includes:

[0168] Read at least one string of data from the first data product information according to the preset reading rules, and split each string of data into several data elements according to the delimiter corresponding to each string of data.

[0169] Based on all the data elements extracted from each data string, generate a content summary and / or additional content summary corresponding to each data string.

[0170] In one alternative implementation, a content summary corresponding to each data string is generated through the following steps for that data string:

[0171] The length of each data element extracted from the string of data is compared with the preset content length, and the data value corresponding to each data element is extracted from each data element according to the comparison result;

[0172] The identity information of the data provider and the data values ​​corresponding to each of the data elements extracted from the string of data are concatenated to obtain a second concatenation result;

[0173] An irreversible encryption algorithm is used to encrypt the second concatenation result, generating a content digest corresponding to the string of data.

[0174] In one optional implementation, the content digest corresponding to each string of data includes a content header digest and / or a content tail digest; wherein,

[0175] When the content length is the content header length, and the data values ​​corresponding to each data element split from the string of data are all extracted from the data elements according to the content header truncation direction, the generated content digest is the content header digest.

[0176] When the content length is the content tail length, and the data values ​​corresponding to each data element split from the string are all extracted from the data elements according to the content tail truncation direction, the generated content summary is the content tail summary.

[0177] In one alternative implementation, all data elements split from each data string have a sequential order;

[0178] The content summary corresponding to each data string is generated through the following steps for that data string:

[0179] Based on the data elements extracted from the string of data, T content append summaries corresponding to the string of data are generated. The t-th content append summary is generated by concatenating and encrypting one or more target data elements. The encryption process is performed using an irreversible encryption algorithm.

[0180] The one or more target data elements are selected from the data elements split from the string of data according to a preset rule. The preset rule is determined by an increasing sequence, an arithmetic sequence, or a geometric sequence. The preset rule takes t as input, where t and T are both positive integers and 1≤t≤T.

[0181] In one alternative implementation, the order is a user-defined order.

[0182] In one optional implementation, adding the summary information to the first data product information to form the second data product information includes:

[0183] The file identifier is placed into the filename of the first data product information to obtain the third data product information;

[0184] The content summary and / or additional content summary corresponding to each string of data are respectively placed into each string of data to form the fourth data product information;

[0185] The second data product information is determined based on the third data product information and / or the fourth data product information.

[0186] Accordingly, this application also provides a data transmission apparatus capable of implementing all the processes of the data transmission method provided in the above embodiments.

[0187] See Figure 4 This diagram illustrates the structure of a data transmission device provided in an embodiment of this application. The data transmission device is suitable for a secondary node in a data transaction system, which also includes a primary node. The data transmission device comprises:

[0188] Information receiving module 401 is used to receive first data product information sent by the data provider;

[0189] Data processing module 402 is used to process the first data product information using any of the data processing methods described above to obtain the second data product information;

[0190] The request module 403 is used to send an application request carrying the second data product information to the first-level node, wherein the application request is used to apply for a data product certificate;

[0191] The delivery module 404 is used to, in response to receiving the data product certificate sent by the primary node, deliver the data product certificate to the data provider.

[0192] In one optional implementation, the application request is specifically used to instruct the first-level node to generate a data product certificate corresponding to the application request and send it to the second-level node if it confirms from the inspection results that it has not stored a certificate corresponding to the application request.

[0193] The inspection result is used to indicate the result of the inspection of the application request by the first-level node.

[0194] In one optional implementation, the application request also carries information about the data provider, the data product name, and a data product description;

[0195] The data product credential corresponding to the application request is generated based on an internal credential digest. The internal credential digest is obtained by the first-level node by concatenating and encrypting the data product name, the data product description, the digest information, the information of the data provider, and the key corresponding to the information of the data provider. The key is pre-stored in the first-level node.

[0196] In one optional implementation, in response to receiving the data product certificate sent by the primary node, the data transmission device further includes at least one of the following:

[0197] Storage module, used to store the data product credentials;

[0198] The listing module is used to list the first data product information to the data trading hall of the data trading system.

[0199] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the data processing method or the steps of the data transmission method described in any of the above claims.

[0200] This application also provides a computer program product, including computer instructions that, when executed by a processor, implement the steps of the data processing method or the data transmission method described in any of the above claims.

[0201] This application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the steps of the data processing method described in any of the above claims, or the steps of the data transmission method described in any of the above claims.

[0202] See Figure 5The computer device of this embodiment includes: a processor 501, a memory 502, and a computer program stored in the memory 502 and executable on the processor 501, such as a data processing program and / or a data transmission program. When the processor 501 executes the computer program, it implements the steps in the various data processing methods and / or data transmission methods embodiments described above, for example... Figure 1 Steps S11-S12 and / or shown Figure 2 Steps S21-S24 are shown.

[0203] For example, the computer program may be divided into one or more modules / units, which are stored in the memory 502 and executed by the processor 501 to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the computer device.

[0204] The computer device may be a desktop computer, laptop, handheld computer, or cloud server, etc. The computer device may include, but is not limited to, a processor 501 and a memory 502. Those skilled in the art will understand that the schematic diagram is merely an example of a computer device and does not constitute a limitation on the computer device. It may include more or fewer components than shown, or combine certain components, or different components. For example, the computer device may also include input / output devices, network access devices, buses, etc.

[0205] The processor 501 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor, or the processor 501 can be any conventional processor. The processor 501 is the control center of the computer device, connecting various parts of the entire computer device through various interfaces and lines.

[0206] The memory 502 can be used to store the computer programs and / or modules. The processor 501 implements various functions of the computer device by running or executing the computer programs and / or modules stored in the memory 502 and calling the data stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.). In addition, the memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart media card (SMC), secure digital card (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0207] Wherein, if the modules / units integrated into the computer device are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by the processor 501, it can implement the steps of the various method embodiments described above. Wherein, the computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc.

[0208] In summary, the embodiments of this application have at least the following beneficial effects:

[0209] By employing the embodiments of this application, summary information is generated based on first data product information from a data provider. The summary information includes at least one of file identifier, content summary, and content supplementary summary. The summary information is added to the first data product information to form second data product information. This allows for the identification of whether the data product information has been sold repeatedly by using the summary information added to the data product information, thereby protecting the legitimate rights and interests of the original data provider.

[0210] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary hardware platforms, or it can be implemented entirely by hardware. Based on this understanding, all or part of the technical solutions of this application that contribute to the background technology can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0211] The above description is the preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications are also considered to be within the scope of protection of this application.

Claims

1. A data processing method, characterized in that, include: Based on the first data product information from the data provider, summary information is generated, wherein the summary information includes at least one of the following: file identifier, content summary, and content supplementary summary; The summary information is added to the first data product information to form the second data product information; The summary information includes the content summary and / or the content supplementary summary. The step of generating summary information based on the first data product information from the data provider includes: reading at least one string of data from the first data product information according to a preset reading rule, and splitting each string of data into several data elements according to the delimiter corresponding to each string of data; generating a content summary and / or content supplementary summary corresponding to each string of data based on all the data elements split from each string of data. The step of adding the summary information to the first data product information to form the second data product information includes: placing the file identifier into the file name of the first data product information to obtain the third data product information; placing the content summary and / or content supplement summary corresponding to each string of data into each string of data to form the fourth data product information; and determining the second data product information based on the third data product information and / or the fourth data product information.

2. The data processing method as described in claim 1, characterized in that, The summary information includes the file identifier, and the generation of summary information based on the first data product information from the data provider includes: An irreversible encryption algorithm is used to encrypt the content of the data file carried by the first data product information to obtain a file content digest; By combining the identity information of the data provider, the submission time of the first data product information, and the document content summary, a first splicing result is obtained; An irreversible encryption algorithm is used to encrypt the first concatenation result to generate the file identifier.

3. The data processing method as described in claim 1, characterized in that, The content summary corresponding to each data string is generated through the following steps for that data string: The length of each data element extracted from the string of data is compared with the preset content length, and the data value corresponding to each data element is extracted from each data element according to the comparison result; The identity information of the data provider and the data values ​​corresponding to each of the data elements extracted from the string of data are concatenated to obtain a second concatenation result; An irreversible encryption algorithm is used to encrypt the second concatenation result, generating a content digest corresponding to the string of data.

4. The data processing method as described in claim 3, characterized in that, The content summary corresponding to each data string includes a content header summary and / or a content footer summary; wherein, When the content length is the content header length, and the data values ​​corresponding to each data element split from the string of data are all extracted from the data elements according to the content header truncation direction, the generated content summary is the content header summary. When the content length is the content tail length, and the data values ​​corresponding to each data element split from the string are all extracted from the data elements according to the content tail truncation direction, the generated content summary is the content tail summary.

5. The data processing method as described in claim 1, characterized in that, All data elements extracted from each data string have a sequential order; The content summary corresponding to each data string is generated through the following steps for that data string: Based on the data elements extracted from the string of data, generate a corresponding data element. The content includes additional summaries, among which the first... Each content appendix is ​​generated by concatenating and encrypting one or more target data elements, wherein the encryption process is performed using an irreversible encryption algorithm. Wherein, the one or more target data elements are selected from the data elements split from the string of data according to a preset rule, wherein the preset rule is determined by an increasing sequence, an arithmetic sequence, or a geometric sequence, and the preset rule is based on... As input, and All are positive integers and .

6. The data processing method as described in claim 5, characterized in that, The order mentioned is a user-defined order.

7. A data transmission method, characterized in that, This method applies to secondary nodes in a data trading system, which also includes primary nodes, and the data transmission method includes: Receive the first data product information sent by the data provider; The first data product information is processed using the data processing method described in any one of claims 1-6 to obtain the second data product information; Send an application request carrying the second data product information to the first-level node, wherein the application request is used to apply for a data product certificate; In response to receiving the data product certificate sent by the primary node, the data product certificate is sent to the data provider.

8. The data transmission method as described in claim 7, characterized in that, The application request is specifically used to instruct the first-level node to generate a data product certificate corresponding to the application request and send it to the second-level node if it confirms from the inspection results that it has not stored a certificate corresponding to the application request. The inspection result is used to indicate the result of the inspection of the application request by the first-level node.

9. The data transmission method as described in claim 8, characterized in that, The application request also includes information about the data provider, the data product name, and a data product description. The data product credential corresponding to the application request is generated based on an internal credential digest. The internal credential digest is obtained by the first-level node by concatenating and encrypting the data product name, the data product description, the digest information, the information of the data provider, and the key corresponding to the information of the data provider. The key is pre-stored in the first-level node.

10. The data transmission method according to any one of claims 7-9, characterized in that, In response to receiving the data product certificate sent by the primary node, the data transmission method further includes at least one of the following: Store the data product credentials; The first data product information is uploaded to the data trading hall of the data trading system.

11. A data processing apparatus, characterized in that, include: The summary information generation module is used to generate summary information based on first data product information from a data provider, wherein the summary information includes at least one of file identifier, content summary, and content supplementary summary; An information adding module is used to add the summary information to the first data product information to form second data product information; The summary information includes the content summary and / or the content supplementary summary. The step of generating summary information based on the first data product information from the data provider includes: reading at least one string of data from the first data product information according to a preset reading rule, and splitting each string of data into several data elements according to the delimiter corresponding to each string of data; generating a content summary and / or content supplementary summary corresponding to each string of data based on all the data elements split from each string of data. The step of adding the summary information to the first data product information to form the second data product information includes: placing the file identifier into the file name of the first data product information to obtain the third data product information; placing the content summary and / or content supplement summary corresponding to each string of data into each string of data to form the fourth data product information; and determining the second data product information based on the third data product information and / or the fourth data product information.

12. A data transmission device, characterized in that, This is applicable to secondary nodes in a data trading system, which also includes primary nodes. The data transmission device includes: The information receiving module is used to receive the first data product information sent by the data provider; The data processing module is used to process the first data product information using the data processing method described in any one of claims 1-6 to obtain the second data product information; The request module is used to send an application request carrying the second data product information to the first-level node, wherein the application request is used to apply for a data product certificate; The distribution module is used to distribute the data product certificate to the data provider in response to receiving the data product certificate sent by the primary node.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the data processing method according to any one of claims 1-6, or the data transmission method according to any one of claims 7-10.

14. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the data processing method according to any one of claims 1-6, or the data transmission method according to any one of claims 7-10.

15. A computer device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor executes the computer program to implement the data processing method of any one of claims 1-6, or the data transmission method of any one of claims 7-10.

Images