Data processing method, device, equipment and computer storage medium
By querying and storing according to the data category identified in the business system, the time-consuming and security problems of data transmission during multi-system flow are solved, and efficient and secure data query and storage are achieved.
Patent Information
- Application Number
- CN202310679828.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-08
- Publication Date
- 2025-08-08
- Estimated Expiration
- 2043-06-08
AI Technical Summary
In a high-complex business system, when data flows between multiple systems, the data volume is large, the transmission takes a long time, and there is a risk of tampering or loss, which affects the workflow execution efficiency and data reliability.
According to the data category identified by the data, query and storage are carried out in the current node or public database. Data security is ensured through public and private key mechanisms, and public data and device data are stored in a classified manner to improve data query efficiency.
It saves time-consuming data transmission, improves data query efficiency, and ensures data security and consistency.
Smart Images

Figure CN117033408B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a data processing method, apparatus, device and computer storage medium. Background Art
[0002] In highly complex business systems, workflows are used to streamline operations, clearly dividing the original processing logic into several steps. Each step has a clear flow. Each module has high cohesion and clear dependencies between modules. This reduces the difficulty of business system implementation and improves system scalability.
[0003] In related technologies, the amount of data, documents, tasks, and other information flowing between steps is too large. Especially when flowing between multiple systems, a large amount of data needs to be transmitted and stored, which takes a lot of time and seriously affects the efficiency of workflow execution. In addition, data may be tampered with or lost during multiple transmissions, reducing the reliability of data information. Summary of the Invention
[0004] The present application proposes a data processing method, apparatus, device and computer storage medium, which can query data information in the current node or public database according to the data category corresponding to the data identifier, thereby improving data query efficiency.
[0005] To achieve the above objectives, the technical solution of this application is implemented as follows:
[0006] In a first aspect, an embodiment of the present application provides a data processing method, the method comprising:
[0007] Get the identifier of the data to be processed;
[0008] Based on the data category corresponding to the data identifier to be processed, query the data information corresponding to the data identifier to be processed;
[0009] Performing data processing on the data information to obtain corresponding incremental data information;
[0010] According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is synchronized from the current node to a public database.
[0011] In some embodiments, the method further comprises:
[0012] Based on the identifier of the data to be processed, determining the data category corresponding to the identifier of the data to be processed; wherein the data category includes public data information and device data information;
[0013] The querying of the data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed includes:
[0014] In a case where the data category corresponding to the data identifier to be processed is public data information, determining the data information corresponding to the data identifier to be processed by querying a public database;
[0015] In a case where the data category corresponding to the data identifier to be processed is device data information, the data information corresponding to the data identifier to be processed is determined by performing a local query on the current node.
[0016] In some embodiments, the method further comprises:
[0017] Classifying the incremental data information, and respectively determining public data information and device data information in the incremental data information;
[0018] According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is synchronized from the current node to a public database, including:
[0019] In a case where the data category corresponding to the incremental data information is public data information, synchronizing the incremental data information from the current node to a public database;
[0020] In a case where the data category corresponding to the incremental data information is device data information, the incremental data information is stored in the current node.
[0021] In some embodiments, the method further comprises:
[0022] Obtaining an information digest corresponding to the data information; wherein the data information and the information digest have a corresponding relationship;
[0023] If the information summary does not change, determining that there is no abnormality in the data information;
[0024] When the information digest changes, the data information is reacquired.
[0025] In some embodiments, determining the data information corresponding to the identifier of the data to be processed by querying a public database includes:
[0026] Determining corresponding public key information based on the identifier of the data to be processed;
[0027] In the case that the public key information is legal, a public database is queried according to the identifier of the data to be processed to obtain data information corresponding to the identifier of the data to be processed.
[0028] In some embodiments, processing the data information to obtain corresponding incremental data information includes:
[0029] The data information is processed at the current node to obtain modified incremental data information; and while keeping the data identifier corresponding to the data information unchanged, the serial number corresponding to the data information is increased by 1 and stored as the serial number corresponding to the incremental data information.
[0030] In some embodiments, synchronizing the incremental data information from the current node to a public database includes:
[0031] Sign the incremental data information using the private key information at the current node, and synchronize the corresponding public key information to other target nodes except the current node;
[0032] Synchronize the incremental data information from the current node to the shared database.
[0033] In a second aspect, an embodiment of the present application provides a data processing device, the data processing device comprising:
[0034] an acquisition unit configured to acquire an identifier of data to be processed;
[0035] a determining unit configured to query data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed;
[0036] a processing unit configured to process the data information to obtain corresponding incremental data information;
[0037] The storage unit is configured to store the incremental data information to the current node or synchronize the incremental data information from the current node to a public database according to the data category corresponding to the incremental data information.
[0038] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device including a memory and a processor; wherein,
[0039] The memory is used to store a computer program that can be run on the processor;
[0040] The processor is configured to execute the data processing method as described in the first aspect when running the computer program.
[0041] In a fourth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program. When the computer program is executed by at least one processor, it implements the data processing method described in the first aspect.
[0042] The embodiment of the present application provides a data processing method, device, equipment and computer storage medium, the method comprising: obtaining a data identifier to be processed; querying the data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed; processing the data information to obtain corresponding incremental data information; storing the incremental data information to the current node, or synchronizing the incremental data information from the current node to a public database, according to the data category corresponding to the incremental data information. In this way, data information can be queried according to the data category corresponding to the data identifier to be processed, saving data transmission time while ensuring data security and improving the efficiency of data information query. When generating incremental data information, the incremental data information is stored separately according to the corresponding data category according to different data categories to improve data query efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] Figure 1 A flowchart of a data processing method provided in an embodiment of the present application;
[0044] Figure 2 A flowchart of another data processing method provided in an embodiment of the present application;
[0045] Figure 3 A flowchart of another data processing method provided in an embodiment of the present application;
[0046] Figure 4 A schematic diagram of the structure of a data processing device provided in an embodiment of the present application;
[0047] Figure 5 A schematic diagram of the specific hardware structure of an electronic device provided in an embodiment of the present application;
[0048] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0049] In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below with reference to the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present application.
[0050] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.
[0051] In the following description, reference is made to "some embodiments," which describe a subset of all possible embodiments. However, it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict. It should also be noted that the terms "first, second, and third" in the embodiments of the present application are only used to distinguish similar objects and do not represent a specific ordering of the objects. It is understood that "first, second, and third" may be interchanged in a specific order or sequential order where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.
[0052] It's understandable that in highly complex business systems, workflows can be used to streamline operations, clearly dividing the original processing logic into several steps, with clear and distinct flow within each step. Each module has very high cohesion, and the dependencies between modules are clearly defined. This reduces the difficulty of implementing the business system and improves system scalability.
[0053] In related technologies, the amount of data, documents, tasks, and other information flowing between steps is too large. Especially when flowing between multiple systems, a large amount of data needs to be transmitted and stored, which takes a lot of time and seriously affects the efficiency of workflow execution. In addition, data may be tampered with or lost during multiple transmissions, reducing the reliability of data information.
[0054] Based on this, the embodiment of the present application needs to provide a data processing method, the basic idea of which is: obtain the identifier of the data to be processed; based on the data category corresponding to the identifier of the data to be processed, query the data information corresponding to the identifier of the data to be processed; process the data information to obtain the corresponding incremental data information; according to the data category corresponding to the incremental data information, store the incremental data information to the current node, or synchronize the incremental data information from the current node to the public database. In this way, data information can be queried according to the data category corresponding to the identifier of the data to be processed, which saves data transmission time while ensuring data security and improving the efficiency of data information query. When generating incremental data information, the incremental data information is stored separately according to the corresponding data category according to different data categories to improve data query efficiency.
[0055] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0056] Example 1
[0057] See also Figure 1 , which shows a flow chart of a data processing method provided by an embodiment of the present application. Figure 1 As shown, the method may include:
[0058] S101: Obtain an identifier of data to be processed.
[0059] It should be noted that the data processing method provided in the embodiments of the present application can be applied to a data processing device with data processing requirements, or an electronic device integrated with the device. Here, the electronic device can be a computer, a smart phone, a tablet computer, a laptop computer, a PDA (Personal Digital Assistant), a portable media player (PMP), a navigation device, a wearable device, or a system composed of the above device nodes, etc., and the embodiments of the present application do not specifically limit this.
[0060] It should also be noted that in the embodiment of the present application, there is a corresponding relationship between the data identifier to be processed and the data information, and the corresponding data information can be obtained based on the data identifier to be processed. The data identifier to be processed can come from other nodes or be preset by the user, and no limitation is made here.
[0061] In some embodiments, the data identifier to be processed may include an information summary; the data information has a corresponding data identifier and information summary, the data identifier is used to transmit the data information, and the information summary is used to verify the data information. After obtaining the data identifier to be processed, the corresponding data information can be queried through the local database, and the information summary can be used to verify the data information.
[0062] S102: Based on the data category corresponding to the data identifier to be processed, query the data information corresponding to the data identifier to be processed.
[0063] It should be noted that in the embodiment of the present application, based on the data category corresponding to the data identifier to be processed, the storage location of the data information corresponding to the data identifier to be processed is determined according to different data categories, and the data information corresponding to the data identifier to be processed is queried, wherein the data identifier to be processed and the data information have a corresponding relationship. Specifically, the data identifier to be processed and the data information can be a one-to-one correspondence or a one-to-many correspondence, and no limitation is made here.
[0064] In some embodiments, the method may further include:
[0065] Based on the identifier of the data to be processed, determining the data category corresponding to the identifier of the data to be processed; wherein the data category includes public data information and device data information;
[0066] The querying of the data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed includes:
[0067] In a case where the data category corresponding to the data identifier to be processed is public data information, determining the data information corresponding to the data identifier to be processed by querying a public database;
[0068] In a case where the data category corresponding to the data identifier to be processed is device data information, the data information corresponding to the data identifier to be processed is determined by performing a local query on the current node.
[0069] It should be noted that in the embodiment of the present application, the data categories include public data information and device data information, among which the public data information can specifically include data information that can be obtained and used by other nodes other than the current node, and the device data information can specifically include the device data information of the current node itself, that is, data information that will not be used by other nodes other than the current node.
[0070] It should also be noted that, in an embodiment of the present application, after determining the data category corresponding to the data identifier to be processed based on the data identifier to be processed, if the data category corresponding to the data identifier to be processed is public data information, it indicates that the public data information is stored in a public database, and the data information corresponding to the data identifier to be processed is determined by querying the public database; if the data category corresponding to the data identifier to be processed is device data information, it indicates that the device data information is stored in the current node, and the data information corresponding to the data identifier to be processed is determined by performing a local query on the current node.
[0071] In some embodiments, the method may further include:
[0072] Obtaining an information digest corresponding to the data information; wherein the data information and the information digest have a corresponding relationship;
[0073] If the information summary does not change, determining that there is no abnormality in the data information;
[0074] When the information digest changes, the data information is reacquired.
[0075] It should be noted that, in the embodiment of the present application, the acquired data information is verified by verifying the information digest corresponding to the data information. If the information digest has not changed, it means that the data information has not changed either, and it is determined that there is no abnormality in the data information; if the information digest has changed, it means that the data information has also changed, and the data information needs to be re-acquired.
[0076] It should also be noted that in the embodiment of the present application, the information summary can be obtained based on the data information using a hash algorithm to obtain a hash function value that can represent the data information. When performing information summary comparison, it is equivalent to performing data information comparison, which improves the efficiency of data information verification.
[0077] In some embodiments, determining the data information corresponding to the identifier of the data to be processed by querying a public database may include:
[0078] Determining corresponding public key information based on the identifier of the data to be processed;
[0079] In the case that the public key information is legal, a public database is queried according to the identifier of the data to be processed to obtain data information corresponding to the identifier of the data to be processed.
[0080] It should be noted that, in an embodiment of the present application, the corresponding public key information is determined by the data identifier to be processed; if the public key information is legal, the public database is queried based on the data identifier to be processed to obtain the data information corresponding to the data identifier to be processed; if the public key information is illegal, the data identifier to be processed and the public key information corresponding to the data identifier to be processed are re-obtained until the public key information is legal, and then the public database is queried based on the data identifier to be processed to obtain the data information corresponding to the data identifier to be processed.
[0081] S103: Process the data information to obtain corresponding incremental data information.
[0082] It should be noted that in an embodiment of the present application, during the data processing process, the data information can be modified, deleted and added, without any limitation. After processing the data information, the corresponding incremental data information is obtained. In an embodiment of the present application, the incremental data information can be synchronously given to other nodes other than the current node, where the incremental data information refers to a new version of the changed data information.
[0083] Specifically, in some embodiments, processing the data information to obtain corresponding incremental data information may include:
[0084] The data information is processed at the current node to obtain modified incremental data information; and while keeping the data identifier corresponding to the data information unchanged, the serial number corresponding to the data information is increased by 1 and stored as the serial number corresponding to the incremental data information.
[0085] It should be noted that in the embodiment of the present application, during the data processing process, the data information can be modified, deleted and added, without any limitation here. After processing the data information, the corresponding incremental data information is obtained. Furthermore, the current node stores the incremental data information, and the device data information in the incremental data information is stored at the current node. It is also necessary to synchronize the public data information in the incremental data information from the current node to the public database to ensure that the data information versions between the nodes are consistent and improve data operation efficiency.
[0086] S104: According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is synchronized from the current node to a public database.
[0087] It should be noted that in the embodiment of the present application, the current node not only needs to store the device data information in the incremental data information at the current node, but also needs to synchronize the public data information in the incremental data information from the current node to the public database to ensure that the public data information versions between the nodes are consistent and improve data operation efficiency. The other target nodes can be one or more, and there is no limitation here.
[0088] In some embodiments, the method may further include:
[0089] Classifying the incremental data information, and respectively determining public data information and device data information in the incremental data information;
[0090] According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is synchronized from the current node to a public database, including:
[0091] In a case where the data category corresponding to the incremental data information is public data information, synchronizing the incremental data information from the current node to a public database;
[0092] In a case where the data category corresponding to the incremental data information is device data information, the incremental data information is stored in the current node.
[0093] It should be noted that in the embodiment of the present application, the data categories include public data information and device data information, among which the public data information can specifically include data information that can be obtained and used by other nodes other than the current node, and the device data information can specifically include the device data information of the current node itself, that is, data information that will not be used by other nodes other than the current node.
[0094] It should also be noted that, in an embodiment of the present application, after the incremental data information is classified, the public data information and device data information in the incremental data information are determined; in a case where the data category corresponding to the incremental data information is public data information, it means that other nodes besides the current node can also obtain and use the public data information, so the incremental data information is synchronized from the current node to the public database; in a case where the data category corresponding to the incremental data information is device data information, it means that other nodes besides the current node will not use the device data information, so the incremental data information is stored in the current node.
[0095] In some embodiments, synchronizing the incremental data information from the current node to a public database may include:
[0096] Sign the incremental data information using the private key information at the current node, and synchronize the corresponding public key information to other target nodes except the current node;
[0097] The incremental data information is synchronized from the current node to the shared database.
[0098] It should be noted that in the embodiment of the present application, regardless of synchronizing data information from the current node to the shared database, it is necessary to use private key information at the current node to sign the incremental data information, and synchronize the corresponding public key information to other target nodes other than the current node to achieve sharing of the public database. Other target nodes can obtain data information in the public database through public key information.
[0099] It should also be noted that in the embodiments of the present application, the public key information is the non-secret half of the key pair used with the private key information. The public key information and the private key information have a corresponding relationship. The data encrypted by the current node using the private key information can be verified by other nodes through the public key information, thereby determining the accuracy of the data information. The public key information and the private key information are a key pair (i.e., a public key and a private key) obtained by the algorithm, wherein the private key information is used by the current node, and the public key information is passed to other nodes for use.
[0100] This embodiment provides a data processing method, which obtains a data identifier to be processed; based on the data category corresponding to the data identifier to be processed, queries the data information corresponding to the data identifier to be processed; processes the data information to obtain corresponding incremental data information; based on the data category corresponding to the incremental data information, stores the incremental data information to the current node, or synchronizes the incremental data information from the current node to a public database. In this way, data information can be queried based on the data category corresponding to the data identifier to be processed, which saves data transmission time, ensures data security, and improves the efficiency of data information query. When generating incremental data information, the incremental data information is stored separately according to the corresponding data category according to different data categories to improve data query efficiency.
[0101] Example 2
[0102] Based on the same inventive concept as the above-mentioned embodiment, during data processing between multi-node devices, the data information of the current node can be classified first. Specifically, the data information can be divided into public data information and device data information based on whether the data information needs to be used by other nodes other than the current node.
[0103] Specifically, the public data information may include data information that can be acquired and used by other nodes except the current node, and the device data information may include the device data information of the current node itself, that is, data information that other nodes except the current node do not need to use.
[0104] In some embodiments, when the data information is public data information, see Figure 2 , which shows a detailed flow chart of a data processing method provided by an embodiment of the present application. The embodiment of the present application independently stores large information documents that need to be shared between nodes as public data information. During the flow of business processes, the identifier and summary of the large information document are used for transmission. If complete document information is required in each step, the specified application program interface (Application Program Interface, API) can be called through the identifier to obtain it. The data summary is obtained using a hash algorithm and verified when the large information document is obtained. Figure 2 As shown, the method may include:
[0105] Step 1: Generate id and hashValue based on big information data and store them through storage service.
[0106] Step 2: Use the ID passed in step 1 to query the big information data from the storage service, and check the data using hashValue to prevent data changes in the middle and cause exceptions.
[0107] Step 3: In subsequent steps, you can query big information data through ID and perform business processing.
[0108] In some embodiments, when the data information is device data information, see Figure 3 , which shows a detailed flow chart of another data processing method provided by an embodiment of the present application, such as Figure 3 As shown, the method may include:
[0109] Step 1: Generate an ID based on the big data and use the private key to sign it. The ID and sign are then stored locally on Storage Node 1. After receiving the data, Storage Node 1 immediately synchronizes it with other similar storage nodes, passing along the data ID and public key.
[0110] Step 2: Node 2 uses the ID passed from step 1 to query the big information data on local storage node 2. The data is signed using the public key to prevent mid-process data changes and tampering. After step 2 modifies the data in 1001, it increments the sequence number by 1 and stores it on local storage node 2. The data is also synchronized to other storage nodes.
[0111] Step 3: All subsequent nodes can use the data ID to query the big information data locally and perform business processing. Each change requires each step node to sign with its own private key.
[0112] Step 4: Each step node stores the public keys of all legal nodes in advance. When receiving the message from the previous step node, it first determines whether the public key is legal.
[0113] In the embodiment of the present application, device data information is stored in the local storage node corresponding to each node device, and public data information is immediately synchronized to the public database after each processing node processes the data. When performing data query and application; each processing node in the region determines the data information that needs to be processed by sending the data to be processed identifier, and obtains data from the public database or the current node through the data to be processed identifier. In this way, there is no need to transmit a large amount of data during data processing, which shortens the transmission time, and when each processing node updates the data to be processed, the updated incremental data is immediately synchronized to other storage nodes, which can improve processing efficiency.
[0114] This allows big data to be synchronized to a public database before being processed by the next process node, allowing each step to utilize the public data in the public database, improving process execution efficiency. Data is also signed and verified, greatly improving security.
[0115] In the embodiments of this application, the process flow uses data IDs for flow, big data information is synchronized to each storage node in advance, and a signature mechanism is used to verify the legitimacy of the data. This allows for high transmission performance between nodes, high process processing efficiency, simple step node operations, and enhanced data security.
[0116] An embodiment of the present application provides a data processing method, and the specific implementation of the aforementioned embodiment is elaborated in detail based on the aforementioned embodiment. It can be seen that according to the technical solution of the aforementioned embodiment, in the data processing method of the present technical solution, data is stored in the local storage node corresponding to each node device, and each processing node immediately adds data to each storage node after processing the data, and synchronizes the data to be processed to all storage nodes in the area; the identification of the data to be processed is sent between each processing node in the area, so that there is no need to transmit a large amount of data during data processing, shortening the transmission time, and when each processing node updates the data to be processed, the updated incremental data is immediately synchronized to other storage nodes, which can improve processing efficiency.
[0117] Example 3
[0118] Based on the same inventive concept as the above embodiments, see Figure 4 , which shows a schematic diagram of the structure of a data processing device 40 provided in an embodiment of the present application. The data processing device 40 is used to implement any one of the data processing methods in the aforementioned embodiments, specifically, as Figure 4 As shown, the data processing device 40 may include:
[0119] An acquisition unit 401 is configured to acquire an identifier of data to be processed;
[0120] The determining unit 402 is configured to query the data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed;
[0121] The processing unit 403 is configured to process the data information to obtain corresponding incremental data information;
[0122] The storage unit 404 is configured to store the incremental data information to the current node or synchronize the incremental data information from the current node to a public database according to the data category corresponding to the incremental data information.
[0123] In some embodiments, the determination unit 402 is specifically configured to determine the data category corresponding to the data identifier to be processed based on the data identifier to be processed; wherein the data category includes public data information and device data information; and in a case where the data category corresponding to the data identifier to be processed is public data information, the data information corresponding to the data identifier to be processed is determined by querying a public database; and in a case where the data category corresponding to the data identifier to be processed is device data information, the data information corresponding to the data identifier to be processed is determined by performing a local query on the current node.
[0124] In some embodiments, the storage unit 404 is further configured to classify the incremental data information, and respectively determine the public data information and device data information in the incremental data information; and when the data category corresponding to the incremental data information is public data information, synchronize the incremental data information from the current node to the public database; and when the data category corresponding to the incremental data information is device data information, store the incremental data information to the current node.
[0125] In some embodiments, the determination unit 402 is further configured to obtain an information summary corresponding to the data information; wherein there is a corresponding relationship between the data information and the information summary; and when the information summary has not changed, determine that there is no abnormality in the data information; and when the information summary has changed, re-acquire the data information.
[0126] In some embodiments, the determination unit 402 is specifically configured to determine the corresponding public key information based on the data identifier to be processed; and when the public key information is legal, query the public database according to the data identifier to be processed to obtain the data information corresponding to the data identifier to be processed.
[0127] In some embodiments, the processing unit 403 is specifically configured to perform data processing on the data information at the current node to obtain modified incremental data information; and while keeping the data identifier corresponding to the data information unchanged, add 1 to the serial number corresponding to the data information and store it as the serial number corresponding to the incremental data information.
[0128] In some embodiments, the storage unit 404 is specifically configured to use private key information to sign the incremental data information at the current node, and synchronize the corresponding public key information to other target nodes other than the current node; and synchronize the incremental data information from the current node to the shared database.
[0129] It is understood that in this embodiment, a "unit" can be a portion of a circuit, a portion of a processor, a portion of a program or software, etc., and can also be a module or a non-modular system. Furthermore, the various components in this embodiment can be integrated into a single processing unit, or each unit can exist physically separately, or two or more units can be integrated into a single unit. The aforementioned integrated units can be implemented in the form of hardware or software functional modules.
[0130] If the integrated unit is implemented as a software functional module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment, or the portion that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the method described in this embodiment. The aforementioned storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0131] Therefore, this embodiment provides a computer storage medium, which stores a data processing program. When the data processing program is executed by at least one processor, the steps of the method in any one of the above embodiments are implemented.
[0132] Based on the composition of the above-mentioned data processing device 40 and the computer storage medium, see Figure 5 , which shows a schematic diagram of the structure of an electronic device 50 provided in an embodiment of the present application. Figure 5 As shown, it may include: a communication interface 501, a memory 502 and a processor 503; each component is coupled together via a bus system 504. It is understood that the bus system 504 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 504 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, Figure 5 Various buses are labeled as bus system 504. Among them, the communication interface 501 is used to receive and send signals in the process of sending and receiving information between other external network elements;
[0133] Memory 502, used to store computer programs that can be run on processor 503;
[0134] The processor 503 is configured to, when running the computer program, execute:
[0135] Get the identifier of the data to be processed;
[0136] Based on the data category corresponding to the data identifier to be processed, query the data information corresponding to the data identifier to be processed;
[0137] Performing data processing on the data information to obtain corresponding incremental data information;
[0138] According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is synchronized from the current node to a public database.
[0139] It is understood that the memory 502 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDRSDRAM), enhanced synchronous DRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DRRAM). The memory 502 of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0140] The processor 503 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in the processor 503 or by software instructions. The processor 503 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The methods, steps, and logic block diagrams disclosed in the embodiments of this application can be implemented or executed. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory 502, and the processor 503 reads the information in the memory 502 and, in conjunction with its hardware, completes the steps of the above method.
[0141] It is understood that the embodiments described herein may be implemented using hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described herein, or a combination thereof.
[0142] For software implementation, the techniques described herein can be implemented by modules (e.g., procedures, functions, etc.) that perform the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or external to the processor.
[0143] Optionally, as another embodiment, the processor 503 is further configured to execute the steps of the method in any one of the aforementioned embodiments when running the computer program.
[0144] In some embodiments, based on the composition of the above-mentioned data processing device 40, see Figure 6 , which shows a schematic diagram of the composition structure of another electronic device 50 provided in an embodiment of the present application. Figure 6 As shown, the electronic device 50 may include the data processing device 40 according to any one of the aforementioned embodiments.
[0145] In the embodiment of the present application, for the electronic device 50, the identification of the data to be processed is obtained; based on the data category corresponding to the identification of the data to be processed, the data information corresponding to the identification of the data to be processed is queried; the data information is processed to obtain the corresponding incremental data information; according to the data category corresponding to the incremental data information, the incremental data information is stored to the current node, or the incremental data information is synchronized from the current node to the public database. In this way, data information can be queried according to the data category corresponding to the identification of the data to be processed, which saves data transmission time, ensures data security, and improves the efficiency of data information query. When generating incremental data information, the incremental data information is stored separately according to the corresponding data category according to different data categories to improve data query efficiency.
[0146] It should be noted that, in this application, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.
[0147] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0148] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0149] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0150] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.
[0151] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A data processing method, characterized in that: The method comprises: Get the identifier of the data to be processed; Based on the data category corresponding to the data identifier to be processed, query the data information corresponding to the data identifier to be processed; Performing data processing on the data information to obtain corresponding incremental data information; According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is signed and encrypted using the private key information at the current node, and the corresponding public key information is synchronized to other target nodes except the current node, so that the other target nodes can verify the incremental information through the public key information; the incremental data information is synchronized from the current node to a public database; the private key information and the public key information have a corresponding relationship.
2. The method according to claim 1, characterized in that The method further comprises: Based on the identifier of the data to be processed, determining the data category corresponding to the identifier of the data to be processed; The querying of the data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed includes: In a case where the data category corresponding to the data identifier to be processed is public data information, determining the data information corresponding to the data identifier to be processed by querying a public database; In a case where the data category corresponding to the data identifier to be processed is device data information, the data information corresponding to the data identifier to be processed is determined by performing a local query on the current node.
3. The method according to claim 1, characterized in that The method further comprises: Classifying the incremental data information, and respectively determining the public data information and the device data information in the incremental data information; According to the data category corresponding to the incremental data information, the incremental data information is stored in the current node, or the incremental data information is synchronized from the current node to a public database, including: In a case where the data category corresponding to the incremental data information is public data information, synchronizing the incremental data information from the current node to a public database; In a case where the data category corresponding to the incremental data information is device data information, the incremental data information is stored in the current node.
4. The method according to claim 1, wherein The method further comprises: Obtaining an information digest corresponding to the data information; wherein the data information and the information digest have a corresponding relationship; If the information summary does not change, determining that there is no abnormality in the data information; When the information digest changes, the data information is reacquired.
5. The method according to claim 1, wherein The step of determining the data information corresponding to the identifier of the data to be processed by querying a public database includes: Determining corresponding public key information based on the identifier of the data to be processed; In the case that the public key information is legal, a public database is queried according to the identifier of the data to be processed to obtain data information corresponding to the identifier of the data to be processed.
6. The method according to claim 1, characterized in that The processing of the data information to obtain corresponding incremental data information includes: The data information is processed at the current node to obtain modified incremental data information; and while keeping the data identifier corresponding to the data information unchanged, the serial number corresponding to the data information is increased by 1 and stored as the serial number corresponding to the incremental data information.
7. A data processing device, characterized in that: The data processing device includes: an acquisition unit configured to acquire an identifier of data to be processed; a determining unit configured to query data information corresponding to the data identifier to be processed based on the data category corresponding to the data identifier to be processed; a processing unit configured to process the data information to obtain corresponding incremental data information; A storage unit is configured to store the incremental data information to a current node according to a data category corresponding to the incremental data information, or to sign and encrypt the incremental data information using private key information at the current node, and synchronize the corresponding public key information to other target nodes other than the current node, so that the other target nodes can verify the incremental information through the public key information; synchronize the incremental data information from the current node to a public database; the private key information and the public key information have a corresponding relationship.
8. An electronic device, characterized in that: The electronic device includes a memory and a processor; wherein, The memory is used to store a computer program that can be run on the processor; The processor is configured to execute the data processing method according to any one of claims 1 to 6 when running the computer program.
9. A computer storage medium, characterized in that The computer storage medium stores a computer program, and when the computer program is executed by at least one processor, the data processing method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Data synchronization method and device, storage medium and electronic device
CN110674152A
Data query method and device, computer equipment and storage medium
CN115878663A