Data reporting method and apparatus, electronic device, and storage medium

By filtering and calculating to identify data changes, only newly added and changed data are reported, which solves the problems of high resource consumption and long time in existing technologies and achieves efficient data reporting.

CN115238204BActive Publication Date: 2025-12-16PING AN TRUST CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210868136.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-22
Publication Date
2025-12-16
Estimated Expiration
2042-07-22

AI Technical Summary

Technical Problem

Existing data reporting methods cannot identify changing data, resulting in high resource consumption, long processing times, and low data reporting efficiency.

Method used

By acquiring the data to be reported and historical datasets, filtering target historical data using reporting time tags, performing set operations to identify newly added and changed fields, reporting only newly added and changed data, filtering reporting nodes using hash values, and encapsulating the data for reporting.

Benefits of technology

It reduced the amount of data reported, improved data reporting efficiency, reduced resource consumption, and avoided the impact of changes in reporting nodes on data reporting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115238204B_ABST
    Figure CN115238204B_ABST
Patent Text Reader

Abstract

The present application relates to data processing technology, disclose a kind of data reporting method, comprising: obtaining data to be reported and historical data set, wherein each historical data in the historical data set has corresponding reporting time label;According to the reporting time label, the historical data in the historical data set is filtered, and target historical data is obtained;The data to be reported and target historical data are compared, and according to the comparison result, the newly added and changed data in the data to be reported is reported by screening.The present application also relates to a kind of block chain technology, and the data to be reported can be stored in block chain node.The present application also proposes a kind of data reporting device, equipment and medium.The present application can improve the efficiency of data reporting.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, in particular to a data reporting method and device, electronic equipment and storage medium. BACKGROUND

[0002] With the gradual improvement of the supervision of the financial industry, various supervision data (such as credit data) need to be reported regularly.

[0003] However, the existing data reporting method cannot identify the changed data, and can only report all data, which consumes a lot of resources and takes a long time, resulting in low efficiency of data reporting. SUMMARY

[0004] The present application provides a data reporting method, device, electronic equipment and storage medium, which mainly aims to improve the efficiency of data reporting.

[0005] Obtain the data to be reported and the historical data set, wherein each historical data in the historical data set has a corresponding reporting time label;

[0006] According to the reporting time label, the historical data in the historical data set is filtered to obtain the target historical data;

[0007] Perform a first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a new field set;

[0008] Extract the data corresponding to each field in the new field set in the data to be reported to obtain new data;

[0009] Perform a second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set;

[0010] Compare the data of each field in the repeated field set in the data to be reported with the data in the target historical data, and filter the repeated field set according to the comparison result to obtain a changed field set;

[0011] Extract the data corresponding to each field in the changed field set in the data to be reported to obtain changed data;

[0012] Obtain a reporting address, and report the new data and the changed data using the reporting address.

[0013] Optionally, the filtering of the historical data in the historical data set according to the reporting time label to obtain the target historical data comprises:

[0014] Screening the corresponding time label of the report time label in the historical data set closest to the target time label, obtaining the target time label;

[0015] Selecting the historical data in the historical data set to which the target time label belongs, obtaining the target historical data.

[0016] Optionally, the first set operation of all fields in the to-be-reported data and all fields in the target historical data is performed to obtain a new field set, comprising:

[0017] Extracting all fields in the to-be-reported data to obtain a to-be-reported field set;

[0018] Extracting all fields in the target historical data to obtain a historical field set;

[0019] Calculating the intersection of the to-be-reported field set and the historical field set, and calculating the complement of the intersection in the to-be-reported field set, to obtain the new field set.

[0020] Optionally, the reporting of the new data and the change data by using the reporting address comprises:

[0021] Obtaining a reporting node set, wherein the reporting node set comprises addresses of different reporting nodes;

[0022] Hash calculation is performed on each reporting node to obtain a corresponding node hash value; all node hash values are summarized to obtain a node hash value set;

[0023] Hash calculation is performed on the reporting address to obtain a reporting hash value;

[0024] According to the reporting hash value and the node hash value set, all the reporting nodes are matched and screened to obtain a target reporting node;

[0025] The new data and the change data are sent to the reporting address by using the target reporting node.

[0026] Optionally, according to the reporting hash value and the node hash value set, all the reporting nodes are matched and screened to obtain a target reporting node, comprising:

[0027] A hash value ring is constructed by using a preset numerical interval;

[0028] The reporting hash value and each node hash value in the node hash value set are mapped to corresponding points on the hash value ring;

[0029] The adjacent points of the point corresponding to the reporting hash value on the hash value ring in a preset direction are screened, and the node hash value corresponding to the adjacent point is determined as a target node hash value.

[0030] Selecting a reporting node corresponding to the target node hash value in all the reporting nodes as a target reporting node.

[0031] Optionally, the sending of the new data and the change data to the reporting address by the target reporting node comprises:

[0032] Encapsulating the new data and the change data into a reporting file in a preset format;

[0033] Sending the reporting file to the reporting address by the target reporting node.

[0034] Optionally, after the reporting of the new data and the change data by the reporting address, the method further comprises:

[0035] Replacing data corresponding to each field in the change data with data corresponding to the same field in the target historical data to obtain first updated historical data;

[0036] Summarizing the new data and the first updated historical data to obtain second updated historical data;

[0037] Performing a reporting time mark on the second updated historical data by the data to be reported, and adding the marked second updated historical data to the historical data set.

[0038] To solve the above problems, the application further provides a data reporting device, which comprises:

[0039] A new data screening module is configured to acquire data to be reported and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label; the historical data in the historical data set is screened according to the reporting time label to obtain target historical data; all fields in the data to be reported and all fields in the target historical data are subjected to first set operation to obtain a new field set; data corresponding to each field in the new field set in the data to be reported is extracted to obtain new data;

[0040] A change data screening module is configured to perform second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a repeated field set; whether data of each field in the repeated field set in the data to be reported is consistent with data of each field in the target historical data is compared, and the repeated field set is screened according to the comparison result to obtain a change field set; data corresponding to each field in the change field set in the data to be reported is extracted to obtain change data;

[0041] The data reporting module is configured to acquire a reporting address and report the new data and the changed data by using the reporting address.

[0042] To solve the above problems, the present application further provides an electronic device, which comprises:

[0043] a memory configured to store at least one computer program; and

[0044] a processor configured to execute the computer program stored in the memory to implement the data reporting method.

[0045] To solve the above problems, the present application further provides a computer readable storage medium, which stores at least one computer program, and the at least one computer program is executed by a processor in an electronic device to implement the data reporting method.

[0046] The embodiment of the present application extracts the data corresponding to each field in the new field in the data to be reported to obtain new data, extracts the data corresponding to each field in the changed field set in the data to be reported to obtain changed data, reports the new data and the changed data by using the reporting address, identifies the new data and the changed data by comparing with historical reporting data, and reports the new data and the changed data, so that all data does not need to be reported, the amount of data to be reported is reduced, and the efficiency of data reporting is improved. BRIEF DESCRIPTION OF DRAWINGS

[0047] Figure 1 A flowchart of a data reporting method provided by an embodiment of the present application is shown in the figure.

[0048] Figure 2 A module diagram of a data reporting device provided by an embodiment of the present application is shown in the figure.

[0049] Figure 3 An internal structure diagram of an electronic device for implementing a data reporting method provided by an embodiment of the present application is shown in the figure.

[0050] The implementation, functional features and advantages of the present application will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0051] It should be understood that the specific embodiments described herein are merely intended to explain the present application, and are not intended to limit the present application.

[0052] The embodiment of the present application provides a data reporting method. The execution subject of the data reporting method includes but is not limited to at least one of the electronic devices such as a server and a terminal which can be configured to execute the method provided by the present application. In other words, the data reporting method can be executed by the software or hardware installed in the terminal device or the server device, and the software can be a blockchain platform. The server includes but is not limited to a single server, a server cluster, a cloud server or a cloud server cluster, and the server can be a stand-alone server or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (CDN), and basic cloud computing services such as big data and artificial intelligence platforms.

[0053] Referring to Figure 1 The embodiment of the present application provides a data reporting method. The execution subject of the data reporting method includes but is not limited to at least one of the electronic devices such as a server and a terminal which can be configured to execute the method provided by the present application. In other words, the data reporting method can be executed by the software or hardware installed in the terminal device or the server device, and the software can be a blockchain platform. The server includes but is not limited to a single server, a server cluster, a cloud server or a cloud server cluster, and the server can be a stand-alone server or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks (CDN), and basic cloud computing services such as big data and artificial intelligence platforms.

[0054] S1, obtaining to-be-reported data and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label.

[0055] In detail, in the embodiment of the present application, the to-be-reported data is credit investigation data that needs to be reported, the historical data is full-amount historical data backed up after each reporting, and the reporting time label is the acquisition time of the reporting data corresponding to each reporting.

[0056] In another embodiment of the present application, the to-be-reported data can be stored in a blockchain node, and the high-throughput characteristics of the blockchain node are used to improve the efficiency of data access.

[0057] S2, screening historical data in the historical data set according to the reporting time label to obtain target historical data.

[0058] In the embodiment of the present application, in order to better detect the changes of the to-be-reported data compared with the historical data, the to-be-reported data needs to be compared with the historical data backed up after the last reporting, therefore, the historical data in the historical data set is screened according to the reporting time label.

[0059] In detail, in the embodiment of the present application, the historical data corresponding to the time label closest to the target time label in the historical data set is screened to obtain the target time label; further, the historical data to which the target time label belongs in the historical data set is selected to obtain the target historical data.

[0060] For example, the historical data set has two submission time labels "2021-12-25" and "2021-12-29", the time corresponding to the submission time label "2021-12-29" is closest to the current time, and therefore the target time label is "2021-12-29".

[0061] S3, performing first set operation on all fields in the to-be-reported data and all fields in the target historical data to obtain a newly added field set.

[0062] In detail, the embodiment of the present application performs first set operation on all fields in the to-be-reported data and all fields in the target historical data to obtain a newly added field set, comprising:

[0063] extracting all fields in the to-be-reported data to obtain a to-be-reported field set;

[0064] Optionally, in the embodiment of the present application, the data in the to-be-reported data is composed of the same fields and corresponding field values, in order to filter the newly added data in the to-be-reported data, it is necessary to filter and compare the difference between the fields in the to-be-reported data and the fields in the target historical data, therefore, all fields in the to-be-reported data are extracted to obtain a to-be-reported field set.

[0065] extracting all fields in the target historical data to obtain a historical field set;

[0066] Optionally, in the embodiment of the present application, the data in the target historical data is composed of the same fields and corresponding field values, in order to filter and compare the difference between the fields in the to-be-reported data and the fields in the target historical data, therefore, all fields in the target historical data are extracted to facilitate difference comparison of the fields.

[0067] calculating the intersection of the to-be-reported field set and the historical field set, and calculating the complement of the intersection in the to-be-reported field set to obtain the newly added field set.

[0068] Optionally, in the embodiment of the present application, the intersection of the to-be-reported field set and the historical field set is the common field of the to-be-reported field set and the historical field set, further, in order to calculate the newly added field in the target historical data, the complement of the intersection in the to-be-reported field set is calculated, that is, other fields of the to-be-reported field set except the common field are calculated, to obtain the newly added field set.

[0069] The embodiment of the present application performs first set operation on all fields in the to-be-reported data and all fields in the target historical data, thereby obtaining the field newly added in the to-be-reported data compared with the target historical data.

[0070] S4, extracting data corresponding to each field in the added field in the to-be-reported data, to obtain added data.

[0071] In detail, in the embodiment of the present application, data corresponding to each field in the added field in the to-be-reported data is extracted, so that added data in the to-be-reported data compared with the target historical data is obtained.

[0072] S5, performing a second set operation on all fields in the to-be-reported data and all fields in the target historical data, to obtain a repeated field set.

[0073] In detail, in the embodiment of the present application, a second set operation is performed on all fields in the to-be-reported data and all fields in the target historical data, to obtain a repeated field set, including:

[0074] Calculating the intersection of the to-be-reported field set and the historical field set, to obtain the repeated field set.

[0075] In the embodiment of the present application, the intersection of the to-be-reported field set and the historical field set is calculated, so that common fields in the to-be-reported field set and the historical field set are obtained, and the repeated field set is obtained. Further, it is checked whether the field values corresponding to the common fields in the to-be-reported data and the target historical data change, so as to facilitate screening of the common fields whose field values change.

[0076] S6, comparing data of each field in the repeated field set in the to-be-reported data with data of each field in the target historical data, and screening the repeated field set according to the comparison result, to obtain a changed field set.

[0077] In the embodiment of the present application, in order to check whether the data corresponding to the repeated fields in the to-be-reported data and the data corresponding to the fields in the target historical data change, it is compared whether the data of each field in the repeated field set in the to-be-reported data is consistent with the data of each field in the target historical data.

[0078] Specifically, in the embodiment of the present application, the repeated field set is screened according to the comparison result, to obtain a changed field set, including:

[0079] Selecting the fields in the repeated field set whose comparison result is inconsistent, to obtain the changed field set.

[0080] In the embodiment of the present application, the fields whose comparison result is inconsistent, that is, the fields whose field values in the to-be-reported data and the target historical data change, are the common fields that change. S7, extracting data corresponding to each field in the changed field set in the to-be-reported data, to obtain changed data.

[0081] In detail, the embodiment extracts the data corresponding to each field in the new field in the to-be-reported data, thereby obtaining change data of the field that has been uploaded in the target historical data but the data corresponding to the field in the to-be-reported data has changed.

[0082] S8, obtaining a reporting address, and reporting the new data and the change data to the reporting address.

[0083] In the embodiment, a reporting node set is obtained, the reporting node set containing addresses of different reporting nodes, the reporting nodes being message sending server nodes.

[0084] Hash calculation is performed on each reporting node to obtain a corresponding node hash value; all the node hash values are summarized to obtain a node hash value set, and hash calculation is performed on the reporting address to obtain a reporting hash value.

[0085] Further, the embodiment matches and filters all the reporting nodes according to the reporting hash value and the node hash value set to obtain a target reporting node, including: constructing a hash value ring by using a preset numerical interval, mapping the reporting hash value and each node hash value in the node hash value set to a corresponding point on the hash value ring, selecting adjacent points of the point corresponding to the reporting hash value on the hash value ring in a preset direction, and determining the node hash value corresponding to the adjacent point as a target node hash value; and selecting a reporting node corresponding to the target node hash value in all the reporting nodes as the target reporting node. Optionally, the preset direction is a clockwise direction.

[0086] Optionally, the numerical interval for constructing the hash value ring in the embodiment can be [0, 2^32]. The embodiment connects the left and right endpoints of the numerical interval into a circular ring to obtain the hash value ring. In order to ensure that the reporting hash value and each node hash value in the node hash value set can be mapped on the hash value ring, the embodiment sets the value corresponding to the right endpoint of the numerical interval to be greater than the maximum value of the reporting hash value and the node hash value set, and the value corresponding to the left endpoint of the numerical interval to be less than the minimum value of the reporting hash value and the node hash value set.

[0087] Further, the embodiment encapsulates the new data and the change data into a reporting file in a preset format, and sends the reporting file to the reporting address by using the target reporting node. Through the filtering of the reporting node, the most suitable reporting node is selected for reporting in real time, the influence of the change of the reporting node on data reporting is avoided, and the efficiency of data reporting is improved.

[0088] In another embodiment of the present application, after the reporting address is used to report the new data and the change data, the method further comprises:

[0089] The data corresponding to each field in the change data is replaced with the data corresponding to the same field in the target historical data to obtain first updated historical data;

[0090] The new data and the first updated historical data are summarized to obtain second updated historical data;

[0091] The second updated historical data is marked with the reporting time using the data to be reported, and the marked second updated historical data is added to the historical data set.

[0092] In another embodiment of the present application, after the reporting address is used to report the new data and the change data, the method further comprises:

[0093] Obtaining a reporting processing result;

[0094] When the reporting processing result is a reporting failure, obtaining a reporting failure reason;

[0095] Sending the reporting failure reason to a preset terminal device of an exception handling personnel.

[0096] Optionally, the terminal device in the embodiment of the present application includes a mobile phone, a computer, a tablet computer, and the like.

[0097] The embodiment of the present application reduces the resource consumption of data reporting by monitoring and screening the data to be reported, and only reporting the new data and the changed data, and improves the efficiency of data reporting by using a dynamic reporting node to report and avoiding the influence of the change of the reporting node on data reporting.

[0098] As shown in Figure 2 FIG. 1 is a functional module diagram of a data reporting device according to the present application.

[0099] The data reporting device 100 according to the present application can be installed in an electronic device. According to the implemented functions, the data reporting device can include a new data screening module 101, a change data screening module 102, and a data reporting module 103. The modules according to the present application can also be referred to as units, which refer to a series of computer program segments that can be executed by an electronic device processor and can complete a fixed function, and are stored in the memory of the electronic device.

[0100] In the present embodiment, the functions of each module / unit are as follows:

[0101] The new data screening module 101 is configured to obtain to-be-reported data and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label; historical data in the historical data set is screened according to the reporting time label to obtain target historical data; all fields in the to-be-reported data and all fields in the target historical data are subjected to a first set operation to obtain a new field set; data corresponding to each field in the new field in the to-be-reported data is extracted to obtain new data.

[0102] The changed data screening module 102 is configured to perform a second set operation on all fields in the to-be-reported data and all fields in the target historical data to obtain a repeated field set; whether the data of each field in the repeated field set in the to-be-reported data and the data in the target historical data are consistent is compared, and the repeated field set is screened according to the comparison result to obtain a changed field set; data corresponding to each field in the changed field set in the to-be-reported data is extracted to obtain changed data.

[0103] The data reporting module 103 is configured to obtain a reporting address, and report the new data and the changed data by using the reporting address.

[0104] In detail, each module in the data reporting device 100 in the embodiment of the present application adopts the same technical means as the data reporting method described above in the Figure 1 and can produce the same technical effects, which will not be described here.

[0105] As shown in Figure 3 , it is a structural schematic diagram of an electronic device for implementing the data reporting method of the present application.

[0106] The electronic device can include a processor 10, a memory 11, a communication bus 12 and a communication interface 13, and can further include a computer program stored in the memory 11 and executable on the processor 10, such as a data reporting program.

[0107] The memory 11 includes at least one type of readable storage medium, such as a flash memory, a mobile hard disk, a multimedia card, a card-type memory (e.g., an SD or DX memory, etc.), a magnetic memory, a disk, an optical disk, etc. In some embodiments, the memory 11 can be an internal storage unit of an electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory 11 can also be an external storage device of the electronic device, such as a plug-in mobile hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. Further, the memory 11 can include both an internal storage unit and an external storage device of the electronic device. The memory 11 can be used to store application software and various data installed in the electronic device, such as a code of a data reporting program, etc., and to temporarily store data that has been output or will be output.

[0108] The processor 10 can be composed of an integrated circuit in some embodiments, such as a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including a combination of one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and various control chips, etc. The processor 10 is a control unit of the electronic device, which connects various components of the entire electronic device through various interfaces and lines, and executes various functions and processes data of the electronic device by running or executing programs or modules (such as a data reporting program, etc.) stored in the memory 11 and calling data stored in the memory 11.

[0109] The communication bus 12 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. The communication bus 12 is configured to realize the connection and communication between the memory 11 and at least one processor 10, etc. For ease of representation, only one thick line is shown in the figure, but it does not mean that there is only one bus or only one type of bus.

[0110] Figure 3 Only an electronic device with components is shown, and those skilled in the art can understand that, Figure 3The illustrated structure does not constitute a limitation on the electronic device, which can include fewer or more components than those shown, or combine certain components, or arrange different components.

[0111] For example, although not shown, the electronic device can also include a power supply (such as a battery) to power the various components. Preferably, the power supply can be logically connected to the at least one processor 10 through a power management device, so that the power management device can implement functions such as charge management, discharge management, and power consumption management. The power supply can also include one or more DC or AC power sources, recharging devices, power failure classification circuits, power converters or inverters, power status indicators, and any other components. The electronic device can also include various sensors, Bluetooth modules, Wi-Fi modules, and the like, which are not described here.

[0112] Optionally, the communication interface 13 can include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device and other electronic devices.

[0113] Optionally, the communication interface 13 can also include a user interface, which can be a display (Display), an input unit (such as a keyboard (Keyboard)), and optionally a standard wired interface, a wireless interface. Optionally, in some embodiments, the display can be an LED display, a liquid crystal display, a touch liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, etc. The display can also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device and to display a visualized user interface.

[0114] It should be understood that the embodiments are only for illustration and are not limited in the scope of the patent application by this structure.

[0115] The data reporting program stored in the memory 11 of the electronic device is a combination of multiple computer programs, which, when running in the processor 10, can implement:

[0116] Obtain the to-be-reported data and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label;

[0117] According to the reporting time label, the historical data in the historical data set is filtered to obtain target historical data;

[0118] Perform a first set operation on all fields in the to-be-reported data and all fields in the target historical data to obtain a new field set;

[0119] extracting data corresponding to each field in the to-be-reported data in the added field, to obtain added data;

[0120] performing a second set operation on all fields in the to-be-reported data and all fields in the target historical data, to obtain a repeated field set;

[0121] comparing data of each field in the to-be-reported data with data of each field in the target historical data in the repeated field set, and performing screening on the repeated field set according to a comparison result, to obtain a changed field set;

[0122] extracting data corresponding to each field in the to-be-reported data in the changed field set, to obtain changed data;

[0123] obtaining a reporting address, and reporting the added data and the changed data by using the reporting address.

[0124] Specifically, the processor 10 can refer to the description of the specific implementation method of the above computer program in the corresponding embodiments, which will not be described here. Figure 1 The specific implementation method of the processor 10 can refer to the description of the specific implementation method of the above computer program in the corresponding embodiments, which will not be described here.

[0125] Further, the modules / units of the electronic device, if realized in the form of software function units and sold or used as independent products, can be stored in a computer readable storage medium. The computer readable medium can be non-volatile or volatile. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory).

[0126] The embodiment of the application can also provide a computer readable storage medium, which stores a computer program, and the computer program can realize the following steps when executed by a processor of an electronic device:

[0127] obtaining to-be-reported data and a historical data set, wherein each historical data in the historical data set has a corresponding reporting time label;

[0128] screening historical data in the historical data set according to the reporting time label, to obtain target historical data;

[0129] performing a first set operation on all fields in the to-be-reported data and all fields in the target historical data, to obtain an added field set;

[0130] extracting data corresponding to each field in the to-be-reported data in the added field, to obtain added data;

[0131] performing a second set operation on all fields in the to-be-reported data and all fields in the target historical data to obtain a repeated field set;

[0132] comparing data of each field in the repeated field set in the to-be-reported data with data of each field in the target historical data, and performing screening on the repeated field set according to a comparison result to obtain a changed field set;

[0133] extracting corresponding data of each field in the changed field set in the to-be-reported data to obtain changed data;

[0134] obtaining a reporting address, and reporting the added data and the changed data by using the reporting address.

[0135] Further, the computer usable storage medium can mainly include a storage program area and a storage data area, wherein the storage program area can store an operating system, at least one application required by a function, and the like; and the storage data area can store data created according to use of a blockchain node and the like.

[0136] In several embodiments provided in the present application, it should be understood that the disclosed devices, apparatuses and methods can be implemented by other manners. For example, the apparatus embodiments described above are merely illustrative, for example, the division of the modules is merely a logical function division, and another division manner can be used in actual implementation.

[0137] The modules described as separated components can or can not be physically separated, and the components displayed as modules can or can not be physical units, that is, can be located in one place, or can be distributed on multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiments.

[0138] The embodiments of the present application can acquire and process related data based on artificial intelligence technology. Wherein, artificial intelligence (Artificial Intelligence, AI) is to use digital computers or digital computer controlled machines to simulate, extend and expand human intelligence, perceive environment, acquire knowledge and use knowledge to obtain the best results.

[0139] In addition, each function module in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware, or in the form of hardware plus software function module.

[0140] It will be obvious to a person skilled in the art that the application is not limited to the details of the above-described exemplary embodiments but can be implemented in other embodiments without departing from the scope of the application.

[0141] The embodiments should therefore be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the description given above, so that all changes coming within the meaning and equivalency range of the claims are intended to be embraced therein. Any reference signs in the claims should not be construed as limiting the scope of the claims.

[0142] The blockchain referred to in the present application is a new application mode of distributed data storage, peer-to-peer transmission, consensus mechanism, encryption algorithm and other computer technologies. The blockchain is essentially a decentralized database, which is a series of data blocks associated using cryptographic methods. Each data block contains information about a batch of network transactions, which is used to verify the validity (anti-fake) of the information and generate the next block. The blockchain can include a blockchain underlying platform, a platform product service layer, and an application service layer, etc.

[0143] Furthermore, it is clear that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or devices can be implemented by one unit or device through software or hardware. The terms "first", "second", "third", "fourth", "fifth" and "sixth" are used to distinguish between similar objects, not to imply or create any special order or priority.

[0144] Finally, it should be noted that the above embodiments are merely used to illustrate the technical solutions of the present application, rather than limit the present application. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or replaced by equivalents without departing from the spirit and scope of the present application.

Claims

1. A data reporting method, characterized in that, The method includes: Obtain the data to be reported and the historical dataset, wherein each historical data in the historical dataset has a corresponding reporting time tag; Filter the historical dataset to obtain the target time tag that corresponds to the most recent reporting time tag; Select the historical data belonging to the target time label from the historical dataset to obtain the target historical data; Perform a first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a new set of fields; Extract the corresponding data for each field within the newly added field from the data to be submitted to obtain the new data; Perform a second set operation between all fields in the data to be reported and all fields in the target historical data to obtain a set of duplicate fields. Compare the data of each field in the duplicate field set in the data to be reported with the data in the target historical data, and filter the duplicate field set according to the comparison results to obtain the changed field set; Extract the data corresponding to each field in the set of changed fields from the data to be reported to obtain the changed data; Obtain the reporting address, and use the reporting address to report the new data and the changed data.

2. The data reporting method as described in claim 1, characterized in that, The step of performing a first set operation on all fields in the data to be reported and all fields in the target historical data to obtain a new set of fields includes: Extract all fields from the data to be reported to obtain the set of fields to be reported; Extract all fields from the target historical data to obtain a historical field set; Calculate the intersection of the set of fields to be reported and the set of historical fields, and calculate the complement of the intersection in the set of fields to be reported to obtain the new set of fields.

3. The data reporting method as described in claim 1, characterized in that, The step of reporting the new data and the changed data using the reporting address includes: Obtain the reporting node set, which contains the addresses of different reporting nodes; Perform a hash calculation on each of the reporting nodes to obtain the corresponding node hash value; summarize all the node hash values ​​to obtain a node hash value set; The reporting address is hashed to obtain the reporting hash value; The target reporting node is obtained by matching and filtering all the reporting nodes based on the reporting hash value and the node hash value set. The newly added data and the changed data are sent to the reporting address using the target reporting node.

4. The data reporting method as described in claim 3, characterized in that, The step of matching and filtering all the reporting nodes based on the reporting hash value and the node hash value set to obtain the target reporting node includes: Construct a hash value ring using a preset numerical range; The reported hash value is mapped to each node hash value in the node hash value set as a corresponding point on the hash value ring; Filter the adjacent points in a preset direction of the point corresponding to the reported hash value on the hash value ring, and determine the node hash value corresponding to the adjacent point as the target node hash value; Select the reporting node corresponding to the target node hash value among all the reporting nodes as the target reporting node.

5. The data reporting method as described in claim 3, characterized in that, The step of using the target reporting node to send the new data and the changed data to the reporting address includes: The newly added data and the changed data are packaged into a report file with a preset format; The target reporting node is used to send the reporting file to the reporting address.

6. The data reporting method according to any one of claims 1 to 5, characterized in that, After reporting the new data and the changed data using the reporting address, the method further includes: Replace the data corresponding to the same field in the target historical data with the data corresponding to each field in the changed data to obtain the first updated historical data; The newly added data is combined with the first update history data to obtain the second update history data; The second update history data is time-stamped using the data to be reported, and the stamped second update history data is added to the historical dataset.

7. A data reporting apparatus for implementing the data reporting method as described in any one of claims 1 to 6, characterized in that, The data reporting device includes: A new data filtering module is added to obtain the data to be reported and historical datasets. Each historical data in the historical dataset has a corresponding reporting time tag. The historical data in the historical dataset is filtered according to the reporting time tag to obtain target historical data. A first set operation is performed on all fields in the data to be reported and all fields in the target historical data to obtain a new field set. The data corresponding to each field in the new field set is extracted from the data to be reported to obtain the new data. The changed data filtering module is used to perform a second set operation on all fields in the data to be reported and all fields in the target historical data to obtain a duplicate field set; compare whether the data of each field in the duplicate field set in the data to be reported is consistent with the data in the target historical data, and filter the duplicate field set according to the comparison results to obtain a changed field set; extract the data corresponding to each field in the changed field set in the data to be reported to obtain the changed data; The data reporting module is used to obtain a reporting address and use the reporting address to report the new data and the changed data.

8. An electronic device, characterized in that, The electronic device includes: At least one processor; and, A memory that is communicatively connected to the at least one processor; The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the data reporting method as described in any one of claims 1 to 6.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the data reporting method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Data quality inspection method and system based on distributed big data computing platform

    CN114004465A