Data processing method and apparatus

Abstract

This invention provides a data processing method and apparatus. The method includes: receiving data to be processed; determining a target database for the data to be processed; determining whether the data to be processed meets the entry conditions of the target database; if the data to be processed meets the entry conditions, determining whether historical data currently exists in the target database; if historical data exists in the target database, determining whether the priority of the data to be processed is higher than the priority of the historical data; the attribute type of the historical data is consistent with the attribute type of the data to be processed; if the priority of the data to be processed is higher than the priority of the historical data, storing the data to be processed in the target database. Applying the method provided by this invention can prevent repeated data overwriting and avoid the loss of important data.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a data processing method and apparatus. Background Technology

[0002] With the development of computer science and technology, databases have been widely used. In some scenarios, the data sources for storing data in databases are often diverse, meaning that multiple data centers are maintained by different systems. For example, software A in the first data center stores data in a database, and software B in the second data center stores data in a database. Due to management requirements, the same equipment may belong to both software A and software B. Therefore, the data stored in the database will be repeatedly overwritten by data from software A and software B, leading to the loss of important data. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a data processing method that can prevent data from being repeatedly overwritten and avoid the loss of important data.

[0004] The present invention also provides a data processing apparatus to ensure the implementation and application of the above method in practice.

[0005] A data processing method, comprising:

[0006] Receive data to be processed;

[0007] Determine the target database for the data to be processed;

[0008] Determine whether the data to be processed meets the entry conditions of the target database;

[0009] If the data to be processed meets the entry conditions, determine whether historical data currently exists in the target database;

[0010] If historical data exists in the target database, it is determined whether the priority of the data to be processed is higher than the priority of the historical data; the attribute type of the historical data is consistent with the attribute type of the data to be processed.

[0011] If the priority of the data to be processed is higher than the priority of the historical data, then the data to be processed is stored in the target database.

[0012] Optionally, in the above method, determining whether the data to be processed meets the entry conditions of the target database includes:

[0013] Determine the target attribute type associated with the attribute type of the data to be processed;

[0014] Obtain the associated attribute data of the target attribute type of the data to be processed;

[0015] Determine whether the associated attribute data meets the configuration rules corresponding to the target attribute type;

[0016] If the associated attribute data satisfies the configuration rules corresponding to the target attribute type, it is determined that the data to be processed meets the entry conditions of the target database.

[0017] If the associated attribute data does not meet the configuration rules corresponding to the target attribute type, it is determined that the data to be processed does not meet the entry conditions of the target database.

[0018] Optionally, in the above method, determining whether the priority of the data to be processed is higher than the priority of the historical data includes:

[0019] The priority of the data to be processed is determined based on the associated attribute data of the target attribute type of the data to be processed, and the priority of the historical data is determined based on the associated attribute data of the target attribute type of the historical data.

[0020] Determine whether the priority of the data to be processed is higher than the priority of the historical data.

[0021] The above methods may also include:

[0022] If no historical data exists in the target database, the data to be processed is stored in the target database.

[0023] Optionally, in the above method, storing the data to be processed in the target database includes:

[0024] The data to be processed is overwritten and stored over the historical data in the target database.

[0025] A data processing apparatus, comprising:

[0026] The receiving unit is used to receive data to be processed.

[0027] The first determining unit is used to determine the target database of the data to be processed;

[0028] The judgment unit is used to determine whether the data to be processed meets the entry conditions of the target database;

[0029] The second determining unit is used to determine whether historical data currently exists in the target database when the data to be processed meets the entry conditions;

[0030] The third determining unit is used to determine whether the priority of the data to be processed is higher than the priority of the historical data if historical data exists in the target database; the attribute type of the historical data is consistent with the attribute type of the data to be processed.

[0031] The first storage unit is used to store the data to be processed in the target database if the priority of the data to be processed is higher than the priority of the historical data.

[0032] Optionally, in the aforementioned apparatus, the determining unit includes:

[0033] The first determining subunit is used to determine the target attribute type associated with the attribute type of the data to be processed;

[0034] The acquisition subunit is used to acquire the associated attribute data of the target attribute type of the data to be processed.

[0035] The judgment subunit is used to determine whether the associated attribute data meets the configuration rules corresponding to the target attribute type;

[0036] The first determination subunit is used to determine whether the data to be processed meets the entry conditions of the target database when the associated attribute data meets the configuration rules corresponding to the target attribute type.

[0037] The second determination subunit is used to determine that the data to be processed does not meet the entry conditions of the target database when the associated attribute data does not meet the configuration rules corresponding to the target attribute type.

[0038] Optionally, the third determining unit in the aforementioned apparatus includes:

[0039] The second determining subunit is used to determine the priority of the data to be processed based on the associated attribute data of the target attribute type of the data to be processed, and to determine the priority of the historical data based on the associated attribute data of the target attribute type of the historical data.

[0040] The third determining subunit is used to determine whether the priority of the data to be processed is higher than the priority of the historical data.

[0041] The aforementioned apparatus may optionally further include:

[0042] The second storage unit is used to store the data to be processed in the target database if no historical data exists in the target database.

[0043] Optionally, in the aforementioned apparatus, the first storage unit includes:

[0044] The storage subunit is used to overwrite the historical data in the target database with the data to be processed.

[0045] Compared with the prior art, the present invention has the following advantages:

[0046] This invention provides a data processing method and apparatus, which can first receive data to be processed; determine a target database for the data to be processed; determine whether the data to be processed meets the entry conditions of the target database; if the data to be processed meets the entry conditions, determine whether historical data currently exists in the target database; if historical data exists in the target database, determine whether the priority of the data to be processed is higher than the priority of the historical data; the attribute type of the historical data is consistent with the attribute type of the data to be processed; if the priority of the data to be processed is higher than the priority of the historical data, then the data to be processed is stored in the target database. In other words, by applying the solution provided by this invention, it is possible to determine whether the data to be processed meets the database entry conditions, and if the priority of the data to be processed is higher than the priority of the historical data, the data to be processed is stored in the database. By comparing the priorities of the data, it is possible to prevent low-priority data from overwriting high-priority data and avoid the loss of high-priority data. Attached Figure Description

[0047] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0048] Figure 1 A flowchart of a data processing method provided by the present invention;

[0049] Figure 2 A flowchart of a process for determining whether data to be processed meets the entry conditions of a target database, provided by the present invention;

[0050] Figure 3 A flowchart provided by the present invention describes a process for determining whether the priority of data to be processed is higher than the priority of historical data;

[0051] Figure 4 A schematic diagram of the structure of a data processing device provided by the present invention;

[0052] Figure 5 This is a schematic diagram of the structure of an electronic device provided by the present invention. Detailed Implementation

[0053] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0054] In this application, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0055] This invention provides a data processing method that can be applied to electronic devices. The flowchart of the method is shown below. Figure 1 As shown, it specifically includes:

[0056] S101: Receive data to be processed.

[0057] In this embodiment of the invention, a data storage request containing data to be processed can be received, and the data to be processed can be obtained from the data storage request. The data storage request can be sent by any subsystem in a preset set of subsystems, which may include non-financial systems, supply systems, change systems, etc.

[0058] The data to be processed can be various types of system status information, such as the number of CPU cores.

[0059] S102: Determine the target database for the data to be processed.

[0060] In this embodiment of the invention, the target database can be a configuration management database. The target database includes information on the entire lifecycle of configuration items and the relationships between configuration items. The target database can be a logical entity composed of at least one physical database.

[0061] The target database can be used to track all IT components in the system, different versions and states of the components, and the relationships between the components.

[0062] The relationships between configuration items can include at least one of the following: physical relationships, real-time communication relationships, non-real-time communication relationships, and dependency relationships.

[0063] Specifically, the target database for the data to be processed can be determined based on the data storage request to which the data to be processed belongs. The data storage request may contain the database identifier of the data to be processed, and the target database can be determined based on the database identifier.

[0064] S103: Determine whether the data to be processed meets the entry conditions of the target database; if yes, execute S104; if no, execute S107.

[0065] In this embodiment of the invention, the entry condition can be that the associated attribute data corresponding to the data to be processed meets the pre-set configuration rules.

[0066] S104: Determine whether historical data exists in the target database. If yes, proceed to S105; otherwise, proceed to S106.

[0067] S105: If historical data exists in the target database, determine whether the priority of the data to be processed is higher than the priority of the historical data; if the priority of the data to be processed is higher than the priority of the historical data, execute S106; otherwise, execute S107.

[0068] The attribute type of the historical data is consistent with the attribute type of the data to be processed. For example, the attribute type of the data to be processed can be the number of CPU cores, and the attribute type of the historical data can also be the number of CPU cores.

[0069] Specifically, the priority of the data to be processed and the priority of the historical data can be pre-configured.

[0070] S106: Store the data to be processed in the target database.

[0071] In cases where the priority of the data to be processed is higher than that of the historical data, one feasible way to store the data to be processed in the target database is to overwrite the historical data in the target database with the data to be processed.

[0072] If the target database does not contain historical data, the data to be processed can be directly stored in the target database.

[0073] S107: Refuse to store the data to be processed in the target database.

[0074] By applying the method provided by this invention, it is possible to determine whether the data to be processed meets the database's entry conditions, and to store the data to be processed in the database when the priority of the data to be processed is higher than that of the historical data. By comparing the priority of the data, it is possible to prevent low-priority data from overwriting high-priority data and avoid the loss of high-priority data.

[0075] In the method provided by this invention, based on the above implementation process, specifically, determining whether the data to be processed meets the entry conditions of the target database, such as... Figure 2 As shown, it specifically includes:

[0076] S201: Determine the target attribute type associated with the attribute type of the data to be processed.

[0077] The attribute type of the data to be processed can be various status information types of the system, such as the number of CPU cores. The target data type can be one or more of the following: the type of the responsible object, the type of the region, and the type of the device to which the data to be processed belongs.

[0078] S202: Obtain the associated attribute data of the target attribute type of the data to be processed.

[0079] In this embodiment of the invention, the associated attribute data of the target attribute type of the data to be processed is obtained. For example, if the target attribute type of the data to be processed is a responsibility object type, then the associated attribute data can be the responsibility object of the data to be processed, such as unit A.

[0080] S203: Determine whether the associated attribute data meets the configuration rules corresponding to the target attribute type. If it does, execute S204; otherwise, execute S205.

[0081] The configuration rule can be set according to actual needs. For example, the configuration rule can be one or more of the following: the associated attribute data is consistent with the preset standard data, the value type of the associated attribute data corresponding to the data to be processed is the preset standard value type, the value of the associated attribute data corresponding to the data to be processed meets the preset threshold, and the belonging object represented by the associated attribute corresponding to the data to be processed is the preset belonging object.

[0082] S204: Determine that the data to be processed meets the entry conditions of the target database.

[0083] S205: Determine that the data to be processed does not meet the entry conditions of the target database.

[0084] In the method provided by this invention, based on the above implementation process, specifically, determining whether the priority of the data to be processed is higher than the priority of the historical data, such as... Figure 3 As shown, it specifically includes:

[0085] S301: Determine the priority of the data to be processed based on the associated attribute data of the target attribute type of the data to be processed, and determine the priority of the historical data based on the associated attribute data of the target attribute type of the historical data.

[0086] In this embodiment of the invention, a priority configuration file is pre-set. The priority configuration file can record the priorities corresponding to different associated attribute data. By traversing the priority configuration file based on the associated attribute data of the data to be processed, the priority of the data to be processed can be determined. By traversing the priority configuration file based on the associated attribute type of the historical data, the priority of the historical data can be obtained.

[0087] S302: Determine whether the priority of the data to be processed is higher than the priority of the historical data.

[0088] In this embodiment of the invention, after obtaining the priority of historical data of the priority of the data to be processed, the priority of the data to be processed can be compared with the priority of historical data to determine whether the priority of the data to be processed is higher than the priority of historical data.

[0089] In the method provided by this invention, based on the above implementation process, specifically, storing the data to be processed in the target database includes:

[0090] The data to be processed is overwritten and stored over the historical data in the target database.

[0091] The data processing method provided in this invention can be applied to various fields. For example, it can be applied to a banking system in the financial field. The banking system can be a collection of systems consisting of multiple subsystems, such as non-financial systems, supply systems, change systems, etc. Each system can generate data to be processed.

[0092] Data belonging to different data sources can be pre-processed to establish relationships between various attributes of the data from different data sources. For example, "CPU core count" is one type of attribute, and "machine geographic location" is another type. The relationship between these two types of attribute data is established and stored. In addition to the relationships, corresponding rules must be established. These rules define the admission criteria for data entry, i.e., whether data is allowed to be stored. For example, if the associated attribute is an enumerated value, list the admission enumerated values; if the associated attribute is a number, store the admission threshold.

[0093] When data is overwritten, the first step is to check the relationships, specifically whether the associated attribute data is allowed for data entry. For example, when entering CPU core counts, if the associated attribute is "equipment ownership responsibility," then it's checked whether the equipment ownership responsibility meets the rules. For instance, if the equipment ownership responsibility is "Unit A in Region 1," then higher priority is applied. If the equipment ownership responsibility is "Unit B in Region 1," then lower priority is applied. Lower priority data will not overwrite higher priority data. Conversely, higher priority data will overwrite lower priority data. Through this device setting, data is prioritized while meeting business requirements, ensuring accurate data entry.

[0094] and Figure 1 Corresponding to the method described above, embodiments of the present invention also provide a data processing apparatus for processing data... Figure 1 The specific implementation of the method, the data processing device provided in this embodiment of the invention can be applied to electronic devices, and its structural schematic diagram is shown below. Figure 4 As shown, it specifically includes:

[0095] The receiving unit 401 is used to receive data to be processed;

[0096] The first determining unit 402 is used to determine the target database of the data to be processed;

[0097] The judgment unit 403 is used to determine whether the data to be processed meets the entry conditions of the target database;

[0098] The second determining unit 404 is used to determine whether historical data currently exists in the target database when the data to be processed meets the entry conditions;

[0099] The third determining unit 405 is used to determine whether the priority of the data to be processed is higher than the priority of the historical data if historical data exists in the target database; the attribute type of the historical data is consistent with the attribute type of the data to be processed.

[0100] The first storage unit 406 is used to store the data to be processed in the target database if the priority of the data to be processed is higher than the priority of the historical data.

[0101] The data processing apparatus provided in this invention receives data to be processed; determines a target database for the data to be processed; determines whether the data to be processed meets the entry conditions of the target database; if the data to be processed meets the entry conditions, determines whether historical data exists in the target database; if historical data exists in the target database, determines whether the priority of the data to be processed is higher than the priority of the historical data; the attribute type of the historical data is consistent with the attribute type of the data to be processed; if the priority of the data to be processed is higher than the priority of the historical data, then the data to be processed is stored in the target database. By applying the apparatus provided by this invention, it is possible to determine whether the data to be processed meets the database entry conditions, and if the priority of the data to be processed is higher than the priority of the historical data, the data to be processed is stored in the database. By comparing the priorities of the data, it is possible to prevent low-priority data from overwriting high-priority data and avoid the loss of high-priority data.

[0102] In one embodiment of the present invention, based on the above-described solution, optionally, the determining unit 403 includes:

[0103] The first determining subunit is used to determine the target attribute type associated with the attribute type of the data to be processed;

[0104] The acquisition subunit is used to acquire the associated attribute data of the target attribute type of the data to be processed.

[0105] The judgment subunit is used to determine whether the associated attribute data meets the configuration rules corresponding to the target attribute type;

[0106] The first determination subunit is used to determine whether the data to be processed meets the entry conditions of the target database when the associated attribute data meets the configuration rules corresponding to the target attribute type.

[0107] The second determination subunit is used to determine that the data to be processed does not meet the entry conditions of the target database when the associated attribute data does not meet the configuration rules corresponding to the target attribute type.

[0108] In one embodiment of the present invention, based on the above-described solution, optionally, the third determining unit 405 includes:

[0109] The second determining subunit is used to determine the priority of the data to be processed based on the associated attribute data of the target attribute type of the data to be processed, and to determine the priority of the historical data based on the associated attribute data of the target attribute type of the historical data.

[0110] The third determining subunit is used to determine whether the priority of the data to be processed is higher than the priority of the historical data.

[0111] In one embodiment of the present invention, based on the above-described solution, optionally, it further includes:

[0112] The second storage unit is used to store the data to be processed in the target database if no historical data exists in the target database.

[0113] In one embodiment of the present invention, based on the above-described solution, optionally, the first storage unit 406 includes:

[0114] The storage subunit is used to overwrite the historical data in the target database with the data to be processed.

[0115] The specific principles and execution processes of each unit and module in the data processing device disclosed in the above embodiments of the present invention are the same as those of the data processing method disclosed in the above embodiments of the present invention. Please refer to the corresponding parts of the data processing method provided in the above embodiments of the present invention, and they will not be repeated here.

[0116] This invention also provides a storage medium, which includes stored instructions, wherein the execution of the instructions controls the device where the storage medium is located to perform the above-described data processing method.

[0117] This invention also provides an electronic device, the structural schematic of which is shown below. Figure 5 As shown, it specifically includes a memory 501 and one or more instructions 502, wherein one or more instructions 502 are stored in the memory 501 and configured to be executed by one or more processors 503 to perform the following operations:

[0118] Receive data to be processed;

[0119] Determine the target database for the data to be processed;

[0120] Determine whether the data to be processed meets the entry conditions of the target database;

[0121] If the data to be processed meets the entry conditions, determine whether historical data currently exists in the target database;

[0122] If historical data exists in the target database, it is determined whether the priority of the data to be processed is higher than the priority of the historical data; the attribute type of the historical data is consistent with the attribute type of the data to be processed.

[0123] If the priority of the data to be processed is higher than the priority of the historical data, then the data to be processed is stored in the target database.

[0124] It should be noted that the various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For apparatus embodiments, since they are basically similar to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0125] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0126] For ease of description, the above apparatus is described by dividing it into various functional units. Of course, in implementing this invention, the functions of each unit can be implemented in one or more software and / or hardware components.

[0127] As can be seen from the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of the present invention.

[0128] The data processing method provided by the present invention has been described in detail above. Specific examples have been used to illustrate the principle and implementation of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core idea of ​​the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation and application scope based on the idea of ​​the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A data processing method, characterized in that, include: Receive data to be processed; Determine the target database for the data to be processed; Determine whether the data to be processed meets the entry conditions of the target database; If the data to be processed meets the entry conditions, determine whether historical data currently exists in the target database; If historical data exists in the target database, it is determined whether the priority of the data to be processed is higher than the priority of the historical data; the attribute type of the historical data is consistent with the attribute type of the data to be processed. If the priority of the data to be processed is higher than the priority of the historical data, then the data to be processed is stored in the target database; Wherein, determining whether the priority of the data to be processed is higher than the priority of the historical data includes: The priority of the data to be processed is determined based on the associated attribute data of the target attribute type of the data to be processed; the target attribute type is other attribute types associated with the attribute type of the data to be processed, including one or more of the responsibility object type, region type, and equipment type to which the data to be processed belongs; the attribute type of the data to be processed is the system status information type. The priority of the historical data is determined based on the associated attribute data of the target attribute type. Determine whether the priority of the data to be processed is higher than the priority of the historical data; The step of determining whether the data to be processed meets the entry conditions of the target database includes: Determine the target attribute type associated with the attribute type of the data to be processed; Obtain the associated attribute data of the target attribute type of the data to be processed; Determine whether the associated attribute data meets the configuration rules corresponding to the target attribute type; If the associated attribute data satisfies the configuration rules corresponding to the target attribute type, it is determined that the data to be processed meets the entry conditions of the target database. If the associated attribute data does not meet the configuration rules corresponding to the target attribute type, it is determined that the data to be processed does not meet the entry conditions of the target database.

2. The method according to claim 1, characterized in that, Also includes: If no historical data exists in the target database, the data to be processed is stored in the target database.

3. The method according to claim 1, characterized in that, The step of storing the data to be processed into the target database includes: The data to be processed is overwritten and stored over the historical data in the target database.

4. A data processing apparatus, characterized in that, include: The receiving unit is used to receive data to be processed. The first determining unit is used to determine the target database of the data to be processed; The judgment unit is used to determine whether the data to be processed meets the entry conditions of the target database; The second determining unit is used to determine whether historical data currently exists in the target database when the data to be processed meets the entry conditions; The third determining unit is used to determine whether the priority of the data to be processed is higher than the priority of the historical data if historical data exists in the target database; the attribute type of the historical data is consistent with the attribute type of the data to be processed. The first storage unit is used to store the data to be processed in the target database if the priority of the data to be processed is higher than the priority of the historical data. The third determining unit includes: The second determining subunit is used to determine the priority of the data to be processed based on the associated attribute data of the target attribute type of the data to be processed, and to determine the priority of the historical data based on the associated attribute data of the target attribute type of the historical data; the target attribute type is other attribute types associated with the attribute type of the data to be processed, including one or more of the responsibility object type, region type, and equipment type to which the data to be processed belongs; the attribute type of the data to be processed is the system status information type; The third determining subunit is used to determine whether the priority of the data to be processed is higher than the priority of the historical data; The judgment unit includes: The first determining subunit is used to determine the target attribute type associated with the attribute type of the data to be processed; The acquisition subunit is used to acquire the associated attribute data of the target attribute type of the data to be processed. The judgment subunit is used to determine whether the associated attribute data meets the configuration rules corresponding to the target attribute type; The first determination subunit is used to determine whether the data to be processed meets the entry conditions of the target database when the associated attribute data meets the configuration rules corresponding to the target attribute type. The second determination subunit is used to determine that the data to be processed does not meet the entry conditions of the target database when the associated attribute data does not meet the configuration rules corresponding to the target attribute type.

5. The apparatus according to claim 4, characterized in that, Also includes: The second storage unit is used to store the data to be processed in the target database if no historical data exists in the target database.

6. The apparatus according to claim 4, characterized in that, The first storage unit includes: The storage subunit is used to overwrite the historical data in the target database with the data to be processed.

Images