An integrated collation system based on multi-link data of the industrial chain
By building a resident database and a one-way database in the industrial chain, determining the data that each blockchain node should store is solved, and the problems of data redundancy and low performance in the existing technology are achieved, and efficient data sharing and performance improvement are achieved.
Patent Information
- Application Number
- CN202411455351.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-18
- Publication Date
- 2025-02-07
- Estimated Expiration
- 2044-10-18
AI Technical Summary
The existing methods share all data between various production links in the industrial chain, resulting in redundant data stored by blockchain nodes and low system performance.
The production logs of each production link are obtained through the log acquisition module. The resident database module and the one-way database module respectively build a resident database and a one-way database, which store historical data that is of guiding significance to the industry chain and data from the current production stage. The storage data determination module determines the data that each blockchain node should store based on these databases, so as to realize the synchronization of meaningful data and desynchronization of meaningless data.
The amount of data stored by each blockchain node is reduced, the performance of the integrated sorting system is improved, and the efficient sharing of local blockchain data is realized.
Smart Images

Figure CN118981505B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of data processing, and in particular to an integrated sorting system based on multi-link data of an industrial chain. Background Art
[0002] With the advancement of digital transformation, various industries are facing the challenge of massive data. How to effectively integrate data from various production links in the industrial chain such as procurement, production, logistics and sales has become an important task to improve operational efficiency.
[0003] In the existing method, blockchain technology is used to build a blockchain node in each production link, and all data of each production link is shared to the blockchain nodes of all production links through blockchain technology, thereby realizing data integration and collation of multiple links in the industrial chain.
[0004] However, each production link in the industrial chain only uses part of the data, and the existing method will share all the data to the blockchain nodes of each production link, resulting in redundant data stored in each blockchain node and low system performance. Summary of the invention
[0005] The embodiment of the present invention provides an integrated organization system based on multi-link data of the industrial chain, which can reduce the amount of data stored in each blockchain node and improve the performance of the integrated organization system.
[0006] A first aspect of an embodiment of the present invention provides an integrated collating system based on multi-link data of an industrial chain, including:
[0007] A log acquisition module is used to acquire the first production log of each production link in the current production stage and the second production log of each production link in the historical production stage;
[0008] A resident database module is used to build a resident database based on each second production log, and the resident database is used to store data of historical production stages that are instructive to the entire industrial chain;
[0009] A one-way database module is used to construct a one-way database corresponding to each production link based on each first production log, and the one-way database is used to store data that is only of guiding significance to the corresponding production link in the industrial chain at the current production stage;
[0010] The storage data determination module is used to determine the storage data corresponding to the blockchain nodes of each production link in the industrial chain based on the resident database and the one-way database.
[0011] In the integrated sorting system based on multi-link data of the industrial chain provided by the embodiment of the present invention, the resident database module selects data that are instructive for the entire industrial chain according to the call status of the logs in each production link under the historical production stage to construct a resident database. Then the one-way database module only selects data that are instructive for the corresponding production link in the industrial chain according to the call status of the logs in each production link under the current production stage to construct a one-way database module. Finally, the storage data determination module determines the storage data corresponding to the blockchain nodes of each production link in the industrial chain according to the resident database and the one-way database. In this way, the embodiment of the present invention only synchronizes meaningful data according to the resident database and the one-way database, while meaningless data is not synchronized. The sharing of local blockchain data is realized, thereby reducing the amount of data stored in each blockchain node, and the performance of the integrated sorting system can be improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0013] Figure 1 A schematic diagram of the structure of an integrated collating system based on multi-link data of an industrial chain provided by an embodiment of the present invention;
[0014] Figure 2 A schematic diagram of the structure of a one-way database module provided by an embodiment of the present invention;
[0015] Figure 3 A schematic diagram of the structure of a priority determination unit provided by an embodiment of the present invention;
[0016] Figure 4 A schematic diagram of the structure of a priority correction unit provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0017] In order to further explain the technical means and effects adopted by the present invention to achieve the predetermined invention purpose, the following is a detailed description of the specific implementation method, structure, features and effects of an integrated sorting system based on multi-link data of the industrial chain proposed by the present invention in combination with the accompanying drawings and preferred embodiments. In the following description, different "one embodiment" or "another embodiment" does not necessarily refer to the same embodiment. In addition, specific features, structures or characteristics in one or more embodiments may be combined in any suitable form.
[0018] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
[0019] It should be noted that the acquisition, storage, use, and processing of data in the technical solution of the present invention are in compliance with the relevant provisions of laws and regulations.
[0020] It should be noted that in the embodiments of the present invention, certain software, components, models and other existing solutions in the industry may be mentioned, which should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present invention, but it does not mean that the applicant has or will necessarily use the solution.
[0021] In the existing method, a blockchain node is built in each production link using blockchain technology, and all data of each production link is shared to the blockchain nodes of all production links through blockchain technology, thereby realizing data integration and collation of multiple links in the industrial chain. However, each production link in the industrial chain only uses part of the data, and the existing method will share all the data to the blockchain nodes of each production link, resulting in redundant data stored in each blockchain node and low system performance.
[0022] The object of the present invention is to provide an integrated sorting system based on multi-link data of an industrial chain. In the integrated sorting system based on multi-link data of an industrial chain provided by an embodiment of the present invention, the resident database module selects data that are instructive for the entire industrial chain to construct a resident database based on the call of logs in each production link under the historical production stage. Then the one-way database module only selects data that are instructive for the corresponding production link in the industrial chain to construct a one-way database module based on the call of logs in each production link under the current production stage. Finally, the storage data determination module determines the storage data corresponding to the blockchain nodes of each production link in the industrial chain based on the resident database and the one-way database. In this way, the embodiment of the present invention only synchronizes meaningful data based on the resident database and the one-way database, while meaningless data is not synchronized. The sharing of local blockchain data is realized, thereby reducing the amount of data stored in each blockchain node, and the performance of the integrated sorting system can be improved.
[0023] The following introduces a specific embodiment of an integrated sorting system based on multi-link data of an industrial chain provided by an embodiment of the present invention.
[0024] like Figure 1 As shown, a schematic diagram of the structure of an integrated system for collating data from multiple links of an industrial chain is provided. The integrated system 100 for collating data from multiple links of an industrial chain includes a log acquisition module 110 , a resident database module 120 , a one-way database module 130 and a storage data determination module 140 .
[0025] The log acquisition module 110 is used to acquire the first production log of each production link in the current production stage and the second production log of each production link in the historical production stage.
[0026] In this embodiment, the first production log is used to represent the production logs of each production link in the current production stage, and the second production log is used to represent the production logs of each production link in the historical production stage. Among them, a production stage may include several production links, each production link may include several items, and each item corresponds to a production log.
[0027] As an example, the log acquisition module 110 collects the production logs of each production link in the current production stage in real time through the automated data collection system of each production link. Then, the production logs of each production link in the previous production stage are extracted from the database. Specifically, the production log includes a variety of log data, and the log data may include the operator (IP address), the operator's access time, the database address accessed by the operator, and the specific operation content.
[0028] The resident database module 120 is used to build a resident database based on each second production log, and the resident database is used to store data of historical production stages that are of guiding significance to the entire industrial chain.
[0029] In this embodiment, the resident database is used to store data of historical production stages that are of guiding significance to the entire industrial chain.
[0030] As an example, the resident database module 120 extracts data that is instructive to the entire industrial chain based on each second production log through data mining and machine learning technology, such as optimal production parameters, material consumption rules, and quality control standards. After verification and review, these data are stored in the resident database.
[0031] The one-way database module 130 is used to construct a one-way database corresponding to each production link based on each first production log. The one-way database is used to store data that is only of guiding significance to the corresponding production link in the industrial chain at the current production stage.
[0032] In this embodiment, the one-way database is used to store data that is only of guiding significance to the corresponding production link in the industrial chain at the current production stage.
[0033] As an example, the one-way database module 130 establishes an independent one-way database for each production link based on each first production log. The data stored in these one-way databases may specifically include production data, quality control records, and abnormal situation processing of the current production stage. The data in the one-way database is updated in real time to ensure the accuracy and timeliness of the data.
[0034] The storage data determination module 140 is used to determine the storage data corresponding to the blockchain nodes of each production link in the industrial chain based on the resident database and the one-way database.
[0035] In this embodiment, the storage data determination module 140 determines the storage data corresponding to the blockchain nodes of each production link in the industrial chain based on the data in the resident database and the one-way database.
[0036] Specifically, the storage data determination module 140 packages all the data in the resident database and the data in each one-way database in accordance with the data format of the blockchain to ensure the integrity and immutability of the data. The packaged data is then uploaded to the blockchain node corresponding to the one-way database to achieve data sharing and traceability. That is, the data stored in the blockchain nodes of each production link in the final industrial chain includes all the data in the resident database and all the data in the corresponding one-way database.
[0037] In the integrated sorting system 100 based on multi-link data of the industrial chain provided in this embodiment, the resident database module 120 selects data that are instructive for the entire industrial chain according to the call status of the logs in each production link under the historical production stage to construct a resident database. Then the one-way database module 130 only selects data that are instructive for the corresponding production link in the industrial chain to construct a one-way database module according to the call status of the logs in each production link under the current production stage. Finally, the storage data determination module 140 determines the storage data corresponding to the blockchain nodes of each production link in the industrial chain according to the resident database and the one-way database. In this way, the embodiment of the present invention only synchronizes meaningful data according to the resident database and the one-way database, while meaningless data is not synchronized. The sharing of local blockchain data is realized, thereby reducing the amount of data stored in each blockchain node, and the performance of the integrated sorting system can be improved.
[0038] As an optional embodiment, the historical production stage includes a first historical production stage and a second historical production stage, the first historical production stage is a production stage before the current production stage, and the second historical production stage is a production stage before the first historical production stage;
[0039] The resident database module 120 can be specifically used for:
[0040] Screening each second production log to obtain the first historical production log in the first historical production stage and the second historical production log in the second historical production stage;
[0041] Based on the first historical production log and the second historical production log, a target historical production log that calls the second historical production log in the first historical production log is filtered out;
[0042] Build a resident database based on the log data in the target historical production log.
[0043] In this embodiment, the resident database module 120 first obtains the first historical production logs of each production link in the first historical production stage, and the second historical production logs of each production link in the second historical production stage.
[0044] Then, the resident database module 120 selects the target historical production log that calls the second historical production log from each of the first historical production logs according to the first historical production log and the second historical production log.
[0045] Finally, a resident database is constructed based on the log data in the target historical production log. Specifically, the resident database includes but is not limited to the operator (IP address) corresponding to the target historical production log, the operator's access time, the database address accessed by the operator, and the specific operation content. At the same time, during the construction process, the log data can be cleaned, deduplicated, and standardized to improve the accuracy and availability of the data.
[0046] Through this embodiment, the resident database module 120 pre-acquires the historical production logs corresponding to each historical production stage, and then screens the historical production logs corresponding to each historical production stage to obtain the target historical production logs. Thus, according to the target historical production logs, a resident database containing rich historical information is constructed to store data that is instructive for the entire industrial chain in the historical production stage. In this way, by screening the historical production logs and removing meaningless historical production logs, the amount of data stored in each blockchain node is reduced, which can improve the performance of the integrated sorting system.
[0047] As an optional embodiment, Figure 2 As shown, the one-way database module 130 specifically includes the following units:
[0048] The priority determination unit 131 is used to determine the initial call priority of the first production link to each second link log according to the first link log and the second link log in the first production log, the first link log is the log belonging to the first production link in each first production log, and the second link log is the log of each production link before the first production link in each first production log;
[0049] The log screening unit 132 is used to screen the logs of each second link to obtain the initial one-way log and the preliminary one-way log based on the order of the initial call priorities, wherein the initial one-way log is used to represent the log whose initial call priority is greater than the first priority threshold, and the preliminary one-way log is used to represent the log whose initial call priority is between the first priority threshold and the second priority threshold, and the first priority threshold is greater than the second priority threshold;
[0050] The priority correction unit 133 is used to correct the initial call priority of each initial one-way log and each preliminary one-way log based on the priority correction coefficient corresponding to each initial one-way log and each preliminary one-way log, so as to obtain the final call priority corresponding to each initial one-way log and each preliminary one-way log;
[0051] The log screening unit 132 is further used to screen the target one-way log from the initial one-way logs and the preliminary one-way logs based on the order of the final call priorities;
[0052] The one-way database construction unit 134 is used to construct a one-way database corresponding to the first production link based on the log data in the target one-way log.
[0053] In this embodiment, a production stage includes several production links arranged in sequence. The first link log is the log belonging to the first production link in each first production log, and the second link log is the log of each production link before the first production link in each first production log.
[0054] The call priority is used to characterize the degree of dependence of the first production link on the logs of each second link, and the importance of each second link log to the first production link.
[0055] The target one-way log is a log used to construct a one-way database.
[0056] As an example, when it is necessary to construct a one-way database corresponding to the first production link, the priority determination unit 131 selects the first link log belonging to the first production link and the second link log belonging to each production link before the first production link from each first production log. And according to the log call relationship between each first link log and each second link log, a specific algorithm or model (such as a prediction model based on machine learning) is used to calculate the initial call priority of the first production link to each second link log.
[0057] Then, the log screening unit 132 sets a first priority threshold and a second priority threshold according to actual needs and characteristics of the production process, wherein the first priority threshold is greater than the second priority threshold. The second link logs are sorted according to the initial call priority, and the initial one-way logs whose initial call priority is greater than the first priority threshold and the preliminary one-way logs whose initial call priority is between the first priority threshold and the second priority threshold are screened.
[0058] Then, the priority correction unit 133 determines a priority correction coefficient for each initial one-way log and each preliminary one-way log according to the log attributes (such as timestamp, data volume, and data quality) of the initial one-way log and the preliminary one-way log. And according to the priority correction coefficient, the initial call priority of each initial one-way log and each preliminary one-way log is corrected to obtain the final call priority of each log.
[0059] Finally, the log screening unit 132 sorts the initial one-way logs and the preliminary one-way logs in the order of the final call priority, and selects the first N logs with the largest final call priority as the target one-way logs. The one-way database construction unit 134 extracts the required log data from the target one-way log, which may specifically include the operator (IP address) in the production link, the operator's access time, the database address accessed by the operator, and the specific operation content. Then, the extracted log data is used to construct the one-way database corresponding to the first production link.
[0060] Through this embodiment, the one-way database module 130 first determines the initial call priority of the log through the priority determination unit 131, and the log screening unit 132 uses the initial call priority to perform preliminary screening of the log. Then, the initial call priority is further corrected by the priority correction unit 133 to obtain the final call priority. The log screening unit 132 uses the final call priority to perform a final screening of the log to obtain the target one-way log. Finally, the one-way database construction unit 134 can construct a one-way database according to the target one-way log. A one-way database construction method based on the production log call priority is implemented, which can efficiently extract key information from a large number of production logs, thereby reducing the amount of data stored in each blockchain node and improving the performance of the integrated sorting system.
[0061] As an optional embodiment, Figure 3 As shown, the priority determination unit 131 specifically includes the following subunits:
[0062] The parameter determination subunit 1311 is used to determine the correlation parameters between the first production link and each second link log according to the first link log and the second link log in the first production log;
[0063] The closeness determination subunit 1312 is used to determine the closeness of association between the first production link and each second link log according to the number of the first link logs, the number of times each second link log is called in the first production link, and each correlation parameter;
[0064] The priority determination subunit 1313 is used to normalize the maximum and minimum values of each correlation closeness to obtain the initial calling priority of the first production link to each second link log.
[0065] In this embodiment, the parameter determination subunit 1311 first determines the correlation parameters between the first production link and each second link log based on a rule-based association method and according to the log call relationship between each first link log and each second link log, using a specific algorithm or model (such as a prediction model based on machine learning).
[0066] Then, the closeness determination subunit 1312 determines the closeness of association between the first production link and each second link log according to the number of first link logs, the number of times each second link log is called in the first production link, and each correlation parameter through the following formula 1:
[0067] Formula 1
[0068] In the formula, It is used to characterize the closeness of the association between the i-th production link and the j-th second link log in the p-th production link. It is used to represent the number of times the j-th second link log in the p-th production link is called in the i-th production link. It is used to represent the number of logs in the first link of the i-th production link. It is used to characterize the correlation parameter between the log of the jth second link in the i-th production link and the p-th production link.
[0069] in, It is used to represent the ratio of the number of times the j-th second link log in the p-th production link is called in the i-th production link to the number of the first link log in the i-th production link, that is, the size of the call frequency. The larger the call frequency or the larger the correlation parameter, the stronger the correlation, that is, the greater the corresponding correlation density.
[0070] The correlation between the log of the jth second link in the pth production link and the i-th production link The larger it is, the more necessary it is to use the log data in the j-th second link log in the p-th production link as an element of the one-way database of the ith production link.
[0071] Finally, the priority determination subunit 1313 converts each association closeness into an initial call priority between 0 and 1 using a maximum and minimum value normalization method.
[0072] Through this embodiment, the priority determination unit 131 can accurately calculate the initial call priority of the first production link to each second link log according to the number of first link logs, the number of times each second link log is called in the first production link, and the corresponding correlation parameters. This helps to filter the logs according to the initial call priority in the future, so as to reduce the amount of data stored in each blockchain node and improve the performance of the integrated sorting system.
[0073] As an optional embodiment, the parameter determination subunit 1311 may be specifically used for:
[0074] Obtain each first link log and a target second link log from the first production log, where the target second link log is any one of the second link logs;
[0075] According to each first link log and the target second link log, determine the number of times the target second link log is called in the first production link, the number of interval logs from the second production link to the first production link, and the number of interval links from the second production link to the first production link, the second production link is the production link corresponding to the target second link log;
[0076] Divide the number of interval logs by the number of interval links to obtain the mean of the logs from the second production link to the first production link;
[0077] The log mean is multiplied by the inverse of the number of times the target second link log is called, and then a logarithmic calculation is performed to obtain the correlation parameter between the first production link and the target second link log.
[0078] In this embodiment, the correlation parameter between the logs of the first production link and the second link can be specifically determined by the following formula 2:
[0079] Formula 2
[0080] In the formula, It is used to characterize the correlation parameter between the log of the jth second link in the i-th production link and the p-th production link. represents the logarithm with base 10, It is used to represent the number of times the j-th second link log in the p-th production link is called in the i-th production link. It is used to represent the number of interval logs from the pth production link to the ith production link. Used to characterize the number of interval links between the pth production link and the i-th production link.
[0081] in, It represents the ratio of the number of interval logs from the p-th production link to the i-th production link to the number of interval links from the p-th production link to the i-th production link, that is, the log mean from the p-th production link to the i-th production link.
[0082] The correlation parameter between the log of the jth second link in the i-th production link and the p-th production link The larger the value is, the more times the jth second link log in the pth production link is called in the i-th production link. Much smaller than the log mean from the pth production link to the ith production link , then the call of the jth second link log in the i-th production link corresponding to the p-th production link is unique to the i-th production link, that is, it is more inclined to be an element of the one-way database of the i-th production link.
[0083] Through this embodiment, the parameter determination subunit 1311 can accurately calculate the correlation parameter between the first production link and the target second link log according to the number of times the target second link log is called in the first production link, the number of interval logs from the second production link to the first production link, and the number of interval links from the second production link to the first production link. This helps to calculate the initial call priority of the first production link to the target second link log based on the correlation parameter. This helps to filter the logs based on the initial call priority in the future, so as to reduce the amount of data stored in each blockchain node and improve the performance of the integrated sorting system.
[0084] As an optional embodiment, the log screening unit 132 may be specifically used for:
[0085] Sort the initial call priorities from large to small to obtain a call priority sequence;
[0086] Calculating the difference between two adjacent initial call priorities in the call priority sequence to obtain a plurality of call priority differences;
[0087] Determine a first priority threshold and a second priority threshold according to a maximum difference and a second maximum difference among the call priority differences;
[0088] Determine each second link log whose initial call priority is greater than the first priority threshold as an initial one-way log;
[0089] Each second link log whose initial call priority is less than or equal to the first priority threshold and greater than the second priority threshold is determined as a preliminary one-way log.
[0090] In this embodiment, the log screening unit 132 sorts the initial call priorities of each second link log from large to small, thereby obtaining a call priority sequence. Then, for the sorted call priority sequence, the difference between two adjacent initial call priorities is calculated, that is, the absolute value of the previous initial call priority minus the next initial call priority, or the next initial call priority minus the previous initial call priority. In this way, a set containing multiple call priority differences can be obtained.
[0091] Then, find the maximum and second largest values in this difference set, and based on the positions of the initial call priorities corresponding to the maximum and second largest values in the call priority sequence, select the one with a higher position in the call priority sequence to determine the first priority threshold, and select the one with a lower position in the call priority sequence to determine the first priority threshold.
[0092] For example, assuming that the call priority sequence is {30, 24, 14, 9, 6}, the corresponding difference set is {6, 10, 5, 3}, and it can be seen that the maximum value is 10, and the second largest value is 6. Among them, the initial call priorities corresponding to the maximum values are 24 and 14, and the initial call priorities corresponding to the second largest values are 30 and 24. That is, the initial call priority corresponding to the second largest value is at an earlier position in the call priority sequence, and the initial call priority corresponding to the first largest value is at a later position in the call priority sequence. Therefore, the first priority threshold is determined according to the second largest value, and the second priority threshold is determined according to the first largest value, that is, the first priority threshold will be greater than the second priority threshold.
[0093] Specifically, the latter of the two initial call priorities corresponding to the second largest value can be used as the first priority threshold, and the latter of the two initial call priorities corresponding to the maximum value can be used as the second priority threshold. That is, in the above example, the first priority threshold is 24, and the second priority threshold is 14.
[0094] Finally, each second link log whose initial call priority is greater than the first priority threshold is determined as the initial one-way log, and each second link log whose initial call priority is less than or equal to the first priority threshold and greater than the second priority threshold is determined as the reserve one-way log. That is, in the above example, the second link log whose initial call priority is 30 is the initial one-way log, and the second link log whose initial call priority is 24 is the reserve one-way log.
[0095] Through this embodiment, each second link log is screened according to the initial call priority of each second link log. Only the initial one-way logs in the second link logs that are greater than the first priority threshold, and the preliminary one-way logs in the second link logs whose initial call priority is less than or equal to the first priority threshold and greater than the second priority threshold are retained. This reduces the amount of data stored in each blockchain node and improves the performance of the integrated sorting system.
[0096] As an optional embodiment, Figure 4 As shown, the priority correction unit 133 may specifically include the following subunits:
[0097] The correction coefficient determination subunit 1331 is used to determine the initial correction coefficient according to the first similarity between the target correction log and the corresponding result log in the current production stage, the target correction log is any one of the initial one-way logs and the preliminary one-way logs, and the result log is the log that calls the target correction log in the first production link;
[0098] The correction coefficient updating subunit 1332 is used to update the initial correction coefficient based on the proportional coefficient of the target correction log to obtain the priority correction coefficient of the target correction log;
[0099] The priority correction subunit 1333 is used to multiply the initial call priority of the target correction log by the priority correction coefficient to obtain the final call priority corresponding to the target correction log.
[0100] In this embodiment, for each target correction log (any one of the initial one-way log or the preliminary one-way log), the correction coefficient determination subunit 1331 is first used to search for the result log that calls the target correction log in the first production link. Then, a similarity calculation method (such as cosine similarity or Jaccard similarity) is used to calculate the first similarity between the target correction log and the corresponding result log. Therefore, according to the size of the first similarity, a threshold value or range is set to convert the first similarity into the corresponding initial correction coefficient.
[0101] Then, the correction coefficient updating subunit 1332 calculates a proportional coefficient for each target correction log according to its importance in the production process and frequency of use, and multiplies the proportional coefficient by the initial correction coefficient to obtain the priority correction coefficient of the target correction log.
[0102] Finally, the priority correction subunit 1333 multiplies the initial call priority of each target correction log by the priority correction coefficient, thereby obtaining the final call priority corresponding to the target correction log.
[0103] Through this embodiment, the initial call priority is corrected by using the priority correction unit 133, so as to obtain a more accurate final call priority, which is helpful for further screening of logs according to the more accurate final call priority, so as to reduce the amount of data stored in each blockchain node and improve the performance of the integrated sorting system.
[0104] As an optional embodiment, the correction coefficient determination subunit 1331 may be specifically used for:
[0105] Calculate the similarity between the target correction log and the corresponding result logs in the current production stage to obtain a first similarity between the target correction log and the corresponding result logs;
[0106] An initial correction coefficient of the target correction log is determined according to a minimum value among the first similarities.
[0107] In this embodiment, the more similar the data between the target correction log and the corresponding result log in the current production stage is, the greater the reference significance of the target correction log is, which means that the calling priority of the target correction log in the current production stage should be increased.
[0108] Therefore, the initial correction coefficient of the target correction log can be determined by the following formula 3:
[0109] Formula 3
[0110] In the formula, The initial correction coefficient used to characterize the kth target correction log in the i-th production link, () is used to characterize the calculated value using the DTW algorithm distance, Used to characterize the minimum value, The data sequence used to represent the kth target correction log in the i-th production link, A data sequence used to represent the pth result log of the kth target correction log in the ith production link.
[0111] Among them, the target correction log and the result log will include two types of log data: digital data and text data. Therefore, it is necessary to first vectorize the log data in each log to obtain the vector sequence corresponding to each log. Then, after the vector sequence corresponding to each log is standardized and the modulus is calculated, the data sequence corresponding to each log can be obtained.
[0112] Specifically, the standardized calculation modulus is used to represent that each log data is converted according to a preset conversion rule so that it meets a specific distribution requirement or range requirement. For example, the standardized calculation method may include a Z-score standardized method.
[0113] in, It is used to represent the relationship between the kth target correction log and the corresponding pth result log in the i-th production link. The distance is the first similarity. The smaller the distance, the more similar the kth target correction log is to the corresponding pth result log, and the larger the corresponding initial correction coefficient is.
[0114] Through this embodiment, the similarity between the target correction log and the corresponding result log is calculated, thereby obtaining the first similarity between the target correction log and the corresponding result log, and determining the initial correction coefficient of the target correction log according to the first similarity. This helps to correct the initial call priority according to the initial correction coefficient in the future, thereby obtaining a more accurate final call priority. This further helps to further screen the logs according to the more accurate final call priority in the future, so as to reduce the amount of data stored in each blockchain node and improve the performance of the integrated sorting system.
[0115] As an optional embodiment, before the initial correction coefficient is updated based on the proportional coefficient of the target correction log to obtain the priority correction coefficient of the target correction log, the priority correction unit 133 specifically further includes the following subunits:
[0116] A proportional coefficient calculation subunit is used to calculate the similarity between the target correction log and the corresponding result logs in the historical production stage to obtain multiple second similarities;
[0117] The proportional coefficient calculation subunit is further used to calculate the difference between the second similarity mean of each second similarity and the minimum similarity among each first similarity and then take the absolute value to obtain the similarity absolute difference;
[0118] The proportional coefficient calculation subunit is also used to perform exponential operation on the opposite number of the absolute difference of similarity to obtain the proportional coefficient of the target correction log.
[0119] In this embodiment, for an industrial chain, the amount used in each production link is different based on different production requirements. However, for a complete and mature industrial chain, the raw materials and process parameters of each link are recorded in a proportional relationship with different production. At this time, the change in log data will cause the value of the initial correction coefficient to change. Therefore, the initial correction coefficient can be adjusted according to the proportional change of the log data to obtain the final priority correction coefficient of the target correction log.
[0120] Specifically, after obtaining the target correction log and the corresponding result log in the current production stage, the priority correction unit 133 also obtains the target correction log and the corresponding result log in the historical production stage. If there is no corresponding result log for the target correction log in the historical production stage, the proportional coefficient of the target correction log is determined to be 0.
[0121] When there is a corresponding result log for the target correction log in the historical production stage, the similarity between the target correction log in the historical production stage and the corresponding result log is calculated by the proportional coefficient calculation subunit to obtain multiple second similarities, and the method for obtaining the second similarities is exactly the same as the method for obtaining the first similarities.
[0122] Then, according to the first similarity and the second similarity corresponding to the target correction log, the proportional coefficient of the target correction log is determined by the following formula 4:
[0123] Formula 4
[0124] In the formula, It is used to characterize the proportional coefficient corresponding to the kth target correction log in the i-th production link, Used to represent exponential operations, It is used to represent the minimum similarity among the first similarities corresponding to the k-th target correction log in the i-th production link, Used to characterize the second similarity mean corresponding to the k-th target correction log in the historical production stage.
[0125] in, It is used to represent the difference between the minimum similarity among the first similarities corresponding to the k-th target correction log in the i-th production link and the mean of the second similarities corresponding to the k-th target correction log in the historical production stage. The smaller the difference, the more likely it is to present a proportional relationship caused by different production volumes, and the larger the corresponding proportional coefficient.
[0126] Through this embodiment, according to the first similarity between the target correction log and the corresponding result log in the current production stage, and the second similarity between the target correction log and the corresponding result log in the historical production stage, the proportionality coefficient corresponding to the target correction log is obtained, which is helpful for updating the initial correction coefficient according to the proportionality coefficient later, and then obtaining the final priority correction coefficient of the target correction log.
[0127] As an optional embodiment, the correction coefficient updating subunit 1332 may be specifically used for:
[0128] Multiply the proportional coefficient by the initial correction coefficient to obtain the intermediate calculation result;
[0129] The intermediate calculation result is added to the initial correction coefficient to obtain the priority correction coefficient of the target correction log.
[0130] In this embodiment, the priority correction coefficient of the target correction log can be specifically determined by the following formula 5:
[0131] Formula 5
[0132] In the formula, It is used to characterize the priority correction coefficient of the kth target correction log in the i-th production link. The initial correction coefficient used to characterize the kth target correction log in the i-th production link, It is used to characterize the proportional coefficient corresponding to the k-th target correction log in the ith production link.
[0133] in, The sum of the initial correction coefficient used to characterize the kth target correction log in the i-th production link and the intermediate calculation result obtained by correcting the initial correction coefficient according to the proportional coefficient corresponding to the target correction log. The larger the initial correction coefficient corresponding to the target correction log, or the larger the proportional coefficient corresponding to the target correction log, the larger the final priority correction coefficient of the target correction log will be.
[0134] Through this embodiment, the initial correction coefficient is updated according to the proportional coefficient corresponding to the target correction log, and then the final priority correction coefficient of the target correction log is obtained. This helps to correct the initial call priority according to the priority correction coefficient in the future, so as to obtain a more accurate final call priority. This helps to further screen the logs according to the more accurate final call priority in the future, so as to reduce the amount of data stored in each blockchain node and improve the performance of the integrated sorting system.
[0135] It should be clear that the present invention is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the technical solution of the present invention.
[0136] It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.
[0137] The above is only a specific implementation of the present invention. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process of the system, module and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be covered within the protection scope of the present invention.
Claims
1. An integrated sorting system based on multi-link data of the industrial chain, characterized in that: The system comprises: A log acquisition module is used to acquire the first production log of each production link in the current production stage and the second production log of each production link in the historical production stage; A resident database module, used to construct a resident database based on each of the second production logs, wherein the resident database is used to store data of historical production stages that are instructive to the entire industrial chain; A one-way database module, used to construct a one-way database corresponding to each of the production links based on each of the first production logs, wherein the one-way database is used to store data that is only of guiding significance to the corresponding production link in the industrial chain at the current production stage; A storage data determination module, used to determine the storage data corresponding to the blockchain nodes of each production link in the industrial chain according to the resident database and the one-way database; the historical production stage includes a first historical production stage and a second historical production stage, the first historical production stage is the previous production stage of the current production stage, and the second historical production stage is the previous production stage of the first historical production stage; The resident database module is specifically used for: Screening each of the second production logs to obtain the first historical production log in the first historical production stage and the second historical production log in the second historical production stage; Based on the first historical production log and the second historical production log, filter out a target historical production log in the first historical production log that calls the second historical production log; Based on the log data in the target historical production log, the resident database is constructed; the one-way database module specifically includes the following units: a priority determination unit, configured to determine the initial call priority of the first production link to each second link log according to the first link log and the second link log in the first production log, wherein the first link log is the log belonging to the first production link in each of the first production logs, and the second link log is the log of each of the production links before the first production link in each of the first production logs; a log screening unit, configured to screen the logs of the second links to obtain an initial one-way log and a preliminary one-way log based on the order of the initial call priorities, wherein the initial one-way log is used to represent a log whose initial call priority is greater than a first priority threshold, and the preliminary one-way log is used to represent a log whose initial call priority is between the first priority threshold and a second priority threshold, and the first priority threshold is greater than the second priority threshold; A priority correction unit, for correcting the initial call priority of each of the initial one-way logs and each of the preliminary one-way logs based on the priority correction coefficients corresponding to each of the initial one-way logs and each of the preliminary one-way logs, to obtain the final call priority corresponding to each of the initial one-way logs and each of the preliminary one-way logs; The log screening unit is further used to screen the target one-way log from the initial one-way logs and the preliminary one-way logs based on the order of the final call priorities; A one-way database construction unit is used to construct the one-way database corresponding to the first production link based on the log data in the target one-way log.
2. The integrated sorting system based on multi-link data of the industrial chain according to claim 1 is characterized in that: The priority determination unit specifically includes the following subunits: A parameter determination subunit, used to determine the correlation parameters between the first production link and each of the second link logs according to the first link log and the second link log in the first production log; A closeness determination subunit, used to determine the closeness of association between the first production link and each of the second link logs according to the number of the first link logs, the number of times each of the second link logs is called in the first production link, and each of the correlation parameters; The priority determination subunit is used to normalize the maximum and minimum values of each of the correlation closenesses to obtain the initial calling priority of the first production link to each of the second link logs.
3. The integrated sorting system based on multi-link data of the industrial chain according to claim 2 is characterized in that: The parameter determination subunit is specifically used for: Obtaining each of the first link logs and a target second link log from the first production log, wherein the target second link log is any one of the second link logs; According to each of the first link logs and the target second link log, determine the number of times the target second link log is called in the first production link, the number of interval logs from the second production link to the first production link, and the number of interval links from the second production link to the first production link, where the second production link is the production link corresponding to the target second link log; Divide the number of interval logs by the number of interval links to obtain the mean value of logs from the second production link to the first production link; The log mean is multiplied by the inverse of the number of times the target second link log is called, and then a logarithmic calculation is performed to obtain a correlation parameter between the first production link and the target second link log.
4. The integrated sorting system based on multi-link data of the industrial chain according to claim 1 is characterized in that: The log screening unit is specifically used for: Sorting the initial call priorities in descending order to obtain a call priority sequence; Calculating the difference between two adjacent initial call priorities in the call priority sequence to obtain a plurality of call priority differences; Determining the first priority threshold and the second priority threshold according to the maximum difference and the second maximum difference among the call priority differences; Determine each of the second link logs whose initial call priority is greater than the first priority threshold as the initial one-way log; Each of the second-link logs whose initial call priority is less than or equal to the first priority threshold and greater than the second priority threshold is determined as the preliminary one-way log.
5. The integrated sorting system based on multi-link data of the industrial chain according to claim 1 is characterized in that: The priority correction unit specifically includes the following subunits: A correction coefficient determination subunit, configured to determine an initial correction coefficient according to a first similarity between a target correction log and a corresponding result log in a current production stage, wherein the target correction log is any one of the initial one-way logs and the preliminary one-way logs, and the result log is a log in which the target correction log is called in the first production link; A correction coefficient updating subunit, configured to update the initial correction coefficient based on the proportional coefficient of the target correction log to obtain a priority correction coefficient of the target correction log; The priority correction subunit is used to multiply the initial call priority of the target correction log by the priority correction coefficient to obtain a final call priority corresponding to the target correction log.
6. The integrated sorting system based on multi-link data of the industrial chain according to claim 5 is characterized in that: The correction coefficient determination subunit is specifically used for: Calculating the similarity between the target revision log and the corresponding result logs in the current production stage to obtain the first similarity between the target revision log and the corresponding result logs; An initial correction coefficient of the target correction log is determined according to a minimum value of each of the first similarities.
7. The integrated sorting system based on multi-link data of the industrial chain according to claim 5 is characterized in that: Before the initial correction coefficient is updated based on the proportional coefficient of the target correction log to obtain the priority correction coefficient of the target correction log, the priority correction unit specifically further includes the following subunits: A proportional coefficient calculation subunit, used for calculating the similarity between the target correction log and the corresponding result logs in the historical production stage to obtain a plurality of second similarities; The proportional coefficient calculation subunit is further used to calculate the difference between the second similarity mean of each of the second similarities and the minimum similarity among each of the first similarities and then take the absolute value to obtain the similarity absolute difference; The proportionality coefficient calculation subunit is further used to perform an exponential operation on the opposite number of the absolute difference of the similarity to obtain the proportionality coefficient of the target correction log.
8. The integrated sorting system based on multi-link data of the industrial chain according to claim 5 is characterized in that: The correction coefficient updating subunit is specifically used for: Multiplying the proportionality coefficient by the initial correction coefficient to obtain an intermediate calculation result; The intermediate calculation result and the initial correction coefficient are accumulated to obtain the priority correction coefficient of the target correction log.
Citation Information
Patent Citations
Log processing method, device and equipment based on block chain
CN118154188A