Information Supervision Synchronization Method Based on Multi-Source Data
Through the frequency confirmation of multi-source data and the reasonable allocation of computing power, the problem of inefficient format conversion in multi-source data synchronization is solved, and faster and better data conversion and supervision effects are achieved.
Patent Information
- Application Number
- CN202411690464.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-25
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2044-11-25
AI Technical Summary
In the prior art, the format unified conversion method of multi-source data is poor, resulting in inefficient information synchronization and unable to achieve better synchronization effects.
By determining the update frequency and correlation calibration of multi-source data, synchronous multi-source data packets are generated, and computing resources are reasonably allocated during the format conversion process, ensuring that the conversion logic of each data packet is different, monitoring the conversion rate and abnormal data in real time, and checking the byte capacity to confirm data integrity.
It achieves faster and better data conversion effects, ensures the accuracy and completeness of the synchronization process, reduces conversion time, and improves data supervision efficiency.
Smart Images

Figure CN119646088B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of multi-source data synchronization, and specifically to an information supervision and synchronization method based on multi-source data. Background Art
[0002] Multi-source data refers to a data set that comes from multiple different sources and has different forms or characteristics. These data sources are extensive and diverse in type.
[0003] The application with the publication number CN117149876A discloses a data element information synchronization method and device based on multi-data sources of an Internet of Vehicles, which relates to the technical field of information synchronization. The method includes the following steps: creating a plurality of custom databases, each custom database corresponding to a different data type; based on the data types corresponding to different data protocols, and configuring the corresponding custom databases for different data protocols; based on the data protocol, sending the vehicle protocol data to the corresponding custom database. This application synchronizes the data element information of the data sources of various terminal devices in different databases in a configuration manner or an automatic update manner, and can realize data synchronization in a timely manner to ensure that the data can be correctly stored.
[0004] When it comes to the information supervision of multi-source data, generally based on the set supervision logic, the multi-source data is collected and confirmed. Subsequently, for the confirmed multi-source data, a specific conversion logic is adopted to unify the format. However, within different multi-source data packets, the data capacities of different formats will change greatly. If a fixed conversion logic is adopted, it will lead to a slower conversion rate for some data packets, and the format-unifying conversion method is not in the best state, unable to achieve a better and faster information synchronization effect, and is not convenient for the overall supervision process of multi-source data. Summary of the Invention
[0005] Aiming at the deficiencies of the prior art, the present invention provides an information supervision and synchronization method based on multi-source data, which solves the problem that the original format-unifying conversion method is not in the best state and cannot achieve a better and faster information synchronization effect.
[0006] To achieve the above objectives, the present invention is realized through the following technical solutions: An information supervision and synchronization method based on multi-source data, including the following steps:
[0007] Step 1: Based on the source ports of different multi-source data, determine the update frequencies of different source ports, and then use the current moment as the calibration moment to determine the synchronized multi-source data packets of the multi-source data with associated calibrations. The specific method is as follows:
[0008] S11: Based on the source port of the corresponding multi-source data, determine the update frequency P of the corresponding source port for generating the corresponding multi-source data i, where i represents different source ports;
[0009] S12. Based on the multi-source data with associated calibration, calibrate several source ports associated with the multi-source data as pending ports, and based on the different update frequencies P determined by different pending ports i , taking the current moment as the calibration moment, generate an update timeline belonging to the corresponding pending port, and the time difference between the initial moment and each subsequent adjacent update time point within its update timeline is P i ;
[0010] Take the pending port with the update frequency P i as the maximum value as the main port, and take the update timeline associated with the main port as the main timeline, and the initial moment within its update timeline is also calibrated as the update time point;
[0011] S13. According to the specific time period (C1, C2] between adjacent update time points of the main timeline, where C1 is the initial moment of the specific time period and C2 is the end moment of the specific time period, calibrate the update time points within this specific time period in other update timelines as subsidiary update points, and based on the confirmed specific time period (C1, C2] and the confirmed subsidiary update points, integrate the data updated by the main port within this specific time period and the data updated by the subsidiary update points into data packets to confirm the synchronous multi-source data packets belonging to this specific time period. Similarly, for each subsequent adjacent update time point in the main timeline, a group of synchronous multi-source data packets will be confirmed;
[0012] Step 2. Based on the determined synchronous multi-source data packets, specifically confirm the format conversion logic by determining the data capacity of different format data in each different synchronous multi-source data packet, and then based on the confirmed specific format conversion logic, unify the formats in the synchronous multi-source data packets, and reasonably allocate computing power resources during the format unification process. The specific sub-steps are as follows:
[0013] S21. Based on the multi-source data in different formats within the synchronous multi-source data packets, calibrate the data capacity associated with the multi-source data in different formats as R k , where k represents different formats, and randomly select a group of formats as the format to be converted Dz from the determined several different formats k;
[0014] Determine the conversion rate during the conversion from other formats to the format to be converted Dz from the historical completed data, determine the minimum value and the maximum value from the confirmed conversion rates, and lock its rate interval;
[0015] S22. Based on the data capacity R of other formats k and the determined rate interval, lock its time interval, and its time = R k÷ Conversion rate, confirm each group of time intervals associated with the format Dz to be converted one by one, and lock the set of time intervals belonging to this Dz;
[0016] Then, in the same way, take any one of the other formats as the format Dz to be converted, and so on, to confirm the set of time intervals corresponding to the format Dz to be converted;
[0017] S23. Based on the different sets of time intervals determined for different formats to be converted, take the maximum value of the time in the set of time intervals as the characteristic value of this set, select the minimum value from the different characteristic values confirmed by different sets of time intervals, take the format to be converted confirmed by the minimum characteristic value as the execution format, and convert the multi-source data of other formats to the execution format. The multi-source data in the same format as this execution format is not converted;
[0018] S24. Based on the confirmed execution format, confirm the time intervals confirmed when converting other formats to the execution format, and determine the intermediate value Zq of its time interval, where q represents different time intervals. Then, perform ratio processing on several intermediate values Zq to determine the ratio characteristic sequence. Based on this ratio characteristic sequence, evenly divide the original computing power resources so that each conversion process can be allocated corresponding conversion computing power, and execute the conversion process;
[0019] Step 3. Based on the different computing power resources allocated for each different conversion process, confirm the conversion initial velocity associated with each different conversion process, confirm its velocity interval range, and then monitor the conversion rate during subsequent different conversion processes in real time. Based on the rate results of the real-time monitoring, mark the conversion data with anomalies. The specific sub-steps are as follows:
[0020] S31. Based on the conversion process executed in real time, confirm the conversion initial velocity of its corresponding conversion process, and calibrate it as Vq, where q represents different conversion processes. Based on this Vq, determine a set of monitoring ranges, and its monitoring range is: [Vq - Y1, Vq + Y1], where Y1 is a preset fluctuation value;
[0021] S32. Based on the conversion rate of the conversion process under real-time monitoring, generate a rate change curve corresponding to the conversion process in real time, and based on the determined monitoring range [Vq - Y1, Vq + Y1], identify whether the rate parameters associated with the rate change curve generated in real time all belong to [Vq - Y1, Vq + Y1]. If they do, continue monitoring; if not, move this monitoring range up and down. During the movement, the position of Vq within this monitoring range changes. During the movement, make the rate change curve fall within this monitoring range. When Vq is an endpoint value within the monitoring range, label this type of monitoring range as an extreme value range. When the conversion rate under real-time monitoring does not belong to the monitoring range or the extreme value range, label the corresponding conversion period as an abnormal period, and label the conversion data associated with this abnormal period as abnormal conversion data;
[0022] Step Four. Based on the confirmed abnormal conversion data, confirm the original format data associated with this abnormal conversion data, and then, based on the original format data and the capacity ratio between different byte data within the abnormal conversion data, evaluate whether this abnormal conversion data is missing. The specific method is as follows:
[0023] S41. Based on the determined abnormal conversion data, confirm the original format data before the conversion of this abnormal conversion data. Based on the relevant bytes within the abnormal conversion data, confirm the capacity of each byte data, and according to the relationship from front to back, process the ratios of the confirmed capacities to determine an abnormal ratio sequence;
[0024] Then, based on the relevant bytes within the original format data, confirm the capacity of each byte data, and according to the relationship from front to back, process the ratios of the confirmed capacities to confirm an original format ratio sequence;
[0025] S42. Identify whether the abnormal ratio sequence is consistent with the original format ratio sequence. If they are not completely consistent, it means that this abnormal conversion data is missing, and directly label this abnormal conversion data as abnormal missing data and directly display it;
[0026] If the abnormal ratio sequence is completely consistent with the original format ratio sequence, no processing is performed, indicating that this abnormal conversion data is not missing.
[0027] The present invention provides an information supervision synchronization method based on multi-source data. Compared with the prior art, it has the following beneficial effects:
[0028] The present invention confirms the frequencies of multi-source data from different sources, synchronizes relevant data belonging to the same batch of frequencies, determines corresponding synchronization data packets, and then, for different synchronization data packets, based on the conversion rate during the data format conversion process and the reasonable allocation of computing resources, unifies the formats inside the corresponding synchronization data packets. During the format unification process, the conversion logics executed by each different data packet are not the same. For each different synchronization data packet, its conversion rate can be fully guaranteed, its corresponding conversion time can be fully reduced, and a better data conversion effect can be achieved;
[0029] For the corresponding conversion process, after the computing power is allocated, confirm its original conversion rate, and then confirm the relevant monitoring range based on the original conversion rate. Moreover, this monitoring range can float up and down. During the subsequent rate monitoring process, based on the confirmed monitoring range, abnormal data can be effectively confirmed, and the abnormal data can be confirmed in real time during the conversion process to achieve a better data supervision effect;
[0030] For abnormal data, check the byte capacity inside the data. Based on the check result, confirm whether such data is missing, which can achieve a better data analysis effect and facilitate subsequent relevant operators to process such abnormal data. Brief Description of the Drawings
[0031] Figure 1 is a schematic diagram of the method flow of the present invention;
[0032] Figure 2 is a schematic diagram of the change of the monitoring range of the present invention. Detailed Embodiment
[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
[0034] Embodiment 1
[0035] Please refer to Figure 1 , this application provides an information supervision and synchronization method based on multi-source data, including the following steps:
[0036] Step 1: Based on the source ports of different multi-source data, determine the update frequencies of different source ports. Then, taking the current moment as the calibration moment, determine the synchronized multi-source data packets for the multi-source data with associated calibrations. The synchronized multi-source data packets include the multi-source data of all source ports with associations, that is, there are different multi-source data packets in each different time period. Due to different update frequencies, the number of different multi-source data included in each different multi-source data packet may be different;
[0037] Among them, the specific method for determining the synchronized multi-source data packets is as follows:
[0038] S11: Based on the source port of the corresponding multi-source data, determine the update frequency Pi of the corresponding source port for generating the corresponding multi-source data, where i represents different source ports; i , where i represents different source ports;
[0039] S12: Based on the multi-source data with associated calibrations, the associated calibrations are pre-calibrated by the operator and can be directly calibrated within the source port. Mark several source ports associated with the multi-source data as pending ports. Based on the different update frequencies Pi determined for different pending ports, taking the current moment as the calibration moment, generate an update timeline belonging to the corresponding pending port. The time difference between the initial moment and each subsequent adjacent update time point within the update timeline is Pi; i , taking the current moment as the calibration moment, generate an update timeline belonging to the corresponding pending port, and the time difference between the initial moment and each subsequent adjacent update time point within the update timeline is Pi; i ;
[0040] Take the pending port with the maximum update frequency Pi i as the main port, and take the update timeline associated with the main port as the main timeline. The initial moment within the update timeline is also marked as an update time point;
[0041] S13: According to the specific time period (C1, C2] between adjacent update time points of the main timeline, where C1 is the initial moment of the specific time period and C2 is the end moment of the specific time period, mark the update time points within other update timelines that belong to this specific time period as subsidiary update points. According to the confirmed specific time period (C1, C2] and the confirmed subsidiary update points, integrate the data updated by the main port within this specific time period and the data updated by the subsidiary update points to confirm the synchronized multi-source data packet belonging to this specific time period. Similarly, for subsequent adjacent update time points within the main timeline, a group of synchronized multi-source data packets will be confirmed;
[0042] Example: Suppose there are three source ports A, B, and C. The update frequency of A is once every 5 seconds, the update frequency of B is once every 10 seconds, and the update frequency of C is once every 15 seconds. Then the C source port belongs to the master port. Determine the timelines of its three source ports. Suppose the current moment is the calibration moment 0. Then the update timeline for the master port is: 0 - 15 - 30 - 45 - 60 - ……, the update timeline for A is: 0 - 5 - 10 - 15 - 20 - ……, and the update timeline for B is: 0 - 10 - 20 - 30 - ……. Then, first determine the first set of specific time periods (0, 15] based on port A. The subsidiary time points belonging to the first specific time period (0, 15] are: 5, 10, 15. Then there are four subsidiary data packets in this time period, three of which belong to A and one belongs to B, which is the data packet corresponding to the time point 10. The second specific time period is (15, 30], and the subsidiary time points are: 20, 25, 30. Then there are five subsidiary data packets in this specific time period, three of which belong to A and two belong to B;
[0043] Step 2: Based on the determined synchronous multi-source data packets, by determining the data capacity of different format data in each different synchronous multi-source data packet, specifically confirm the format conversion logic. Then, based on the confirmed specific format conversion logic, unify the formats in the synchronous multi-source data packets, and reasonably allocate computing power resources during the format unification process to maintain synchronization during the format unification process. Among them, the specific sub-steps for unifying the formats in the synchronous multi-source data packets are:
[0044] S21: Based on the multi-source data of different formats in the synchronous multi-source data packets, label the data capacity associated with the multi-source data of different formats as R k , where k represents different formats. Based on the determined several different formats k, randomly select a group of formats as the format to be converted Dz;
[0045] From the historical completed data, determine the conversion rate during the conversion of other formats to the format to be converted Dz, determine the minimum value and the maximum value from the confirmed conversion rates, and lock its rate interval;
[0046] S22: Based on the data capacity R of other formats k and the determined rate interval, lock its time interval, where time = R k ÷ conversion rate. Confirm each group of time intervals associated with this format to be converted Dz one by one, and lock the set of time intervals belonging to this Dz;
[0047] Then, use the same method to take any format in other formats as the format to be converted Dz, and so on, to confirm the set of time intervals corresponding to the format to be converted;
[0048] S23. Based on the different sets of time intervals determined for different formats to be converted, take the maximum time value within the set of time intervals as the eigenvalue of this set. For example, if the set of time intervals is {[1,3], [2,4], [1,6], [2,5]}, then the maximum time value within this set of time intervals is 6. Therefore, 6 belongs to the eigenvalue of this set. Select the minimum value from the different eigenvalues confirmed from different sets of time intervals, and take the format to be converted corresponding to the minimum eigenvalue as the execution format. Convert the multi-source data in other formats to the execution format, and do not convert the multi-source data in the same format as the execution format;
[0049] S24. Based on the confirmed execution format, confirm the time intervals determined when converting other formats to the execution format, and determine the intermediate value Zq of its time interval, where q represents different time intervals. Then perform ratio processing on several intermediate values Zq to determine the ratio feature sequence. Based on this ratio feature sequence, evenly divide the original computing power resources so that each conversion process can be allocated the corresponding conversion computing power, and execute the conversion process to ensure the synchronization during the format unification process. For example, if the confirmed execution format is format C, then the multi-source data in formats A and B will be converted to format C. During the conversion process, the corresponding time intervals have been determined. Suppose the time interval determined for A is [2, 8], and the time interval determined for B is [3, 6]. Among them, the intermediate value Zq of A is 5, and the intermediate value Zq of B is 3.5. Then the ratio feature sequence determined between A and B is 5:3.5 = 10:7. If the original computing power resources are a determined value, first classify this computing power into 17 parts. Then when A executes the conversion process, the computing power resources it can hold are 10 parts, and the computing power resources that B can hold are 7 parts. In this way, it is ensured that during the synchronous conversion process, the synchronization during the data format conversion can be effectively guaranteed;
[0050] Step 3. Based on the different computing power resources allocated for each different conversion process, confirm the initial conversion speed associated with each different conversion process, confirm its speed range, and then monitor the conversion rate during subsequent different conversion processes in real time. Based on the rate results of the real-time monitoring, mark the conversion data with anomalies to ensure the accuracy of the data during the conversion process. Specifically, in the actual conversion process, because the conversion logics executed by each different format conversion process are different, it is easy to cause process interference during the synchronous conversion process. When the interference persists and is strong, it is very easy to cause corresponding anomalies in the data during the conversion. Therefore, relevant verifications are required. Among them, the specific sub-steps for marking the conversion data with anomalies are as follows:
[0051] S31. Based on the conversion process executed in real time, confirm the initial conversion speed of its corresponding conversion process and calibrate it as Vq, where q represents different conversion processes. Based on this Vq, determine a set of monitoring ranges, and its monitoring range is: [Vq - Y1, Vq + Y1], where Y1 is a preset fluctuation value, and its specific value is determined by the operator in advance according to experience;
[0052] S32. Based on the conversion rate of the conversion process monitored in real time, generate a rate change curve of the corresponding conversion process in real time, and based on the determined monitoring range [Vq - Y1, Vq + Y1], identify whether the rate parameters associated with the rate change curve generated in real time all belong to [Vq - Y1, Vq + Y1]. If so, continue to monitor. If not, move this monitoring range up and down. During the movement, the position of Vq in this monitoring range changes. Vq may change to the maximum value of this monitoring range or the minimum value of this monitoring range. The numerical range of this monitoring range remains unchanged, and Vq also belongs to this monitoring range. Then the manifestation form of the monitoring range where Vq belongs to the maximum value is: [Vq - 2Y1, Vq], and the manifestation form of the monitoring range where Vq belongs to the minimum value is: [Vq, Vq + 2Y1]. During the movement, make the rate change curve belong to this monitoring range. When Vq belongs to the end value in the monitoring range, calibrate this monitoring range as the extreme value range. When the conversion rate monitored in real time does not belong to the monitoring range or the extreme value range, calibrate the corresponding conversion period as an abnormal period, and calibrate the conversion data associated with this abnormal period as abnormal conversion data;
[0053] Specifically, combined with Figure 2 , first move up or down a distance Y1 based on the determined Vq, where Y1 is a preset value. After numerical translation, the corresponding monitoring range can be confirmed. From Figure 2 the data trend of the rate change curve in, it can be clearly known that the original monitoring range cannot cover the generated rate change curve, that is, the trend of the rate change curve has exceeded the monitoring range, but the overall change amplitude does not exceed the range value of the corresponding monitoring range. Then this monitoring range can be adjusted upward. Based on the corresponding upward adjustment direction, determine the adjusted monitoring range. The lowest value of the adjusted monitoring range is Vq. Then after the monitoring range is adjusted upward, the rate change curve can be made to belong to the corresponding monitoring range, so as to ensure that the monitoring range can give priority to monitoring the rate change curve, so as to determine whether there is an abnormal situation in the corresponding conversion data. The upward adjustment direction is not limited here, and it can also be adjusted downward, and there is also a corresponding downward adjustment direction;
[0054] Step 4: Based on the confirmed abnormal conversion data, confirm the original format data associated with this abnormal conversion data, and then, based on the original format data and the capacity ratio between different byte data in the abnormal conversion data, evaluate whether this abnormal conversion data is missing. The specific sub-steps for evaluation are as follows:
[0055] S41: Based on the determined abnormal conversion data, confirm the original format data before conversion of this abnormal conversion data (the original format data is converted into the abnormal conversion data after format conversion). Based on the relevant bytes in the abnormal conversion data, confirm the capacity of each byte data, and according to the front-to-back relationship, process the ratios of the confirmed several capacities to determine the abnormal ratio sequence;
[0056] Then, based on the relevant bytes inside the original format data, confirm the capacity of each byte data, and according to the front-to-back relationship, process the ratios of the confirmed several capacities to confirm the original format ratio sequence;
[0057] S42: Identify whether the abnormal ratio sequence is consistent with the original format ratio sequence. If they are exactly the same, no processing is required, indicating that during format conversion of this type of data, due to data congestion or other reasons, the data conversion rate becomes slower, indicating that this abnormal conversion data is not missing. If they are not exactly the same, it means that this abnormal conversion data is missing, and directly mark this abnormal conversion data as abnormal missing data and directly display it for external personnel to view, so that they can take corresponding measures in a timely manner, facilitating external personnel to supplement such abnormal missing data.
[0058] During the process of format conversion of the data, since there may be multiple conversion processes executed simultaneously, there may be interference between multiple processes. Then, during the conversion of some conversion processes, due to the interference of other processes, the process rate becomes slower, thus corresponding abnormal conversion data will be generated;
[0059] Such abnormal conversion data may be caused by a slower process rate or may be due to missing data, resulting in data anomalies. In order to analyze whether such data is missing or other problems, it is necessary to confirm whether the data is missing, facilitating external personnel to perform relevant processing in a timely manner.
[0060] Some data in the above formula are numerically calculated after removing their dimensions, and the content not described in detail in this specification belongs to the prior art well-known to those skilled in the art.
[0061] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical method of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical method of the present invention.
Claims
1. Information supervision synchronization method based on multi-source data, characterized in that, It includes the following steps: Step 1: Based on the source ports of different multi-source data, determine the update frequencies of different source ports. Then, taking the current moment as the calibration moment, determine the synchronous multi-source data packets for the multi-source data with associated calibrations. The specific method is as follows: S11. Determine the update frequency P at which the corresponding source port generates the corresponding multi-source data based on the source port of the corresponding multi-source data i , where i represents different source ports; S12. Based on multi-source data with associated calibrations, several source ports associated with the multi-source data are calibrated as pending ports, and different update frequencies P are determined based on different pending ports i , taking the current moment as the calibration moment, generate an update timeline belonging to the corresponding pending port, and the time difference between the initial moment and each subsequent adjacent update time point within the update timeline is P i ; Set the update frequency P i Take the undetermined port with the maximum value as the main port, and take the update timeline associated with the main port as the main timeline. The initial moment within its update timeline is also marked as the update time point; S13. According to the specific time period (C1, C2] between adjacent update time points on the main timeline, where C1 is the initial moment of the specific time period and C2 is the end moment of the specific time period, mark the update time points within this specific time period in other update timelines as subsidiary update points. Based on the confirmed specific time period (C1, C2] and the confirmed subsidiary update points, integrate the data updated by the main port within this specific time period and the data updated by the subsidiary update points to confirm the synchronous multi-source data packets belonging to this specific time period. Similarly, for subsequent adjacent update time points on the main timeline, a set of synchronous multi-source data packets will be confirmed; Step 2: Based on the determined synchronous multi-source data packets, specifically confirm the format conversion logic by determining the data capacities of different format data in each different synchronous multi-source data packet. Then, based on the confirmed specific format conversion logic, unify the formats in the synchronous multi-source data packets and reasonably allocate computing power resources during the format unification process; Step 3: Based on the different computing power resources allocated to each different conversion process, confirm the initial conversion speed associated with each different conversion process, confirm its speed range, and then monitor the conversion rates during subsequent different conversion processes in real time. Based on the rate results of the real-time monitoring, mark the abnormal conversion data; Step 4: Based on the confirmed abnormal conversion data, confirm the original format data associated with this abnormal conversion data. Then, based on the capacity ratio between the original format data and the different byte data in the abnormal conversion data, evaluate whether this abnormal conversion data is missing.
2. The information supervision synchronization method based on multi-source data according to claim 1, wherein In the above Step 2, the specific sub-steps for unifying the formats in the synchronous multi-source data packets are as follows: S21. Based on the multi-source data in different formats within the synchronous multi-source data packet, calibrate the data capacity associated with the multi-source data in different formats as R k , where k represents different formats. Based on a number of determined different formats k, randomly select a set of formats as the format to be converted Dz Determine the conversion rate during the conversion from other formats to the target format Dz from the historical completed data. Determine the minimum value and the maximum value from the confirmed conversion rates and lock its rate range; S22. Based on the data capacity R of other formats k and the determined rate range, lock its time range, where the time = R k ÷ conversion rate, and confirm one by one the several groups of time ranges associated with the format Dz to be converted, and lock the set of time ranges belonging to this Dz; Then, use the same method to take any one of the other formats as the target format Dz, and so on, to confirm the set of time intervals corresponding to the target formats; S23. Based on the different sets of time intervals determined for different target formats, take the maximum value of the time in the set of time intervals as the characteristic value of this set. Select the minimum value from the different characteristic values confirmed from different sets of time intervals. Take the target format corresponding to the minimum characteristic value as the execution format, and convert the multi-source data of other formats to the execution format. The multi-source data in the same format as the execution format will not be converted; S24. Based on the confirmed execution format, confirm the time interval confirmed during the conversion from other formats to the execution format, and determine the median value Zq of this time interval, where q represents different time intervals. Then, perform a ratio process on several median values Zq to determine the ratio feature sequence. Based on this ratio feature sequence, evenly divide the original computing power resources so that each conversion process can be allocated the corresponding conversion computing power, and execute the conversion process.
3. The information supervision synchronization method based on multi-source data according to claim 1, characterized in that In the third step mentioned above, the specific sub-steps for marking the abnormal conversion data are as follows: S31. Based on the conversion process executed in real time, confirm the initial conversion speed of its corresponding conversion process, and calibrate it as Vq, where q represents different conversion processes. Based on this Vq, determine a set of monitoring ranges, and its monitoring range is: [Vq - Y1, Vq + Y1], where Y1 is a preset fluctuation value; S32. Based on the conversion rate of the conversion process monitored in real time, generate the rate change curve of the corresponding conversion process in real time, and based on the determined monitoring range [Vq - Y1, Vq + Y1], identify whether the rate parameters associated with the rate change curve generated in real time all belong to [Vq - Y1, Vq + Y1]. If so, continue to monitor. If not, move this monitoring range up and down. During the movement, the position of Vq in this monitoring range changes. During the movement, make the rate change curve belong to this monitoring range. When Vq belongs to the endpoint value within the monitoring range, mark this monitoring range as the extreme value range. When the conversion rate monitored in real time does not belong to the monitoring range or the extreme value range, mark the corresponding conversion period as an abnormal period, and mark the conversion data associated with this abnormal period as abnormal conversion data.
4. The information supervision synchronization method based on multi-source data according to claim 3, wherein In the fourth step mentioned above, the specific method for evaluating whether this abnormal conversion data is missing is as follows: S41. Based on the determined abnormal conversion data, confirm the original format data of this abnormal conversion data before conversion. Based on the relevant bytes in the abnormal conversion data, confirm the capacity of each byte of data, and perform a ratio process on the confirmed several capacities according to the front-to-back relationship to determine the abnormal ratio sequence; Then, based on the relevant bytes inside the original format data, confirm the capacity of each byte of data, and perform a ratio process on the confirmed several capacities according to the front-to-back relationship to confirm the original format ratio sequence; S42. Identify whether the abnormal ratio sequence is consistent with the original format ratio sequence. If they are not completely consistent, it means that this abnormal conversion data is missing, and directly mark this abnormal conversion data as abnormal missing data and directly display it.
5. The information supervision synchronization method based on multi-source data according to claim 4, wherein In step S42 mentioned above, if the abnormal ratio sequence is completely consistent with the original format ratio sequence, no processing is performed, indicating that this abnormal conversion data is not missing.
Citation Information
Patent Citations
Data element information synchronization method and device based on multiple data sources of Internet of Vehicles
CN117149876A
Real-time e-government affair platform based on big data processing
CN119179736A