Data driving processing method and device based on standard digitization

Through standard digital preprocessing and classification analysis of data acquisition equipment, the problem of low accuracy caused by a single data-driven processing method is solved, efficient and accurate processing and optimization of data is achieved, and data utilization efficiency is improved.

CN118916356AInactive Publication Date: 2024-11-08CHINA NAT INST OF STANDARDIZATION
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202410964031.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-18
Publication Date
2024-11-08
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

In the existing data-driven processing technology, the driving processing method is single, resulting in the results deviating from the standard range, low accuracy, and reducing the data utilization efficiency.

Method used

Data acquisition and standardized digital preprocessing are carried out through data acquisition equipment, classification and analysis of the impact value of evidence for evidence equipment, comparison with preset definition values, and driving optimization prompts to ensure that the data is maintained at the same level and improve data accuracy and utilization efficiency.

Benefits of technology

It realizes automated preprocessing of data and real-time classification response processing, improves the accuracy and efficiency of data-driven processing, saves labor costs, and improves the quality of data storage and utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118916356A_ABST
    Figure CN118916356A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of data driving processing, and particularly discloses a data driving processing method and device based on standard digitization, and the method comprises the steps: carrying out the data collection through data collection equipment, extracting initial collection data, and carrying out the standard digitization preprocessing operation on the initial collection data, can save the manpower processing cost, and improves the processing efficiency. The method comprises the following steps: preprocessing initial acquisition data, ensuring that the data are maintained at the same level, performing data classification on the preprocessed initial acquisition data, obtaining more accurate various forensic data through real-time data classification response processing, analyzing forensic equipment influence values of the various forensic data, and improving forensic efficiency. According to the invention, a reference data basis can be provided for subsequent driving optimization prompting of the evidence obtaining data, and finally the accuracy of data driving processing is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of data-driven processing, and in particular to a data-driven processing method and device based on standard digitization. Background Art

[0002] With the development of Internet technology, a large amount of structured and unstructured data has been generated. Through data-driven processing, data can be automatically cleaned to save labor processing costs, and the quality of data utilization can be improved by responding to changes in real time. At the same time, data can be maintained at the same level through standard digital processes, thereby improving data utilization efficiency.

[0003] For example, the invention patent with announcement number CN117807102B announces a data-driven database update method and system, which involves the field of data set processing and application technology. The method includes: configuring a mirror port for each data source, and establishing a communication link between the mirror port and the edge server; each data source performs data-driven messaging, reports the first message data to the background server, and stores it in the database to obtain the message data set of each data source; through the mirror port, the second message data generated by the updated data drive is reported to the data center deployed on the edge server; the AI ​​data change detection model pre-deployed in the data center performs data-driven change detection on the second message data to determine whether there is a data-driven change between it and the first message data. If so, the first message data is replaced with the new data-driven second message data to update the database. It can improve the efficiency of database updates when data is driven.

[0004] For example, the invention patent with announcement number CN106503217B announces a business-driven data interaction device and method, and the data interaction device includes: an information preset processing module receives external input data, and when the publish / subscribe model recommended to the user is not applicable to the external input data, verifies whether the external input data complies with the preset data entry rules; when the publish / subscribe model recommended to the user is applicable to the external input data, verifies whether the external input data complies with the preset data entry rules and temporarily stores the external input data; the document translation module translates the common field information in the external input data into coded data that can be recognized by the data interaction device; the data filtering module filters the translated coded data; the conversion strategy module distributes the filtered coded data to the extension interfaces in different fields to realize data interaction, which can achieve data interaction between different systems, reduce development difficulty, improve the efficiency of data interaction, and enhance the stability of the system.

[0005] Combining the above technical solutions, it is found that in the current data-driven technical solutions, in most cases, the collected data is directly driven and processed. At the same time, since the driving processing method is relatively single, the driving processing result will deviate from the standard range, resulting in low accuracy of the driving processing result and reduced data utilization efficiency. Summary of the invention

[0006] In view of the deficiencies of the prior art, the present invention provides a data-driven processing method and device based on standard digitization, which can effectively solve the problems involved in the above-mentioned background technology.

[0007] To achieve the above objectives, the present invention is implemented through the following technical solutions: The first aspect of the present invention provides a data-driven processing method based on standard digitization, including: step one, data acquisition is performed through a data acquisition device, initial acquisition data is extracted, and standard digitization preprocessing operations are performed, and the preprocessed initial acquisition data is recorded as analyzable data, and stored in a temporary storage bin; step two, data classification is performed on the analyzable data in the temporary storage bin through various types of forensic equipment to obtain various types of forensic data, thereby analyzing the forensic equipment impact values ​​of various types of forensic data; step three, the forensic equipment impact values ​​of various types of forensic data are compared with the forensic equipment impact limit values ​​preset in the data-driven library, and the various types of forensic data corresponding to the forensic equipment impact values ​​greater than the preset forensic equipment impact limit values ​​are counted, and drive optimization prompts are given to various types of forensic data.

[0008] As a further method, the standard digitization preprocessing operation is performed, and the preprocessed initial collected data is recorded as analyzable data. Specifically, the standard digitization preprocessing operation is performed on the initial collected data through a data processing unit in a data acquisition device; the standard digitization preprocessing operation specifically includes standard formatting of the initial collected data, thereby obtaining the standard formatted initial collected data, which is recorded as standard digitized initial collected data; the standard digitized initial collected data is preprocessed, wherein the preprocessing operation includes removing duplicate items, filling missing values, and correcting erroneous items, and finally the preprocessed standard digitized initial collected data is obtained, which is recorded as analyzable data.

[0009] As a further method, the storage is in a temporary storage warehouse, and the specific process is:

[0010] The data acquisition device sends the analyzable data through the wireless communication module, and the temporary storage bin receives the analyzable data through the wireless communication module and stores the analyzable data in the temporary storage bin.

[0011] As a further method, the various types of forensic equipment classify the analyzable data in the temporary storage warehouse to obtain various types of forensic data. Specifically, the various types of forensic equipment are connected to the temporary storage warehouse via a wireless communication module, and based on the data classification unit of the various types of forensic equipment, the analyzable data in the temporary storage warehouse are classified, and the classified analyzable data is synchronously stored in the various types of forensic equipment through the wireless communication module, thereby obtaining the classified analyzable data in the various types of forensic equipment, which are recorded as various types of forensic data.

[0012] As a further method, the forensic equipment impact value of each type of forensic data is specifically formulated as follows:

[0013]

[0014] In the formula, FC g is the impact value of the forensic equipment for the g-type forensic data, TQ g gf is the first forensic device impact index of the g-type forensic device. 1 DAI is the weight factor of the first forensic device impact index preset in the data-driven library. g gf is the second forensic device impact index of the g-type forensic device. 2 is the weight factor of the second forensic device influence index preset in the data-driven library, e is a natural constant, g is the serial number of each type of forensic data, g=1,2,3,...,r, r is the total number of forensic data categories.

[0015] As a further method, the driver optimization prompts for various types of forensic data are provided, and the specific process is as follows:

[0016] The forensic device impact value of each type of forensic data is compared with the forensic device impact limit value preset in the data-driven library. If the forensic device impact value of a certain type of forensic data is greater than the preset forensic device impact limit value, then this type of forensic data is recorded as data requiring optimization prompts. Thus, various types of forensic data corresponding to the forensic device impact value greater than the preset forensic device impact limit value are counted and recorded as various types of prompt data requiring optimization, and drive optimization prompts for various types of prompt data requiring optimization.

[0017] The second aspect of the present invention provides an apparatus for a data-driven processing method based on standard digitalization, comprising: a data acquisition device, a wireless communication module, a data publishing channel, a temporary storage bin, and a forensic device; the data acquisition device is used to call the wireless communication module through the data acquisition module in the data acquisition device to collect the publishing data set in the data publishing channel, which is recorded as the initial collected data; the temporary storage bin is used to receive the initial collected data after preprocessing operations in the data acquisition device through the wireless communication module, which is recorded as analyzable data; the forensic device is used to connect to the temporary storage bin through the wireless communication module, and classify the analyzable data in the temporary storage bin based on the data classification unit of the forensic device, and the classified data is stored in the forensic device.

[0018] Compared with the prior art, the embodiments of the present invention have at least the following advantages or beneficial effects:

[0019] (1) The present invention provides a data-driven processing method and device based on standard digitalization. First, the initial collected data is automatically preprocessed to save labor processing costs, and the initial collected data after preprocessing is classified. Through real-time data classification response processing, more accurate forensic data of various types can be obtained, and the forensic equipment impact value of various types of forensic data can be analyzed, thereby providing driving optimization prompts for the forensic data, which can ultimately improve the accuracy of data-driven processing.

[0020] (2) The present invention collects data through data collection equipment, extracts initial collected data, and performs standard digital preprocessing operations, which can ensure that the data is maintained at the same level, record the preprocessed initial collected data as analyzable data, and store it in a temporary storage warehouse, which can improve the storage and utilization efficiency of data.

[0021] (3) The present invention classifies the analyzable data in the temporary storage bin through various types of forensic equipment, that is, through the diversification of data-driven processing methods, various types of forensic data are obtained, thereby analyzing the forensic equipment impact values ​​of various types of forensic data and comparing them with the forensic equipment impact limit values ​​preset in the data-driven library. This can provide a reference data basis for subsequent driving optimization prompts for the forensic data, thereby ultimately improving the quality of data utilization. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The present invention is further described using the accompanying drawings, but the embodiments in the accompanying drawings do not constitute any limitation to the present invention. A person skilled in the art can obtain other drawings based on the following drawings without creative work.

[0023] Figure 1 The figure is a schematic flow chart of the method steps of the present invention.

[0024] Figure 2 It is a schematic diagram of the data collection process involved in the present invention.

[0025] Figure 3 This is a schematic diagram of storing analyzable data involved in the present invention in a temporary storage warehouse.

[0026] Figure 4 This is a schematic diagram of the data classification process involved in the present invention.

[0027] Figure 5 This is a diagram of the data driven processing structure involved in the present invention.

[0028] Figure numerals: 1. Data acquisition equipment, 2. Wireless communication module, 3. Data release channel, 4. Temporary storage warehouse, 5. Evidence collection equipment. DETAILED DESCRIPTION

[0029] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0030] Reference Figure 1 As shown, the first aspect of the present invention provides a data-driven processing method based on standard digitization, including: step one, collecting data through a data acquisition device, extracting initial collected data, performing standard digitization preprocessing operations, recording the preprocessed initial collected data as analyzable data, and storing it in a temporary storage bin.

[0031] Specifically, the data acquisition device performs data acquisition and extracts initial acquisition data. The specific process is as follows:

[0032] Based on the data acquisition module in the data acquisition device, the wireless communication module is called through the data acquisition module to adaptively collect the release data sets of each data release channel within the data collection cycle, and the data sets are recorded as initial collection data.

[0033] It should be explained that the above-mentioned data acquisition equipment refers to hardware equipment used to collect, monitor and transmit data, which is widely used in industrial production, scientific research, judicial system, environmental monitoring, smart home and other fields. The types of data acquisition equipment include but are not limited to data integration platforms, cloud data aggregation services, sensors, instrumentation equipment, wireless radio frequency identification equipment, cameras and image acquisition equipment, etc. In this example, data is extracted from different sources through the specific ETL (Extract-Transform-Load) tool in the data integration platform; the data acquisition module refers to the E (extraction) stage in the ETL (Extract-Transform-Load) tool, which is used to extract raw data from various external data sources. Its types include but are not limited to database connectors, file readers, etc. In this example, the database connector is the key component for data extraction; the wireless communication module refers to the part used to process wireless signal transmission in the communication system, and its types include but are not limited to wireless transceivers, radio frequency modules, Bluetooth modules, Internet of Things communication modules, etc. In this example, the Internet of Things communication module is used as a method of data transmission communication.

[0034] It is further necessary to explain that the above-mentioned wireless communication module adaptively collects the published data sets of each data publishing channel within the data collection cycle, wherein the adaptive collection means that the ETL (extract-transform-load) tool can automatically adjust its data collection strategy and method according to the changes in the data publishing channel and format; each data publishing channel means a channel for data generation, storage or sharing, and its types include but are not limited to databases, file systems, network services, APIs, social media, and Internet of Things devices; the data collection cycle means the time period from when the ETL (extract-transform-load) tool starts to collect data to when it ends to collect data, and the size of the time period will change with the extraction performance of the ETL (extract-transform-load) tool, the signal strength of the Internet of Things communication module and other influencing factors, and the ETL (extract-transform-load) tool can determine the data collection cycle by parsing the timestamp of the data change; in this example, only one data collection device is set, and other data collection devices can perform data collection operations in the above manner, which is not limited in this example.

[0035] It should be explained that the above-mentioned initial collected data is the sum of the data sets released by each data release channel during the data collection cycle.

[0036] In this example, the data collection process is as follows: Figure 2 As shown, based on the data acquisition module in the data acquisition device 1, that is, the E (extraction) stage in the ETL (extraction-transformation-load) tool, the wireless communication module 2, that is, the Internet of Things communication module, adaptively collects the release data sets of each data release channel 3 within the data collection cycle; through the above Figure 2It can be found that since the ETL (Extract-Transform-Load) tool in this example occupies a large memory space, even if there are multiple data publishing channels, the data collected can be transmitted to the ETL (Extract-Transform-Load) tool in the end, thereby reducing the risk of subsequent data transmission and conversion, which is beneficial to the data-driven processing process.

[0037] Furthermore, the standard digital preprocessing operation is performed to record the preprocessed initial collected data as analyzable data, specifically, the standard digital preprocessing operation is performed on the initial collected data by a data processing unit in the data acquisition device.

[0038] It should be explained that the above-mentioned data processing unit represents the T (transformation) stage in the ETL (extract-transform-load) tool, and its function is to transform the original data into a clean, consistent and easy-to-analyze form that meets business needs. This is the core link in the ETL (extract-transform-load) tool and can provide high-quality data input for subsequent loading steps.

[0039] The standard digital preprocessing operation specifically includes standard formatting of the initial collected data, which makes the initial collected data more comparable between different sources through the data standardization function within the data processing unit.

[0040] Thus, the initial collected data after standard formatting is obtained, which is recorded as the standard digitized initial collected data.

[0041] The standard digitized initial acquisition data is preprocessed, wherein the preprocessing operation includes removing duplicate items, filling missing values, and correcting erroneous items, and finally the preprocessed standard digitized initial acquisition data is obtained, which is recorded as analyzable data.

[0042] It should be explained that the above-mentioned preprocessing operation is to remove invalid, duplicate, missing and erroneous data from the standard digital initial collection data through the data cleaning function within the data processing unit to ensure data quality; if this example sets an additional data application field, such as the judicial system field, the data processing unit can remove a series of data irrelevant to the judicial system according to the set rules of the judicial system field, and only save the data sets related to the judicial system, thereby improving the efficiency of data processing; at the same time, if this example needs to merge data from multiple data release channels, the data integration function within the data processing unit can be used to eliminate data redundancy and ultimately ensure data consistency.

[0043] Specifically, the storage in a temporary storage warehouse is as follows:

[0044] The data acquisition device sends the analyzable data through the wireless communication module, and the temporary storage bin receives the analyzable data through the wireless communication module, so that the analyzable data is stored in the temporary storage bin.

[0045] It should be explained that the above-mentioned data acquisition device sends the analyzable data, and the temporary storage warehouse receives the analyzable data, all through the same type of wireless communication module.

[0046] It is further necessary to explain that the temporary storage warehouse is a container for storing intermediate data during the data processing process. Its function is to cache data, reduce frequent access to the original data source, and help control the data flow, such as batch processing, to avoid pausing the entire process due to blocking of a single step, thereby optimizing the performance and efficiency of data processing.

[0047] The specific process of storing the above analyzable data in the temporary storage warehouse is as follows: Figure 3 As shown, the data acquisition device 1 sends analyzable data through the wireless communication module 2, and the temporary storage bin 4 receives the analyzable data through the wireless communication module 2. The sending and receiving processes of the above data are performed synchronously, which can ensure the transmission quality of the data.

[0048] In a specific embodiment, the present invention collects data through a data acquisition device, extracts initial collected data, and performs standard digital preprocessing operations to ensure that the data is maintained at the same level. The preprocessed initial collected data is recorded as analyzable data and stored in a temporary storage warehouse, which can improve data storage utilization efficiency.

[0049] Step 2: Classify the analyzable data in the temporary storage bin through various types of forensic equipment to obtain various types of forensic data, thereby analyzing the forensic equipment impact value of each type of forensic data.

[0050] Specifically, the various types of forensic equipment classify the analyzable data in the temporary storage warehouse to obtain various types of forensic data. Specifically, the various types of forensic equipment are connected to the temporary storage warehouse through the wireless communication module, and based on the data classification unit of the various types of forensic equipment, the analyzable data in the temporary storage warehouse are classified, and the analyzable data after data classification is synchronously stored in the various types of forensic equipment through the wireless communication module, thereby obtaining the analyzable data after data classification in the various types of forensic equipment, which are recorded as various types of forensic data.

[0051] In this example, if the application field is set to the judicial system field, the above-mentioned types of evidence collection equipment are divided according to the field type of the judicial system. The types of evidence collection equipment include but are not limited to law enforcement recorders, surveillance cameras, and mobile phone evidence collection equipment. The divided data types include but are not limited to case data, judicial files, court records, judicial statistics, and court announcements. For example, if the evidence collection equipment is a law enforcement recorder, the divided data types include court records and court announcements. Among them, various types of evidence collection equipment are connected to the temporary storage warehouse through wireless communication modules, which can realize real-time data transmission and ensure that the data received by all evidence collection equipment can be synchronized with the temporary storage warehouse in a timely and complete manner to avoid data loss or inconsistency. Data classification unit The element is a data classification function built into the forensic device. For example, when the forensic device is a law enforcement recorder, its data classification unit is a built-in event detection algorithm, which identifies and marks key events in law enforcement activities, such as the start of law enforcement, the end of law enforcement, conversations, warnings, conflicts, etc., so as to distinguish different types of judicial data and obtain court records and court announcements classified by the law enforcement recorder; the analyzable data after data classification is synchronously stored in various types of forensic devices through the wireless communication module. Specifically, after various types of forensic devices classify the analyzable data in the temporary storage bin, only analyzable data of the same type is extracted through the wireless communication module as the analyzable data classified by this type of forensic device, which is recorded as various types of forensic data.

[0052] like Figure 4 As shown, it is a schematic diagram of the process of the above-mentioned data classification, that is, various types of evidence collection equipment 5 are synchronously connected to the temporary storage warehouse 4 through the wireless communication module 2, and based on the data classification unit of each type of evidence collection equipment 5, the analyzable data in the temporary storage warehouse 4 is classified, and the analyzable data after data classification is synchronously stored in the various types of evidence collection equipment 5 through the wireless communication module 2. Through the above-mentioned operation, the analyzable data in the temporary storage warehouse can be synchronously and accurately transmitted to the evidence collection equipment, thereby ensuring the integrity and consistency of the data.

[0053] Furthermore, the forensic equipment impact value of each type of forensic data, the specific data acquisition process is:

[0054] The forensic devices to which various types of forensic data belong are counted, indicating that a certain type of forensic data belongs to this type of forensic device, and there is a one-to-one correspondence, which is recorded as various types of forensic devices. The data classification interruption duration of various types of forensic devices within the forensic cycle and the average data transmission rate of various types of forensic devices within the forensic cycle are obtained, wherein the forensic cycle refers to the time period from the start time point to the end time point of the data classification of the forensic device. The specific duration will be determined according to the data classification function of the forensic device and the size of the analyzable data. This example does not make special restrictions. The data classification interruption duration of the above-mentioned various types of forensic devices within the forensic cycle can be extracted through the built-in timestamp of the forensic device to extract the time when the forensic device does not perform data classification within the forensic cycle, which is recorded as the data classification interruption duration. The average data transmission rate of the above-mentioned various types of forensic devices within the forensic cycle can be obtained through the built-in data transmission software of the forensic device to obtain the data transmission rates at multiple time points within the forensic cycle, and the average data transmission rate of various types of forensic devices within the forensic cycle is obtained by average processing.

[0055] The first forensic equipment impact index of each type of forensic equipment is obtained through comprehensive processing. The specific formula is as follows:

[0056]

[0057] Where, TQ g is the first forensic device impact index of the g-th category forensic device. In this example, during the data classification process of the forensic device, the continuity and stability of the process need to be guaranteed. However, if there is a data classification interruption or a fluctuation in the data transmission rate during the data classification process, and the above negative impact is large, it will affect the data classification performance of the forensic device and be unfavorable for subsequent data-driven processing. At the same time, if the data classification of the forensic device is interrupted, the data transmission speed of the forensic device will be stopped or delayed, which is unfavorable for the stability of data transmission. In summary, the data classification process of the forensic device is affected by many factors and needs to be comprehensively processed and analyzed to make the impact of the forensic device more accurate and reliable.

[0058] a 1 The influencing factor corresponding to the unit value of the data classification interruption duration preset in the data-driven library is obtained by fitting the corresponding relationship between the historical operating temperature, ambient temperature change values ​​and the data classification interruption duration in the forensic device, and the fitting curve corresponding to the data classification interruption duration is fitted. The real-time operating temperature and ambient temperature change values ​​are brought into the fitting curve corresponding to the data classification interruption duration to obtain the influencing factor corresponding to the unit value of the data classification interruption duration in this example. At the same time, the value range in this example is (0, 1).

[0059] time gIt is the data classification interruption duration of the g-type forensic device during the forensic cycle, indicating the time period when data classification is interrupted during the data classification process of the forensic device.

[0060] a 2 It is the correction factor corresponding to the average data transmission rate preset in the data-driven library. It is obtained by fitting the fitting curve corresponding to the average data transmission rate through the correspondence between the number of historical classified data in the forensic device, the historical forensic duration and the average data transmission rate. The real-time number of classified data and the forensic duration are brought into the fitting curve corresponding to the average data transmission rate to obtain the correction factor corresponding to the average data transmission rate in this example. The value range in this example is (0, 1).

[0061] V g It is the average data transmission rate of the g-th type of forensic equipment during the forensic period, indicating the average rate of the forensic equipment during the data transmission process.

[0062] ΔV is a data transmission reference rate preset in the data driver library, indicating a reasonable reference value of the data transmission rate.

[0063] g is the serial number of each type of forensic equipment, g = 1, 2, 3, ..., r, and r is the total number of types of forensic equipment.

[0064] The maximum operating noise intensity and maximum operating signal power of various types of forensic equipment during the forensic cycle are obtained. The maximum operating noise intensity represents the maximum sound pressure level generated by the forensic equipment under normal working conditions, which is obtained by a sound level meter; the maximum operating signal power represents the maximum signal power generated by the forensic equipment under normal working conditions, which is obtained by a power sensor.

[0065] The maximum signal-to-noise ratio of each type of evidence collection equipment during the evidence collection cycle is obtained through ratio processing and recorded as the second evidence collection equipment influence index of each type of evidence collection equipment.

[0066] In this example embodiment, due to the changes in the maximum operating noise intensity and the maximum operating signal power of each type of evidence collection device during the evidence collection cycle, the second evidence collection device influence index of each type of evidence collection device will eventually change accordingly. The specific changes are shown in Table 1 (this example only analyzes three types of evidence collection devices, and the number of each type of evidence collection device is 1):

[0067] Table 1 The second forensic equipment impact index of various forensic equipment and the change of corresponding parameters

[0068]

[0069] It can be learned from the numerical changes in Table 1 that if the maximum operating noise intensity and the maximum operating signal power of the forensic equipment are both in an increasing state, the corresponding maximum signal-to-noise ratio is also in an increasing state, that is, the maximum operating noise intensity and the maximum operating signal power of the forensic equipment are both proportional to the impact index of the second forensic equipment, which can provide a more relevant data basis for the subsequent comprehensive evaluation of the impact value of the forensic equipment.

[0070] Based on the first forensic device impact index of each type of forensic device and the second forensic device impact index of each type of forensic device, the forensic device impact value of each type of forensic data is comprehensively obtained. Since a certain type of forensic device only stores the data of this type inside the forensic device, the analyzable data obtained by various types of forensic devices through data classification can be called various types of forensic data.

[0071] Specifically, the forensic device impact value of each type of forensic data is obtained by analyzing the first forensic device impact index of each type of forensic device, the second forensic device impact index of each type of forensic device, and the weight factor of the first forensic device impact index and the weight factor of the second forensic device impact index. The specific formula is:

[0072]

[0073] In the formula, FC gis the forensic device impact value of the g-th category forensic data. In this example, the forensic device impact value of the forensic data will be affected by the forensic device during the data classification process. That is, if the noise intensity and signal power of the forensic device are large during the data classification process, it means that the forensic device is affected by a large noise during the data classification process, which is not conducive to the data classification process of the forensic device, and will cause the forensic data to be transmitted to the wrong corresponding category of forensic devices. The relational structure of the above expression can be used to obtain a larger forensic device impact value. At the same time, during the forensic process, if the data classification interruption duration of the forensic device is closer to the duration of the forensic cycle and the data transmission rate deviates from a reasonable transmission rate range, the risk of the forensic device being unable to perform effective data classification will increase, leading to The data correlation is not strong. The relational structure of the above expression can be used to obtain a forensic device impact value with a larger value. During the data classification process, if the noise intensity of the forensic device is large, it will not only affect its own data classification process, but also the signal interference caused by the noise intensity will affect the data classification process of other forensic devices. The longer the data classification interruption time of the forensic device is, the greater the impact will be, which will eventually lead to a decrease in the transmission rate of the forensic device. In summary, the forensic device impact value of forensic data is not only a consideration of the correlation of the forensic data itself, but the corresponding forensic device will also affect the forensic correlation. Therefore, through the above data quantification and comprehensive analysis, a more accurate forensic device impact value corresponding to the forensic data can be obtained.

[0074] TQ g It is the first forensic device impact index of the g-th category forensic device, which represents the value obtained by comprehensive processing of the data classification interruption duration and the average data transmission rate.

[0075] gf 1 The weight factor of the first forensic device impact index preset in the data-driven library is obtained by fitting the fitting curve corresponding to the first forensic device impact index through the correspondence between the historical data classification interruption duration, the historical data transmission average rate and the first forensic device impact index of the forensic device, and the real-time data classification interruption duration and the average data transmission rate are brought into the fitting curve corresponding to the first forensic device impact index to obtain the weight factor corresponding to the first forensic device impact index in this example. At the same time, the value range in this example is (0, 1).

[0076] DAI g is the second forensic equipment impact index of the g-th category forensic equipment, indicating the proportional change value between the maximum operating noise intensity and the maximum operating signal power of the forensic equipment.

[0077] gf 2The weight factor of the second forensic device impact index preset in the data-driven library is obtained by fitting the corresponding relationship between the historical maximum operating noise intensity, the historical maximum operating signal power and the second forensic device impact index of the forensic device, and the fitting curve corresponding to the second forensic device impact index is fitted. The real-time maximum operating noise intensity and the maximum operating signal power are brought into the fitting curve corresponding to the second forensic device impact index to obtain the weight factor corresponding to the second forensic device impact index in this example. At the same time, the value range in this example is (0, 1).

[0078] e is a natural constant, g is the serial number of each type of forensic data, g = 1, 2, 3, ..., r, and r is the total number of categories of forensic data.

[0079] In this example embodiment, the weight factor of the first forensic device impact index is set to 0.3, and the weight factor of the second forensic device impact index is set to 0.5. Then, through the changes in the first forensic device impact index and the second forensic device impact index of each type of forensic device in Table 1, the numerical changes in the forensic device impact values ​​of each type of forensic data can be obtained. The specific change values ​​are shown in Table 2:

[0080] Table 2 The impact values ​​of forensic equipment on various types of forensic data and the changes in corresponding parameters

[0081]

[0082] It can be seen from Table 2 that since the weight factor of the second forensic device impact index is set larger than the numerical setting of the weight factor of the first forensic device impact index, the larger the second forensic device impact index corresponding to the weight factor of the second forensic device impact index is, the larger the final forensic device impact value is. At the same time, the influence degree of the first forensic device impact index corresponding to the weight factor of the first forensic device impact index is far less than the influence degree of the second forensic device impact index corresponding to the weight factor of the second forensic device impact index. It can be seen that due to the different set values ​​of the impact factors, the final result will be affected by the parameters corresponding to the impact factors, so that more accurate calculation results can be understood through more detailed changes in various parameters.

[0083] Furthermore, the analysis of the impact value of the forensic equipment of various types of forensic data is specifically carried out as follows:

[0084] The statistical data drives the preset weight factors of the first forensic device impact index and the second forensic device impact index in the library, and based on the first forensic device impact index and the second forensic device impact index of each type of forensic device, the forensic device impact value of each type of forensic data is analyzed.

[0085] Step 3: Compare the forensic device impact value of each type of forensic data with the forensic device impact limit value preset in the data driver library, count the various types of forensic data corresponding to the forensic device impact value greater than the preset forensic device impact limit value, and provide driver optimization prompts for each type of forensic data.

[0086] Specifically, the driver optimization prompts for various types of forensic data are as follows:

[0087] The forensic device impact value of each type of forensic data is compared with the forensic device impact limit value preset in the data-driven library, where the forensic device impact limit value represents the minimum value of the forensic device impact value within a reasonable range. If the forensic device impact value of a certain type of forensic data is greater than the preset forensic device impact limit value, it means that the forensic device impact degree of each type of forensic data analyzed in this example is large and higher than the maximum reasonable value. In this way, this type of forensic data is recorded as data requiring optimization prompts. Thus, various types of forensic data corresponding to the forensic device impact value greater than the preset forensic device impact limit value are counted and recorded as various types of prompt data requiring optimization, and optimization prompts are driven for various types of prompt data requiring optimization.

[0088] It needs to be explained that the above-mentioned driver optimization prompts for various types of prompt data that need to be optimized refer to the built-in prompt module of a certain type of forensic equipment, which autonomously senses that the impact degree of the forensic equipment of this type of forensic data has deviated from the reasonable impact range. Therefore, the prompt module autonomously issues a driver optimization prompt function to prompt this type of forensic equipment to perform driver optimization; wherein, the specific optimization process can be as follows: first, based on step one of this example, the same preprocessing operations are performed, that is, duplicate items are removed, missing values ​​are filled, and error items are corrected, such as background noise in law enforcement recorders, distortion correction of cameras, system logs of mobile phones, etc.; secondly, on the basis of the preprocessing in step one, the data format of the original data is unified for subsequent processing, such as converting videos to standard resolution, compressing audio files to a suitable size, etc.; thirdly, the file size is reduced by a data compression algorithm, and duplicate data fragments are deleted, especially It is for long-term videos shot continuously; the above is the driving optimization process of the preprocessing operation of this example. After the optimization is completed, verify whether the processed data meets the forensic requirements, that is, compare the preprocessed data with the original data to ensure that key information is not lost, such as timestamp, location, and sound clarity; check whether the data is logically consistent, such as whether the time interval between consecutive video frames is reasonable, and whether the audio matches the video content; check whether there is duplicate data or outliers caused by error processing, such as the synchronization of video and audio, and whether the same event recorded by multiple devices is consistent; in order to ensure the integrity and accuracy of the data; the above is only the preprocessing optimization driving method corresponding to a certain type of forensic data in this embodiment. The specific driving optimization method corresponding to each type of forensic data will be adjusted due to the different values ​​of the forensic device influence value of each type of forensic data, and this example does not make special limitations.

[0089] It needs to be explained that if the forensic device impact value of a certain type of forensic data mentioned above is less than or equal to the preset forensic device impact limit value, it means that the forensic device impact value of this type of forensic data is within a reasonable impact range, and there is no need to provide driver optimization prompts for this type of forensic data.

[0090] In a specific embodiment, the present invention classifies the analyzable data in the temporary storage warehouse through various types of forensic equipment, that is, through the diversification of data-driven processing methods, various types of forensic data are obtained, thereby analyzing the forensic equipment impact values ​​of various types of forensic data and comparing them with the forensic equipment impact limit values ​​preset in the data-driven library. This can provide a reference data basis for subsequent driving optimization prompts for the forensic data, ultimately improving the quality of data utilization.

[0091] The second aspect of the present invention provides a device for a data-driven processing method based on standard digitalization, including: a data acquisition device, a wireless communication module, a data publishing channel, a temporary storage warehouse, and a forensics device.

[0092] like Figure 5 As shown, it is a data-driven processing structure diagram of the present invention, that is, the data acquisition device 1 is used to call the wireless communication module 2 through the data acquisition module in the data acquisition device to collect the publishing data set in the data publishing channel 3, which is recorded as the initial collected data; the temporary storage warehouse 4 is used to receive the initial collected data after the pre-processing operation in the data acquisition device through the wireless communication module, which is recorded as analyzable data; the forensic device 5 is used to connect to the temporary storage warehouse through the wireless communication module, and based on the data classification unit of the forensic device, classify the analyzable data in the temporary storage warehouse, and the classified data is stored in the forensic device.

[0093] In a specific embodiment, the present invention provides a data-driven processing method and device based on standard digitalization. First, an automated preprocessing operation is performed on the initial collected data, which can save labor processing costs, and the initial collected data after preprocessing is classified. Through real-time data classification response processing, more accurate forensic data of various types can be obtained, and the forensic equipment impact value of each type of forensic data can be analyzed, thereby providing driven optimization prompts for the forensic data, which can ultimately improve the accuracy of data-driven processing.

[0094] The above contents are merely examples and explanations of the structure of the present invention. The technicians in this technical field may make various modifications or additions to the specific embodiments described or replace them in a similar manner. As long as they do not deviate from the structure of the invention or exceed the scope defined by the present invention, they should all fall within the protection scope of the present invention.

Claims

1. A data-driven processing method based on standard digitization, characterized in that: include: Step 1: collect data through data collection equipment, extract initial collected data, perform standard digital preprocessing operations, record the preprocessed initial collected data as analyzable data, and store it in a temporary storage bin; Step 2: Classify the analyzable data in the temporary storage bin by using various forensic devices to obtain various forensic data, thereby analyzing the forensic device impact values ​​of various forensic data; Step 3: Compare the forensic device impact value of each type of forensic data with the forensic device impact limit value preset in the data driver library, count the various types of forensic data corresponding to the forensic device impact value greater than the preset forensic device impact limit value, and provide driver optimization prompts for each type of forensic data.

2. The data-driven processing method based on standard digitization according to claim 1, characterized in that: The data acquisition device performs data acquisition and extracts initial acquisition data. The specific process is as follows: Based on the data acquisition module in the data acquisition device, the wireless communication module is called through the data acquisition module to adaptively collect the release data sets of each data release channel within the data collection cycle, and the data sets are recorded as initial collection data.

3. The data-driven processing method based on standard digitization according to claim 2, characterized in that: The standard digital preprocessing operation is performed to record the preprocessed initial collected data as analyzable data, specifically, the standard digital preprocessing operation is performed on the initial collected data by a data processing unit in the data acquisition device; The standard digitization preprocessing operation specifically includes standard formatting the initial collected data, thereby obtaining the standard formatted initial collected data, which is recorded as the standard digitized initial collected data; The standard digitized initial acquisition data is preprocessed, wherein the preprocessing operation includes removing duplicate items, filling missing values, and correcting erroneous items, and finally the preprocessed standard digitized initial acquisition data is obtained, which is recorded as analyzable data.

4. The data-driven processing method based on standard digitization according to claim 1, characterized in that: The storage is in a temporary storage warehouse, and the specific process is as follows: The data acquisition device sends the analyzable data through the wireless communication module, and the temporary storage bin receives the analyzable data through the wireless communication module and stores the analyzable data in the temporary storage bin.

5. The data-driven processing method based on standard digitization according to claim 1, characterized in that: The various types of forensic equipment classify the analyzable data in the temporary storage bin to obtain various types of forensic data. Specifically, the various types of forensic equipment are connected to the temporary storage bin via a wireless communication module, and based on the data classification unit of the various types of forensic equipment, the analyzable data in the temporary storage bin is classified, and the classified analyzable data is synchronously stored in the various types of forensic equipment via the wireless communication module, thereby obtaining the classified analyzable data in the various types of forensic equipment, which are recorded as various types of forensic data.

6. The data-driven processing method based on standard digitization according to claim 1, characterized in that: The forensic equipment impact value of each type of forensic data, the specific data acquisition and processing process is as follows: The affiliated evidence collection devices of various evidence collection data are counted, recorded as various evidence collection devices, and the data classification interruption duration of various evidence collection devices in the evidence collection cycle and the average data transmission rate of various evidence collection devices in the evidence collection cycle are obtained, and the first evidence collection device impact index of various evidence collection devices is obtained by comprehensive processing; Obtain the maximum noise intensity and maximum signal power of each type of evidence collection equipment during the evidence collection period, obtain the maximum signal-to-noise ratio of each type of evidence collection equipment during the evidence collection period through ratio processing, and record it as the second evidence collection equipment influence index of each type of evidence collection equipment; Based on the first forensic device impact index of each type of forensic device and the second forensic device impact index of each type of forensic device, the forensic device impact value of each type of forensic data is comprehensively obtained.

7. The data-driven processing method based on standard digitization according to claim 6, characterized in that: The specific analysis process of analyzing the impact value of forensic equipment of various types of forensic data is as follows: The statistical data drives the preset weight factors of the first forensic device impact index and the second forensic device impact index in the library, and based on the first forensic device impact index and the second forensic device impact index of each type of forensic device, the forensic device impact value of each type of forensic data is analyzed.

8. The data-driven processing method based on standard digitization according to claim 7, characterized in that: The specific formula for the impact value of the forensic equipment of each type of forensic data is: In the formula, FC g is the impact value of the forensic equipment for the g-type forensic data, TQ g is the first forensic device impact index of the g-th type of forensic device, gf1 is the weight factor of the first forensic device impact index preset in the data-driven library, DAI g is the second forensic device impact index of the g-th type of forensic device, gf2 is the weight factor of the second forensic device impact index preset in the data-driven library, e is a natural constant, g is the number of each type of forensic data, g=1,2,3,...,r, r is the total number of forensic data categories.

9. The data-driven processing method based on standard digitization according to claim 1, characterized in that: The specific process of driving optimization prompts for various types of forensic data is as follows: The forensic device impact value of each type of forensic data is compared with the forensic device impact limit value preset in the data-driven library. If the forensic device impact value of a certain type of forensic data is greater than the preset forensic device impact limit value, then this type of forensic data is recorded as data requiring optimization prompts. Thus, various types of forensic data corresponding to the forensic device impact value greater than the preset forensic device impact limit value are counted and recorded as various types of prompt data requiring optimization, and drive optimization prompts for various types of prompt data requiring optimization.

10. A device using the data-driven processing method based on standard digitization as claimed in any one of claims 1 to 9, characterized in that: include: Data collection equipment, wireless communication modules, data release channels, temporary storage warehouses, and evidence collection equipment; The data acquisition device is used to call the wireless communication module through the data acquisition module in the data acquisition device to collect the release data set in the data release channel, which is recorded as the initial collection data; The temporary storage bin is used to receive the initial collected data after preprocessing operation in the data collection device through the wireless communication module, which is recorded as analyzable data; The evidence collection device is used to connect to the temporary storage bin via a wireless communication module, and classify the analyzable data in the temporary storage bin based on a data classification unit of the evidence collection device, and the classified data is stored in the evidence collection device.

Citation Information

Patent Citations

  • Data forensic analysis method and system for electronic equipment

    CN111951130A

  • Data-driven database updating method and system

    CN117807102A

  • Data acquisition method based on high-precision data acquisition platform

    CN118301501A

  • Device defect data rule base construction method and device defect correlation analysis method

    WO2024103436A1