Inspection data of industrial equipment, data processing method and device, and computing equipment

Abstract

Embodiments of the present application provide a kind of detection data of industrial equipment, data processing method and device, computing device, the data processing method includes: reading multiple detection data from data storage system;Identify the valid data in the multiple detection data, obtain multiple valid data;According to the preset format conversion mode, the multiple valid data are respectively converted into corresponding data record, and multiple data records are obtained;Based on preset data compression algorithm, the multiple data records are compressed and handled, and the target data packet compressed is obtained.The data compression rate of the present application embodiment is improved.

Description

Technical Field

[0001] This application relates to the field of computing equipment technology, and in particular to a detection data, data processing method and apparatus for industrial equipment, and computing equipment. Background Technology

[0002] During operation, industrial equipment uses sensors to detect various data to monitor its operating status. Sensors can collect data such as current, temperature, rotational speed, and / or pressure. Each data acquisition generates a detection record, which may include, for example, factory identification, equipment identification, equipment code, and multiple sub-detection data such as current, temperature, and pressure.

[0003] When using sensors to detect data from industrial equipment, the high acquisition frequency generates a large number of data records. Multiple data points can be sent to data storage systems such as Kafka and HDFS, which can directly store the received data. If computing devices need to use the data to analyze the equipment's operation, they must retrieve multiple data points from the data storage system to reduce the processing load. Since the data storage system stores each received data point as is, the data volume is large when computing devices retrieve multiple data points. Therefore, a preset data compression algorithm can be used during data transmission to compress the multiple data points before transmission, resulting in compressed data packets.

[0004] However, directly using data compression algorithms for data compression has low compression efficiency and cannot meet the needs of fast data transmission. Summary of the Invention

[0005] In view of this, embodiments of this application provide detection data of industrial equipment, data processing method and apparatus, and computing device to solve the technical problem of low data compression efficiency in the prior art.

[0006] In a first aspect, embodiments of this application provide a method for processing detection data of industrial equipment, including:

[0007] Acquire multiple industrial detection data points obtained from sensing the target industrial equipment;

[0008] Identify valid data from the multiple industrial testing data sets to obtain multiple valid data sets;

[0009] According to the preset format conversion method, the multiple valid data are converted into corresponding data records respectively to obtain multiple data records;

[0010] Based on a preset data compression algorithm, the multiple data records are compressed to obtain the compressed target data packet.

[0011] Secondly, embodiments of this application provide a data processing method, including:

[0012] Read multiple detection data entries from the data storage system;

[0013] Identify valid data from the multiple detection data sets to obtain multiple valid data sets;

[0014] According to the preset format conversion method, the multiple valid data are converted into corresponding data records respectively to obtain multiple data records;

[0015] Based on a preset data compression algorithm, the multiple data records are compressed to obtain the compressed target data packet.

[0016] Thirdly, embodiments of this application provide a data processing method, including:

[0017] The system receives a target data packet after compressing multiple detection data. The target data packet is obtained by the computing device reading multiple detection data from the data storage system, identifying valid data in the multiple detection data, obtaining multiple valid data, and then converting the multiple valid data into corresponding data records according to a preset format conversion method to obtain multiple data records. The multiple data records are then compressed based on a preset data compression algorithm.

[0018] Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain the multiple data records;

[0019] The multiple data records are converted into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method;

[0020] The multiple valid data points are processed to restore the data and obtain the multiple detection data points.

[0021] Fourthly, embodiments of this application provide a method for processing detection data of industrial equipment, including:

[0022] The system receives a target data packet containing compressed industrial detection data from multiple industrial equipment. The target data packet is obtained by acquiring multiple industrial detection data points sensed by the target industrial equipment, identifying valid data points within these data points, and then converting these valid data points into corresponding data records according to a preset format conversion method. These data records are then compressed using a preset data compression algorithm.

[0023] Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain the multiple data records;

[0024] The multiple data records are converted into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method;

[0025] Data restoration processing is performed on the multiple valid data to obtain the multiple industrial testing data.

[0026] Fifthly, embodiments of this application provide a detection data processing device for industrial equipment, comprising:

[0027] The data acquisition module is used to acquire multiple industrial detection data points obtained from sensing the target industrial equipment;

[0028] The effective identification module is used to identify the effective data in the multiple industrial test data and obtain multiple effective data.

[0029] The first conversion module is used to convert the multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records;

[0030] The data compression module is used to compress the multiple data records based on a preset data compression algorithm to obtain a compressed target data packet.

[0031] Sixthly, embodiments of this application provide a data processing apparatus, including:

[0032] The data reading module is used to read multiple pieces of detection data from the data storage system;

[0033] The effective identification module is used to identify the effective data among the multiple detection data and obtain multiple effective data.

[0034] The first conversion module is used to convert the multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records;

[0035] The data compression module is used to compress the multiple data records based on a preset data compression algorithm to obtain a compressed target data packet.

[0036] In a seventh aspect, embodiments of this application provide a data processing apparatus, including:

[0037] A data receiving module is used to receive a target data packet after compression of multiple detection data; wherein, the target data packet is obtained by a computing device reading multiple detection data from a data storage system; identifying valid data in the multiple detection data to obtain multiple valid data; converting the multiple valid data into corresponding data records according to a preset format conversion method to obtain multiple data records; and compressing the multiple data records based on a preset data compression algorithm.

[0038] The data decompression module is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain the multiple data records.

[0039] The second conversion module is used to convert the multiple data records into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method;

[0040] The data restoration module is used to perform data restoration processing on the multiple valid data to obtain the multiple detection data.

[0041] Eighthly, embodiments of this application provide a detection data processing apparatus for industrial equipment, comprising:

[0042] The data receiving module is used to receive a target data packet after compression of multiple industrial detection data from the target industrial equipment. The target data packet is obtained by acquiring multiple industrial detection data obtained by sensing the target industrial equipment, identifying valid data in the multiple industrial detection data, and after obtaining multiple valid data, converting the multiple valid data into corresponding data records according to a preset format conversion method to obtain multiple data records, which are then compressed based on a preset data compression algorithm.

[0043] The data decompression module is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain the multiple data records.

[0044] The second conversion module is used to convert the multiple data records into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method;

[0045] The data restoration module is used to perform data restoration processing on the multiple valid data to obtain the multiple industrial testing data.

[0046] Ninthly, embodiments of this application provide a computing device, including: a storage component and a processing component; the storage component is used to store one or more computer instructions; the one or more computer instructions are invoked by the processing component to execute a detection data processing method for industrial equipment.

[0047] In a tenth aspect, embodiments of this application provide a computing device, including: a storage component and a processing component; the storage component is used to store one or more computer instructions; the one or more computer instructions are invoked by the processing component to execute a data processing method.

[0048] In this embodiment, after acquiring multiple industrial testing data points from industrial equipment, valid data can be identified from these data points to obtain multiple valid data entries, initially reducing the total data volume. Then, according to a preset format conversion method, each valid data entry can be converted into a corresponding data record, allowing for the recording and storage of the actual data within the valid data, further reducing the overall data volume. Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet. Through data deduplication and record conversion, the data size of the stored data is effectively compressed. Therefore, by utilizing the data compression algorithm, further data compression can be achieved, improving the compression efficiency of industrial testing data and ensuring efficient transmission of industrial testing data. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 A flowchart illustrating one embodiment of a method for processing detection data of industrial equipment provided in this application;

[0051] Figure 2 A flowchart of one embodiment of a data processing method provided in this application;

[0052] Figure 3 A flowchart of yet another embodiment of a data processing method provided in this application;

[0053] Figure 4 A flowchart illustrating one embodiment of a method for processing detection data of industrial equipment provided in this application;

[0054] Figure 5 An example diagram of data processing provided for an embodiment of this application;

[0055] Figure 6 A schematic diagram of one embodiment of a data processing apparatus provided in this application;

[0056] Figure 7 This is a schematic diagram of the structure of one embodiment of a computing device provided in this application.

[0057] Figure 8 A schematic diagram of another embodiment of a data processing apparatus provided in this application;

[0058] Figure 9 A schematic diagram of another embodiment of a computing device provided in this application;

[0059] Figure 10 A schematic diagram of one embodiment of a detection data processing device for industrial equipment provided in this application;

[0060] Figure 11 A schematic diagram of another embodiment of a computing device provided in this application;

[0061] Figure 12 A schematic diagram of one embodiment of a detection data processing device for industrial equipment provided in this application;

[0062] Figure 13 This is a schematic diagram of another embodiment of a computing device provided in this application. Detailed Implementation

[0063] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0064] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “said,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, unless the context clearly indicates otherwise. “Multiple” generally includes at least two, but does not exclude the inclusion of at least one.

[0065] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0066] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to identification.” Similarly, depending on the context, the phrases “if determination” or “if identification (of the condition or event of the statement)” can be interpreted as “when determination” or “in response to determination” or “when identification (of the condition or event of the statement)” or “in response to identification (of the condition or event of the statement).”

[0067] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a product or system comprising a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a product or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the product or system that includes said element.

[0068] The technical solution of this application embodiment can be applied to data compression. By performing multiple compression processes such as deduplication, data formatting, and data compression on the detection data, the detection data can be effectively compressed, thereby improving the data compression rate and improving data transmission efficiency.

[0069] In existing technologies, various sensors are used to monitor the operating status of industrial equipment and promptly detect operational problems. The data collected from industrial equipment is typically referred to as detection data, which can be sent to data storage systems such as Kafka and HDFS. Control devices used to monitor industrial equipment can obtain the detection data from the data storage system. However, due to the very high frequency of detection data collection and the large volume of data, a common data compression method involves using a preset data compression algorithm to compress the data to be transmitted. However, this compression method is inefficient, resulting in low data transmission efficiency.

[0070] In this embodiment, after reading multiple detection data from the data storage system, valid data can be identified from these data to obtain multiple valid data entries, initially reducing the total data volume. Then, according to a preset format conversion method, the multiple valid data entries are converted into corresponding data records to record and store the actual data within the valid data, further reducing the total data volume. Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet. Through data deduplication and record conversion, the data size of the stored data is effectively compressed. Therefore, by utilizing the data compression algorithm, further data compression can be achieved, improving data compression efficiency and ensuring data transmission efficiency.

[0071] The embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0072] like Figure 1 The diagram shown is a flowchart of one embodiment of a method for compressing detection data of industrial equipment provided in this application. The method may include:

[0073] 101: Acquire multiple industrial detection data points obtained from sensing the target industrial equipment.

[0074] 102: Identify valid data from multiple industrial testing data sets and obtain multiple valid data sets.

[0075] 103: Based on the preset format conversion method, convert multiple valid data into corresponding data records to obtain multiple data records.

[0076] 104. Based on a preset data compression algorithm, multiple data records are compressed to obtain the compressed target data packet.

[0077] The target industrial equipment can be equipped with data sensors. These sensors can collect data from the industrial inspection equipment at a certain sampling frequency and send each piece of data to a data storage system for later retrieval or use. Multiple industrial inspection data points can belong to... Figure 2 For details regarding the processing methods in steps 102-104 of the multiple detection data points shown in the embodiment, please refer to [link / reference needed]. Figure 2 Steps 202 to 204 in the illustrated embodiment will not be repeated here.

[0078] Optionally, acquiring multiple industrial detection data points obtained from sensing the target industrial equipment may include: reading multiple industrial detection data points obtained from the data storage system for detecting the target industrial equipment.

[0079] Optionally, acquiring multiple industrial detection data points obtained from sensing industrial equipment may include:

[0080] It receives multiple industrial detection data points obtained from sensors sent by industrial equipment.

[0081] Some steps in the embodiments of this application are similar to Figure 2 Some steps in the illustrated embodiments are the same, and for the sake of brevity, they will not be repeated here.

[0082] In this embodiment, the method is applicable to the compression of detection data from industrial equipment. After acquiring multiple industrial detection data points sensed by the target industrial equipment, valid data can be identified from these data points to obtain multiple valid data points, initially reducing the data volume of the multiple detection data points. Then, according to a preset format conversion method, the multiple valid data points are converted into corresponding data records to record and store the actual data within the valid data, further reducing the data volume of the multiple valid data points. Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet. After data deduplication and record conversion, the data size of the multiple stored data points is effectively compressed. Therefore, by utilizing the data compression algorithm, further data compression can be achieved, improving the compression efficiency of industrial detection data and ensuring data transmission efficiency.

[0083] like Figure 2 The diagram shown is a flowchart of one embodiment of a data processing method provided in this application. The method may include the following steps:

[0084] 201: Read multiple detection data from the data storage system.

[0085] Data storage systems can include real-time data storage systems and / or offline data storage systems. Kafka is a common real-time data storage system, while HDFS is a common offline data storage system.

[0086] The data processing method provided in this application can be applied to a computing device, which is mainly used for data compression. In some embodiments, the computing device may include, for example, a personal computer, a super mobile personal computer, a laptop, or other computing device with computing processing capabilities. Furthermore, the computing device may also include, for example, a server or a cloud server. This application does not impose excessive limitations on the specific type of computing device.

[0087] The computing device can initiate a data acquisition request to the data storage system. After receiving the data acquisition request sent by the computing device, the data storage system can respond to the data acquisition request and send multiple detection data to the computing device, so that the computing device can receive multiple detection data sent by the data storage system.

[0088] 202: Identify valid data from multiple detection data sets and obtain multiple valid data sets.

[0089] In some cases, the data collection frequency of multiple detection data is higher than a certain collection threshold, but the operating status of the industrial equipment has not changed within a certain period of time. At this time, there is a large number of duplicate data in the multiple detection data. Therefore, identifying the valid data in the multiple detection data and obtaining multiple valid data can include: identifying duplicate data in the multiple detection data, retaining a certain number of duplicate data as valid data, so as to obtain multiple valid data consisting of non-duplicate and retained valid data.

[0090] Optionally, valid data can be data that appears less than a predefined number of times within a certain period of time from multiple detection data, in order to reduce the number of duplicate data and lower the data duplication rate.

[0091] 203: Based on the preset format conversion method, convert multiple valid data into corresponding data records to obtain multiple data records.

[0092] Optionally, a preset format conversion method can convert multiple valid data points into corresponding data records. A data record can be a complete set of information from a single set of test data. The data record actually records the valid data from the test data, excluding the keys. Compared to the original test data, this can reduce the data size, thus achieving data compression.

[0093] 204: Based on a preset data compression algorithm, multiple data records are compressed to obtain the compressed target data packet.

[0094] Optionally, the data compression algorithm can be pre-set. The target data packet can be obtained by compressing multiple data records using the data compression algorithm. The data compression algorithm can include mature compression algorithms such as GZIP (GNU zip, a file compression program) and Huffman compression. In this embodiment, the specific type of data compression algorithm is not limited.

[0095] In this embodiment, after reading multiple detection data from the data storage system, valid data can be identified from these data to obtain multiple valid data entries, initially reducing the total data volume. Then, according to a preset format conversion method, the multiple valid data entries are converted into corresponding data records to record and store the actual data within the valid data, further reducing the total data volume. Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet. Through data deduplication and record conversion, the data size of the stored data is effectively compressed. Therefore, by utilizing the data compression algorithm, further data compression can be achieved, improving data compression efficiency and ensuring data transmission efficiency.

[0096] In some embodiments, reading multiple pieces of detection data from a data storage system includes:

[0097] Read multiple industrial testing data points obtained from the testing of the target industrial equipment from the data storage system.

[0098] To identify valid data among multiple detection data sets, invalid or redundant data is eliminated to reduce the data volume. As another embodiment, each detection data set can correspond to both data content and time content. The time content can include a time key and the acquisition time.

[0099] Identifying valid data from multiple detection data sets to obtain multiple valid data sets may include:

[0100] Multiple test data points are divided into at least one test group.

[0101] Each detection group may include at least one detection data point with identical data content and consecutive acquisition times in the time content.

[0102] If the number of at least one data point in any detection group is greater than 2, then the first and last data points in the detection group are determined to be valid data.

[0103] If the number of at least one data point in any detection group is less than or equal to 2, then at least one data point in the detection group is determined to be valid data, so as to obtain valid data corresponding to at least one detection group respectively.

[0104] Identify multiple valid data sets consisting of valid data corresponding to at least one detection group.

[0105] Optionally, the data content may include multiple data keys and the collected data corresponding to each of the multiple data keys. Specifically, "identical data content" can mean that multiple data keys and the collected data corresponding to each of the multiple data keys are all identical.

[0106] For ease of understanding, let's take receiving 6 detection data points as an example. Assume these 6 detection data points can be:

[0107] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:00"}

[0108] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:05"}

[0109] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:10"}

[0110] {"factory":"factory_a","device_id":"device_a","key4":0.3"key5":0.4,"time":"2020-06-15 00:00:15"}

[0111] {"factory":"factory_a","device_id":"device_a","key4":0.3"key5":0.4,"time":"2020-06-15 00:00:20"}

[0112] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:25"}

[0113] The above six data points can be grouped into three detection groups by categorizing those with identical content and consecutive collection times within their timeframes. Specifically:

[0114] Test Group 1:

[0115] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:00"}

[0116] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:05"}

[0117] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:10"}

[0118] Test Group Two:

[0119] {"factory":"factory_a","device_id":"device_a","key4":0.3"key5":0.4,"time":"2020-06-15 00:00:15"}

[0120] {"factory":"factory_a","device_id":"device_a","key4":0.3"key5":0.4,"time":"2020-06-15 00:00:20"}

[0121] Test Group 3:

[0122] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:25"}

[0123] In Group 1, the number of at least one data point is greater than 2. In Groups 2 and 3, the number of at least one data point is less than or equal to 2.

[0124] The first and last test data in test group one will be considered as valid data.

[0125] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:00"} and

[0126] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:10"} is considered valid data.

[0127] At least one test data point from test group 2 and test group 3 shall be considered as valid data.

[0128] In some embodiments, reading multiple detection data from a data storage system may include:

[0129] Multiple detection data points are read sequentially from the data storage system according to the order of collection time in the time content.

[0130] To perform format conversion on the valid data, as another embodiment, multiple detection data entries each correspond to data content and time content. The data content may include: multiple data keys, and the collected data corresponding to each data key. The time content may include: a time key and the collection time.

[0131] Specifically, based on a preset format conversion method, multiple valid data entries are converted into corresponding data records, resulting in multiple data records that can include:

[0132] Based on the multiple data keys corresponding to multiple valid data, the valid data with the same data key are divided into the same data group to obtain at least one data group.

[0133] Each data group contains at least one valid data entry.

[0134] For any given data set, extract multiple data keys and time keys corresponding to at least one valid data record in the data set to obtain multiple data keys and time keys corresponding to the data set, thereby obtaining multiple data keys and time keys corresponding to at least one data set.

[0135] Based on multiple data keys and time keys corresponding to any data group, extract at least one valid data in the data group from the data collection data of each of the multiple data keys and the collection time corresponding to the time key, and obtain the collection data record corresponding to at least one valid data, so as to obtain at least one collection data record corresponding to at least one data group.

[0136] Identify at least one data group, each corresponding to at least one collected data record, which constitutes multiple data records.

[0137] Furthermore, optionally, based on a preset data compression algorithm, multiple data records are compressed to obtain the compressed target data, which may include:

[0138] Based on a preset data compression algorithm, at least one data record corresponding to at least one data group and multiple data keys and time keys corresponding to at least one data group are compressed to obtain the compressed target data packet.

[0139] Any data collection record may include: multiple data collections and the collection time.

[0140] Any detection data can be arranged sequentially according to the data key and the corresponding acquisition data. The time key and acquisition time of the detection data are located at the end of the detection data to form the detection data.

[0141] Typically, the time key can be located at the end of the detection data. For any given detection data, multiple data keys can be extracted sequentially according to their order in the detection data, and the acquisition data corresponding to each data key can be extracted sequentially. These data keys are then combined with the time data corresponding to the time key located at the end of the sequence to form an acquisition data record.

[0142] To facilitate understanding, let's continue with the previous example. In obtaining the valid data corresponding to Data Group 1, Data Group 2, and Data Group 3, we can group valid data with the same data key into the same data group based on the multiple data keys corresponding to each valid data entry, thus obtaining at least one data group. Specifically, this can be done as follows:

[0143] Data Set 1:

[0144] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:00"}

[0145] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:10"}

[0146] {"factory":"factory_a","device_id":"device_a","key1":0.5,"key2":0.6,"key3":0.7,"time":"2020-06-15 00:00:25"}

[0147] Data Set 2:

[0148] {"factory":"factory_a","device_id":"device_a","key4":0.3"key5":0.4,"time":"2020-06-15 00:00:15"}

[0149] {"factory":"factory_a","device_id":"device_a","key4":0.3"key5":0.4,"time":"2020-06-15 00:00:20"}

[0150] For any given data set, multiple data keys corresponding to at least one valid data record in the data set can be extracted to obtain the multiple data keys corresponding to the data set.

[0151] For example, the multiple data keys corresponding to data group one can be:

[0152] key1: "factory,device_id,key1,key2,key3,time".

[0153] The multiple data keys corresponding to data group two can be:

[0154] key: "factory,device_id,key4,key5,time".

[0155] Based on the multiple data keys corresponding to data group one, the three valid data entries from data group one can be obtained from the corresponding collected data records in data group one as follows:

[0156] {"factory_a",device_a",0.5,0.6,0.7,"2020-06-15 00:00:00"}

[0157] {"factory_a","device_a",0.5,:0.6,0.7,"2020-06-15 00:00:10"}

[0158] {"factory_a","device_a",0.5,0.6,0.7,"2020-06-15 00:00:25"}

[0159] Based on the multiple data keys corresponding to data group two, the two valid data points from data group two can be respectively recorded in the corresponding data collection records of data group two as follows:

[0160] {"factory_a","device_a",0.3,0.4,2020-06-15 00:00:15"}

[0161] {"factory_a","device_a",0.3,0.4,2020-06-15 00:00:20"}.

[0162] To further compress the data, in some embodiments, after determining multiple data records consisting of at least one collected data record corresponding to at least one data group, the method further includes:

[0163] For any given data group, encode the multiple data keys and time keys corresponding to that data group to obtain the data codes corresponding to the multiple data keys and the time codes corresponding to the time keys, so as to obtain multiple data codes and time codes corresponding to at least one data group.

[0164] Among them, any two different data keys correspond to different data codes.

[0165] Based on a preset data compression algorithm, at least one data record corresponding to at least one data group and multiple data keys and time keys corresponding to at least one data group are compressed to obtain a compressed target data packet, which may include:

[0166] Based on a preset data compression algorithm, at least one data record corresponding to at least one data group and multiple data codes and time codes corresponding to at least one data group are compressed to obtain the compressed target data packet.

[0167] To further compress the data, the multiple data keys corresponding to data group one can be replaced with their corresponding data codes, and the multiple data keys corresponding to data group two can be replaced with their corresponding data codes.

[0168] Using the example above, the multiple data keys corresponding to data group one are:

[0169] "factory,device_id,key1,key2,key3,time" can be replaced with multiple data codes:

[0170] "1, 2, 3, 4, 5, 6". Multiple data keys corresponding to data group two:

[0171] "factory,device_id,key4,key5,time" can be replaced with multiple data codes respectively:

[0172] "1, 2, 3, 7, 8, 6".

[0173] Using a preset data compression algorithm, the compression process for at least one data record corresponding to at least one data group and multiple data codes corresponding to at least one data group can be specifically as follows:

[0174] Change "1, 2, 3, 4, 5, 6" and {"factory_a",device_a",0.5,0.6,0.7,"2020-06-1500:00:00"}{"factory_a","device_a",0.5,:0.6,0.7,"2020-06-15 00:00:10"}

[0175] {"factory_a","device_a",0.5,0.6,0.7,"2020-06-15 00:00:25"} corresponds to compression;

[0176] The values ​​“1, 2, 3, 7, 8, 6” and {"factory_a","device_a",0.3, 0.4,2020-06-1500:00:15"} and {"factory_a","device_a",0.3, 0.4,2020-06-15 00:00:20"} are compressed to obtain the target data packet.

[0177] Optionally, in order to compress multiple data codes and time codes corresponding to any given data group, as well as at least one collected data record, these multiple data codes and time codes, along with at least one collected data record, can be formed into a single data format. For example, the multiple data codes and time codes corresponding to any given data group, along with at least one collected data record, can be formed into a data file in the form of scema data (XML Schema Definition, a valid building block of an XML file) to achieve batch processing of the data.

[0178] In some embodiments, data codes can be generated for each data key according to certain data code generation rules. For any given data group, the multiple data keys and time keys corresponding to that data group are encoded to obtain the data codes corresponding to the multiple data keys and the time codes corresponding to the time keys. Obtaining multiple data codes and time codes corresponding to at least one data group may include:

[0179] Based on preset data code generation rules, generate corresponding data codes and time codes for multiple data keys and time codes corresponding to any data group, obtain multiple data codes and time codes corresponding to the data group, and obtain at least one data group corresponding to multiple data codes and time codes respectively.

[0180] Furthermore, optionally, the data code generation rules may specifically include:

[0181] Based on the key arrangement order corresponding to multiple data keys and time keys of any data group, data codes and time codes are generated for multiple data keys to obtain multiple data codes and time codes corresponding to the data group.

[0182] Among them, the character length of the data code corresponding to any data key is less than the character length of the data key, and the character length of the time code corresponding to any time key is less than the character length of the time key.

[0183] The data code generation rules may include, for example, randomly generating a data code for multiple data keys and randomly generating a time code for a time key. However, the character length of the data code corresponding to any data key is less than the character length of the data key, and the character length of the time code corresponding to any time key is less than the character length of the time key. Any two different keys will have different codes. These two different keys can be two data keys or one data key and one time key.

[0184] To facilitate data restoration, as another embodiment, for any given data group, the multiple data keys corresponding to that data group are encoded to obtain the data codes corresponding to each of the multiple data keys. After obtaining the multiple data codes corresponding to at least one data group, the method may further include:

[0185] Based on the data codes corresponding to multiple data keys and the time codes corresponding to time keys in any data group, a data code table for the data group is generated to obtain the data code tables corresponding to multiple data groups respectively.

[0186] In this context, the data code table corresponding to any data group stores multiple data keys corresponding to the data group, as well as the correspondence between the data codes corresponding to the multiple data keys.

[0187] Among them, the data code table corresponding to any data group is used to query the data keys corresponding to the multiple data codes obtained by decompressing a certain data group, so as to obtain the multiple data keys corresponding to the data group.

[0188] The data code table stores the associated data codes for data keys and the associated time codes for time keys. Any data key and its corresponding data code, or any time key and its corresponding time code, are stored in an associated manner. The data code table can be generated by a computing device that compresses data.

[0189] In practical applications, the obtained target data packet can be sent to a receiving device, which can then reconstruct the data based on the target data packet to obtain multiple detection data. As another embodiment, after compressing multiple data records using a preset data compression algorithm to obtain the compressed target data packet, the method may further include:

[0190] The target data packet is sent to the receiving device, which then decompresses the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain multiple data records. The multiple data records are then converted into multiple valid data according to a conversion method that is the opposite of the preset format conversion method. Finally, the multiple valid data are restored to obtain multiple detection data.

[0191] Optionally, after compressing the data using the data processing method provided in this application embodiment, the target data packet can be sent to a computing device for data decompression. This computing device for data decompression may include, for example, a personal computer, a super mobile personal computer, a laptop, or other computing device with computing processing capabilities. Furthermore, the computing device may also include, for example, a server or a cloud server. This application embodiment does not impose excessive limitations on the specific type of computing device.

[0192] The computing device can decompress and restore the target data packet received to obtain the original multiple detection data.

[0193] like Figure 3 The diagram shown is a flowchart of another embodiment of a data processing method provided in this application. The method may include:

[0194] 301: Receives target data packets after compression of multiple detection data.

[0195] The target data packet is obtained by the computing device reading multiple detection data from the data storage system, identifying valid data in the multiple detection data, and after obtaining multiple valid data, converting the multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records, which are then compressed based on a preset data compression algorithm.

[0196] 302: Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain multiple data records.

[0197] 303: Converts multiple data records into multiple valid data records using a conversion method that is the opposite of the preset format conversion method.

[0198] 304: Perform data restoration processing on multiple valid data points to obtain multiple detection data points.

[0199] In this embodiment, the computing device for data decompression can receive a target data packet sent by the computing device for data compression, and decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain multiple data records. These multiple data records are then converted into multiple valid data records according to a conversion method opposite to a preset data format. Finally, the multiple valid data records are restored to obtain multiple detection data records. The obtained target data packet is then restored to achieve decompression of the highly compressed target data packet, thereby obtaining complete multiple detection data records and achieving efficient data transmission.

[0200] Figure 3 The processing procedure of the illustrated embodiment is the same as Figure 2 The processing steps in the illustrated embodiment are similar. For details regarding any steps not described in detail, please refer to [link / reference needed]. Figure 2 The description in the illustrated embodiment.

[0201] In some embodiments, the multiple detection data include: multiple industrial detection data obtained from the detection of the target industrial equipment and read from the data storage system.

[0202] The receiving of multiple compressed target data packets includes: receiving multiple compressed target data packets of industrial detection data from the target industrial equipment.

[0203] As an example, multiple valid data entries correspond to data content and time content respectively; the time content includes the time key and the collection time.

[0204] Data restoration processing was performed on multiple valid data points to obtain multiple detection data points, including:

[0205] Based on the collection time corresponding to multiple valid data, two valid data with the same and adjacent data content are identified as valid data in a detection group, so as to obtain at least one detection group and two valid data corresponding to each detection group.

[0206] For any given test group, the test data of the test group is reconstructed using two valid data points from that test group and the data acquisition frequency, thus obtaining at least two test data points corresponding to the test group.

[0207] Identify multiple valid data sets that are not assigned to any detection group, as well as at least two detection data sets corresponding to each of the at least one detection group.

[0208] Two valid data points in any detection group are the first and last detection data points that originally contained at least one detection data point in that group. By using the first and last detection data points corresponding to any detection group, and assuming the data acquisition frequency is known, at least one detection data point corresponding to that group can be reconstructed. In practical applications, the number of at least one detection data points corresponding to a detection group is actually greater than two.

[0209] If any valid data is not assigned to any detection group, it means that there is no duplicate data with the same content as the valid data. Therefore, the valid data can independently constitute a detection data.

[0210] As another embodiment, decompressing the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain multiple data records may specifically include:

[0211] Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain multiple data codes and time codes corresponding to at least one data group, as well as at least one collected data record corresponding to at least one data group.

[0212] Identify at least one data group, each corresponding to at least one collected data record, which constitutes multiple data records.

[0213] In this system, multiple data codes and time codes corresponding to any data group are stored in correspondence with at least one collected data record corresponding to that data group.

[0214] In some embodiments, converting multiple data records into multiple valid data records according to a conversion method opposite to the preset format conversion method may specifically include:

[0215] For any given data group, decode the multiple data codes and time codes corresponding to the data group to obtain the data keys corresponding to the multiple data codes and the time keys corresponding to the time codes, so as to obtain at least one set of multiple data keys and time keys corresponding to each data group.

[0216] Among them, any two different data keys correspond to different data codes.

[0217] Based on multiple data keys and time keys corresponding to any data group, restore the data keys of at least one collected data record corresponding to the data group to obtain at least one valid data record corresponding to the data group.

[0218] Each valid data entry includes both data content and time information. The data content includes multiple data keys and the corresponding collected data for each data key. The time information includes the time key and the collection time.

[0219] Identify multiple valid data sets consisting of at least one valid data set corresponding to each of at least one data set.

[0220] As one possible implementation, for any given data group, the multiple data codes and time codes corresponding to the data group are decoded separately to obtain the data keys corresponding to the multiple data codes and the time keys corresponding to the time codes, so as to obtain at least one set of multiple data keys and time keys corresponding to each data group, including:

[0221] Receive data code tables corresponding to multiple data groups.

[0222] The data code table is generated based on the data codes of multiple data keys corresponding to at least one data group and the time codes corresponding to the time keys.

[0223] Query the data code table to determine the data keys corresponding to the multiple data codes of any data group and the time keys corresponding to the time codes, so as to obtain at least one data group corresponding to multiple data keys and time keys.

[0224] Among them, the multiple data codes corresponding to any data group are generated from the multiple data keys corresponding to that data group based on the preset data code generation rules.

[0225] The data code table can be generated by a computing device that performs data compression and sent to a computing device that performs data decompression.

[0226] Optionally, the data code generation rule may specifically include: generating data codes for multiple data keys and time codes for time keys based on the key arrangement order corresponding to multiple data keys and time keys of any data group, so as to obtain multiple data codes and time codes corresponding to the data group; wherein, the character length of the data code corresponding to any data key is less than the character length of the data key, and the character length of the time code corresponding to any time key is less than the character length of the time key.

[0227] like Figure 4 The diagram shown is a flowchart of one embodiment of a method for processing detection data of industrial equipment provided in this application. The method may include:

[0228] 401: Receives a target data packet containing compressed industrial testing data from multiple industrial equipment.

[0229] The target data packet is obtained by acquiring multiple industrial detection data points from the target industrial equipment, identifying valid data points from these data points, and then converting these valid data points into corresponding data records according to a preset format conversion method. These data records are then compressed using a preset data compression algorithm.

[0230] 402: Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain multiple data records.

[0231] 403: Converts multiple data records into multiple valid data records using a conversion method that is the opposite of the preset format conversion method.

[0232] 404: Data restoration processing is performed on multiple valid data points to obtain multiple industrial testing data points.

[0233] Among them, many industrial testing data can be obtained by reading the data from the data storage system for testing the target industrial equipment.

[0234] Some steps in the embodiments of this application are similar to Figure 3 Some steps in the illustrated embodiments are the same, and for the sake of brevity, they will not be repeated here.

[0235] In this embodiment, the computing device for data decompression can receive a target data packet sent by the computing device for data compression. This target data packet contains multiple industrial testing data points from a target industrial device. Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain multiple data records. These records are then converted into multiple valid data points using a conversion method opposite to a preset data format. The valid data is then restored to obtain multiple testing data points. The obtained target data packet is then restored to decompress the highly compressed target data packet, thereby obtaining complete multiple industrial testing data points and achieving efficient data transmission.

[0236] For ease of understanding, please refer to Figure 5 Using garment processing equipment M1 as an example, sensor A collects industrial detection data consisting of current, temperature, and rotational speed of garment processing equipment M1, while sensor B collects industrial detection data consisting of pressure and rotational speed of the garment processing equipment. Multiple industrial detection data points collected by sensors A and B are transmitted to data storage system M2 via 501.

[0237] Assume that the computing device performing data compression is computer M3 and the computing device performing data decompression is cloud server M4.

[0238] Computer M3 can read industrial inspection data 502 from data storage system M2 to obtain multiple industrial inspection data points. It then identifies valid data from these multiple industrial inspection data points 303 to obtain multiple valid data points. Next, according to a preset format conversion method, it converts each valid data point 504 into a corresponding data record, obtaining multiple data records. Finally, based on a preset data compression algorithm, it compresses these multiple data records 505 to obtain a compressed target data packet.

[0239] Afterwards, computer M3 can send the target data packet to cloud server M4 via port 506.

[0240] The cloud server M4 can receive target data packets sent by the computer M3. Then, based on the decompression algorithm corresponding to the data compression algorithm, it can decompress the target data packets 507 to obtain multiple data records. Following a conversion method opposite to the preset format conversion method, the multiple data records are converted 508 into multiple valid data records. Finally, data restoration processing is performed on the multiple valid data records to obtain multiple industrial testing data records.

[0241] After obtaining multiple industrial testing data points, the cloud server M4 can classify these data points to obtain multiple industrial testing data points for garment processing equipment M1 (509). It can then use the current, temperature, and rotation speed of sensor A to perform corresponding status monitoring or operational control of garment processing equipment M1, and use the pressure and rotation speed of sensor B to perform corresponding status monitoring or operational control of garment processing equipment M1 (510).

[0242] like Figure 6 The diagram shown is a structural schematic of one embodiment of a data processing apparatus provided in this application. The apparatus may include:

[0243] Data reading module 601: Used to read multiple detection data from the data storage system.

[0244] Valid identification module 602: Used to identify valid data from multiple detection data and obtain multiple valid data.

[0245] First conversion module 603: used to convert multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records.

[0246] Data compression module 604: Used to compress multiple data records based on a preset data compression algorithm to obtain a compressed target data packet.

[0247] In some embodiments, the data reading module can specifically be used to read multiple industrial inspection data obtained from the data storage system for the inspection of the target industrial equipment.

[0248] As an example, multiple detection data points each correspond to data content and time content; the time content includes a time key and the acquisition time.

[0249] Optionally, the effective identification module includes:

[0250] The first division unit is used to divide multiple detection data into at least one detection group; wherein, any detection group includes at least one detection data with the same data content and consecutive acquisition time in the time content;

[0251] The first processing unit is configured to determine the first and last detection data in a detection group as valid data if the number of at least one detection data in any detection group is greater than 2.

[0252] The second processing unit is used to determine that at least one detection data in any detection group is valid data if the number of at least one detection data in any detection group is less than or equal to 2, so as to obtain valid data corresponding to at least one detection group respectively.

[0253] The first determining unit is used to determine multiple valid data consisting of valid data corresponding to at least one detection group.

[0254] In some embodiments, the data reading module includes:

[0255] The data reading unit is used to read multiple detection data from the data storage system in chronological order of the collection time in the time content.

[0256] As another embodiment, multiple detection data points each correspond to data content and time content; the data content includes: multiple data keys and the collected data corresponding to each data key; the time content includes time keys and collection time;

[0257] Optionally, the first conversion module includes:

[0258] The second partitioning unit is used to partition valid data with the same data keys into the same data group based on the multiple data keys corresponding to multiple valid data, thereby obtaining at least one data group; wherein, each of the at least one data group includes at least one valid data.

[0259] The third processing unit is used to extract, for any data group, multiple data keys and time keys corresponding to at least one valid data in the data group, to obtain multiple data keys and time keys corresponding to the data group, so as to obtain multiple data keys and time keys corresponding to at least one data group respectively.

[0260] The record extraction unit is used to extract at least one valid data from a data group based on multiple data keys and a time key, respectively, the acquisition data of each of the multiple data keys and the acquisition time corresponding to the time key, to obtain the acquisition data record corresponding to at least one valid data, so as to obtain at least one acquisition data record corresponding to at least one data group.

[0261] The second determining unit is used to determine multiple data records consisting of at least one collected data record corresponding to at least one data group;

[0262] The data compression module includes:

[0263] The data compression unit is used to compress at least one data record corresponding to at least one data group and multiple data keys and time keys corresponding to at least one data group based on a preset data compression algorithm to obtain a compressed target data packet.

[0264] In some embodiments, the device further includes:

[0265] The first encoding module is used to encode multiple data keys and time keys corresponding to any data group to obtain data codes corresponding to the multiple data keys and time codes corresponding to the time keys, so as to obtain multiple data codes and time codes corresponding to at least one data group; wherein, the data codes corresponding to any two different data keys are different.

[0266] The data compression unit can specifically be used for:

[0267] Based on a preset data compression algorithm, at least one data record corresponding to at least one data group and multiple data codes and time codes corresponding to at least one data group are compressed to obtain the compressed target data packet.

[0268] In some embodiments, the first encoding module includes:

[0269] The first encoding unit is used to generate corresponding data codes and time codes for multiple data keys and time keys corresponding to any data group based on a preset data code generation rule, thereby obtaining multiple data codes and time codes corresponding to the data group, and obtaining multiple data codes and time codes corresponding to at least one data group respectively.

[0270] In one possible design, the data code generation rules specifically include:

[0271] Based on the key arrangement order corresponding to multiple data keys and time keys of any data group, data codes are generated for multiple data keys and time codes are generated for time keys to obtain multiple data codes and time codes corresponding to the data group.

[0272] Among them, the character length of the data code corresponding to any data key is less than the character length of the data key, and the character length of the time code corresponding to any time key is less than the character length of the time key.

[0273] In yet another possible design, the device may also include:

[0274] The code table generation module is used to generate a data code table for a data group based on the data codes corresponding to multiple data keys and the time codes corresponding to time keys, so as to obtain data code tables corresponding to multiple data groups respectively.

[0275] As yet another embodiment, the apparatus may further include:

[0276] The data sending module is used to send the target data packet to the receiving device, so that the receiving device can decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain multiple data records; convert the multiple data records into multiple valid data according to the conversion method opposite to the preset format conversion method; and perform data restoration processing on the multiple valid data to obtain multiple detection data.

[0277] Figure 6 The data processing device can perform Figure 2 The implementation principle and technical effects of the data processing method in the illustrated embodiments will not be repeated here. The specific methods by which each module and unit of the data processing apparatus in the above embodiments perform operations have been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0278] In practical applications, Figure 6 The illustrated embodiment can be configured as a computing device, see reference. Figure 7 This is a schematic diagram of the structure of one embodiment of a computing device provided in this application. The device may include: a storage component 701 and a processing component 702; the storage component 701 is used to store one or more computer instructions; one or more computer instructions are invoked by the processing component 702 to execute. Figure 2 The data processing method of the embodiment shown.

[0279] The processing component 702 may include one or more processors to execute computer instructions to complete all or part of the steps in the above-described method. Alternatively, the processing component may be implemented as one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0280] Storage component 701 is configured to store various types of data to support operations at the terminal. The storage component can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0281] Of course, computing devices may also include other components, such as input / output interfaces and communication components. Input / output interfaces provide an interface between processing components and peripheral interface modules, which can be output devices, input devices, etc. Communication components are configured to facilitate wired or wireless communication between the computing device and other devices.

[0282] Furthermore, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a computer, can perform the above-described functions. Figure 2 The data processing method of the embodiment shown.

[0283] like Figure 8 The diagram shown is a structural schematic of one embodiment of a data processing apparatus provided in this application. The apparatus may include:

[0284] The data receiving module 801 is used to receive multiple compressed target data packets of detection data.

[0285] The target data packet is obtained by reading multiple detection data from the data storage system; identifying valid data from the multiple detection data; converting the multiple valid data into corresponding data records according to a preset format conversion method; and compressing the multiple data records based on a preset data compression algorithm.

[0286] The data decompression module 802 is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain multiple data records.

[0287] The second conversion module 803 is used to convert multiple data records into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method.

[0288] The data restoration module 804 is used to perform data restoration processing on multiple valid data to obtain multiple detection data.

[0289] In some embodiments, the multiple detection data include: multiple industrial detection data obtained from the detection of the target industrial equipment and read from the data storage system.

[0290] The data receiving module can also be used to receive target data packets composed of multiple industrial testing data from the target industrial equipment.

[0291] As an example, multiple valid data entries each correspond to data content and time content; the time content includes a time key and the collection time.

[0292] The data restoration module may include:

[0293] The third determining unit is used to determine, based on the acquisition time corresponding to each of the multiple valid data, two valid data with the same data content and adjacent to each other as valid data in a detection group, so as to obtain at least one detection group and two valid data corresponding to each of the at least one detection group.

[0294] The data restoration unit is used to restore the detection data of any detection group by using two valid data points in the detection group and the data acquisition frequency, so as to obtain at least two detection data points corresponding to the detection group.

[0295] The fourth determining unit is used to determine other valid data that are not assigned to any detection group among multiple valid data, as well as multiple detection data consisting of at least two detection data corresponding to at least one detection group.

[0296] In some embodiments, the data decompression module includes:

[0297] The first decompression unit is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm, and obtain multiple data codes and time codes corresponding to at least one data group and at least one collected data record.

[0298] The fifth determining unit is used to determine multiple data records consisting of at least one collected data record corresponding to at least one data group.

[0299] As another embodiment, the second conversion module includes: a data acquisition unit, configured to decode multiple data codes and time codes corresponding to any data group, respectively, to obtain data keys corresponding to the multiple data codes and time keys corresponding to the time codes, so as to obtain multiple data keys and time keys corresponding to at least one data group.

[0300] The effective restoration unit is used to restore the key data of at least one collected data record corresponding to any data group based on multiple data keys and time keys, so as to obtain at least one valid data record corresponding to the data group; wherein, any valid data record includes data content and time content; the data content includes multiple data keys and the collected data corresponding to each data key; the time content includes the time key and the collection time;

[0301] The sixth determining unit is used to determine multiple valid data consisting of at least one valid data corresponding to at least one data group.

[0302] In one possible design, the data acquisition unit may include:

[0303] The code table receiving subunit is used to receive the data code tables corresponding to multiple data groups respectively; wherein, the data code table is generated based on the data code of each of the multiple data keys corresponding to at least one data group and the time code of the time key;

[0304] The code table lookup subunit is used to query the data code table to determine the data keys corresponding to multiple data codes of any data group and the time keys corresponding to time codes, so as to obtain at least one data group corresponding to multiple data keys and time keys; wherein, any two different data keys correspond to different data codes.

[0305] Data code tables can be generated by computing devices that perform data compression and can be received by computing devices that perform data decompression.

[0306] Figure 8 The data processing device can perform Figure 3 The implementation principle and technical effects of the data processing method in the illustrated embodiments will not be repeated here. The specific methods by which each module and unit of the data processing apparatus in the above embodiments perform operations have been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0307] In practical applications, Figure 8 The illustrated embodiment can be configured as a computing device, see reference. Figure 9 This is a schematic diagram of the structure of one embodiment of a computing device provided in this application. The device may include: a storage component 901 and a processing component 902; the storage component 901 is used to store one or more computer instructions; one or more computer instructions are invoked by the processing component 902 to execute. Figure 3 The data processing method shown in this embodiment.

[0308] The processing component 902 may include one or more processors to execute computer instructions to complete all or part of the steps in the above-described method. Alternatively, the processing component may be implemented as one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0309] Storage component 901 is configured to store various types of data to support operations at the terminal. The storage component can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0310] Of course, computing devices may also include other components, such as input / output interfaces and communication components. Input / output interfaces provide an interface between processing components and peripheral interface modules, which can be output devices, input devices, etc. Communication components are configured to facilitate wired or wireless communication between the computing device and other devices.

[0311] Furthermore, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a computer, can perform the above-described functions. Figure 3 The data processing method of the embodiment shown.

[0312] like Figure 10 The diagram shown is a structural schematic of one embodiment of a detection data processing device for industrial equipment provided in this application. The device may include:

[0313] The data acquisition module 1001 is used to acquire multiple industrial detection data obtained by sensing the target industrial equipment;

[0314] The valid identification module 1002 is used to identify valid data in multiple industrial testing data and obtain multiple valid data.

[0315] The first conversion module 1003 is used to convert multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records;

[0316] The data compression module 1004 is used to compress multiple data records based on a preset data compression algorithm to obtain a compressed target data packet.

[0317] Optionally, the data acquisition module can be used to read multiple industrial testing data obtained from the data storage system for the target industrial equipment.

[0318] Optionally, the data acquisition module can also be used to receive multiple industrial detection data points obtained by sensing from industrial equipment.

[0319] In this embodiment, the method is applicable to the compression of detection data from industrial equipment. After acquiring multiple industrial detection data points sensed by the target industrial equipment, valid data can be identified from these data points to obtain multiple valid data points, initially reducing the data volume of the multiple detection data points. Then, according to a preset format conversion method, the multiple valid data points are converted into corresponding data records to record and store the actual data within the valid data, further reducing the data volume of the multiple valid data points. Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet. After data deduplication and record conversion, the data size of the multiple stored data points is effectively compressed. Therefore, by utilizing the data compression algorithm, further data compression can be achieved, improving the compression efficiency of industrial detection data and ensuring data transmission efficiency.

[0320] Figure 10 The data processing device can perform Figure 1 The implementation principle and technical effects of the industrial equipment detection data compression method in the illustrated embodiment will not be repeated here. The specific methods by which each module and unit of the data processing device in the above embodiments performs its operations have been described in detail in the embodiments related to this method, and will not be elaborated upon here.

[0321] In practical applications, Figure 10 The illustrated embodiment can be configured as a computing device, see reference. Figure 11 This is a schematic diagram of the structure of one embodiment of a computing device provided in this application. The device may include: a storage component 1101 and a processing component 1102; the storage component 1101 is used to store one or more computer instructions; one or more computer instructions are invoked by the processing component 1102 to execute. Figure 3 The embodiment shown illustrates a method for processing detection data from industrial equipment.

[0322] The processing component 1102 may include one or more processors to execute computer instructions to complete all or part of the steps in the above-described method. Alternatively, the processing component may be implemented as one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0323] Storage component 1101 is configured to store various types of data to support operations at the terminal. The storage component can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0324] Of course, computing devices may also include other components, such as input / output interfaces and communication components. Input / output interfaces provide an interface between processing components and peripheral interface modules, which can be output devices, input devices, etc. Communication components are configured to facilitate wired or wireless communication between the computing device and other devices.

[0325] Furthermore, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a computer, can perform the above-described functions. Figure 1 The embodiment shown illustrates a method for compressing detection data from industrial equipment.

[0326] like Figure 12 The diagram shown is a structural schematic of one embodiment of a detection data processing device for industrial equipment provided in this application. The device may include:

[0327] The data receiving module 1201 is used to receive a target data packet after compression of multiple industrial detection data from the target industrial equipment. The target data packet is obtained by acquiring multiple industrial detection data obtained by sensing the target industrial equipment, identifying the valid data in the multiple industrial detection data, and after obtaining multiple valid data, converting the multiple valid data into corresponding data records according to a preset format conversion method to obtain multiple data records, and then compressing the multiple data records based on a preset data compression algorithm.

[0328] The data decompression module 1202 is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain multiple data records;

[0329] The second conversion module 1203 is used to convert multiple data records into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method;

[0330] The data restoration module 1204 is used to perform data restoration processing on multiple valid data to obtain multiple industrial testing data.

[0331] Among them, many industrial testing data can be obtained by reading the data from the data storage system for testing the target industrial equipment.

[0332] Specifically, the data receiving module can be used to receive a target data packet containing multiple industrial testing data from the target industrial equipment after compression.

[0333] In this embodiment, the computing device for data decompression can receive a target data packet sent by the computing device for data compression. This target data packet contains multiple industrial testing data points from a target industrial device. Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain multiple data records. These records are then converted into multiple valid data points using a conversion method opposite to a preset data format. The valid data is then restored to obtain multiple testing data points. The obtained target data packet is then restored to decompress the highly compressed target data packet, thereby obtaining complete multiple industrial testing data points and achieving efficient data transmission.

[0334] Figure 12 The data processing device can perform Figure 4 The implementation principle and technical effects of the industrial equipment detection data processing method in the illustrated embodiment will not be repeated here. The specific methods by which each module and unit of the data processing device in the above embodiments performs its operations have been described in detail in the embodiments related to this method, and will not be elaborated upon here.

[0335] In practical applications, Figure 12 The illustrated embodiment can be configured as a computing device, see reference. Figure 13 This is a schematic diagram of the structure of one embodiment of a computing device provided in this application. The device may include: a storage component 1301 and a processing component 1302; the storage component 1301 is used to store one or more computer instructions; one or more computer instructions are invoked by the processing component 1302 to execute. Figure 4 The embodiment shown illustrates a method for processing detection data from industrial equipment.

[0336] The processing component 1302 may include one or more processors to execute computer instructions to complete all or part of the steps in the above-described method. Alternatively, the processing component may be implemented as one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0337] Storage component 1301 is configured to store various types of data to support operations at the terminal. The storage component can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0338] Of course, computing devices may also include other components, such as input / output interfaces and communication components. Input / output interfaces provide an interface between processing components and peripheral interface modules, which can be output devices, input devices, etc. Communication components are configured to facilitate wired or wireless communication between the computing device and other devices.

[0339] Furthermore, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a computer, can perform the above-described functions. Figure 4 The embodiment shown illustrates a method for processing detection data from industrial equipment.

[0340] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0341] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of a necessary general-purpose hardware platform, or by a combination of hardware and software. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a computer product. This application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0342] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A method for processing detection data of industrial equipment, characterized in that, include: Acquire multiple industrial detection data points obtained from sensing the target industrial equipment; Identify valid data from the multiple industrial testing data sets to obtain multiple valid data sets; According to the preset format conversion method, the multiple valid data are converted into corresponding data records respectively to obtain multiple data records; Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet; The multiple industrial testing data points each correspond to data content and time content; the data content includes: multiple data keys and the collected data corresponding to each data key; the time content includes time keys and the collection time. The step of converting the multiple valid data into corresponding data records according to a preset format conversion method to obtain multiple data records includes: Based on multiple data keys corresponding to multiple valid data, valid data with the same data keys are grouped into the same data group to obtain at least one data group; wherein, each of the at least one data group includes at least one valid data. For any data group, extract multiple data keys and time keys corresponding to at least one valid data in the data group to obtain multiple data keys and time keys corresponding to the data group, so as to obtain multiple data keys and time keys corresponding to the at least one data group respectively. Based on multiple data keys and time keys corresponding to any data group, at least one valid data in the data group is extracted from the data collected at each of the multiple data keys and the time collected at the time key, respectively, to obtain the data collection records corresponding to the at least one valid data, so as to obtain at least one data collection record corresponding to the at least one data group. The plurality of data records are defined as at least one data record corresponding to at least one data group.

2. The method according to claim 1, characterized in that, The acquisition of multiple industrial detection data points obtained from sensing the target industrial equipment includes: Multiple industrial testing data points obtained from testing the target industrial equipment are read from the data storage system.

3. A data processing method, characterized in that, include: Read multiple detection data entries from the data storage system; Identify valid data from the multiple detection data sets to obtain multiple valid data sets; According to the preset format conversion method, the multiple valid data are converted into corresponding data records respectively to obtain multiple data records; Based on a preset data compression algorithm, the multiple data records are compressed to obtain a compressed target data packet; The multiple detection data points each correspond to data content and time content; the data content includes: multiple data keys and the collected data corresponding to each data key; the time content includes time keys and collection time. The step of converting the multiple valid data into corresponding data records according to a preset format conversion method to obtain multiple data records includes: Based on multiple data keys corresponding to multiple valid data, valid data with the same data keys are grouped into the same data group to obtain at least one data group; wherein, each of the at least one data group includes at least one valid data. For any data group, extract multiple data keys and time keys corresponding to at least one valid data in the data group to obtain multiple data keys and time keys corresponding to the data group, so as to obtain multiple data keys and time keys corresponding to the at least one data group respectively. Based on multiple data keys and time keys corresponding to any data group, at least one valid data in the data group is extracted from the data collected at each of the multiple data keys and the time collected at the time key, respectively, to obtain the data collection records corresponding to the at least one valid data, so as to obtain at least one data collection record corresponding to the at least one data group. The plurality of data records are defined as at least one data record corresponding to at least one data group.

4. The method according to claim 3, characterized in that, Each of the multiple detection data points corresponds to data content and time content; the time content includes a time key and the acquisition time. The process of identifying valid data from the multiple detection data sets and obtaining multiple valid data sets includes: The multiple detection data are divided into at least one detection group; wherein, any detection group includes at least one detection data with the same data content and consecutive collection time in the time content; If the number of at least one data point in any detection group is greater than 2, then the first and last data points in the detection group are determined to be valid data. If the number of at least one data point in any detection group is less than or equal to 2, then at least one data point in the detection group is determined to be valid data, so as to obtain valid data corresponding to at least one detection group respectively. The plurality of valid data are determined by identifying the valid data corresponding to each of the at least one detection group.

5. The method according to claim 4, characterized in that, The process of reading multiple detection data from the data storage system includes: The multiple detection data are read sequentially from the data storage system according to the order of collection time in the time content.

6. The method according to any one of claims 4 or 5, characterized in that, The process of compressing the multiple data records based on a preset data compression algorithm to obtain the compressed target data packet includes: Based on a preset data compression algorithm, at least one collected data record corresponding to each of the at least one data group, as well as multiple data keys and time keys corresponding to each of the at least one data group, are compressed to obtain a compressed target data packet.

7. The method according to claim 6, characterized in that, After determining the plurality of data records consisting of at least one collected data record corresponding to at least one data group, the method further includes: For any given data group, the multiple data keys and time keys corresponding to the data group are encoded to obtain the data codes corresponding to the multiple data keys and the time codes corresponding to the time keys, so as to obtain the multiple data codes and time codes corresponding to the at least one data group; wherein, the data codes corresponding to any two different data keys are different. The step, based on a preset data compression algorithm, compresses at least one collected data record corresponding to each of the at least one data group, as well as multiple data keys and time keys corresponding to each of the at least one data group, to obtain a compressed target data packet, including: Based on a preset data compression algorithm, at least one collected data record corresponding to each of the at least one data group, as well as multiple data codes and time codes corresponding to each of the at least one data group, are compressed to obtain a compressed target data packet.

8. The method according to claim 7, characterized in that, For any given data group, encoding multiple data keys and a time key corresponding to the data group to obtain data codes corresponding to the multiple data keys and time codes corresponding to the time keys, thereby obtaining multiple data codes and time codes corresponding to the at least one data group, includes: Based on preset data code generation rules, corresponding data codes and time codes are generated for multiple data keys and time keys corresponding to any data group, thereby obtaining multiple data codes and time codes corresponding to the data group, and thus obtaining multiple data codes and time codes corresponding to the at least one data group respectively.

9. The method according to claim 8, characterized in that, The data code generation rules specifically include: Based on the key arrangement order corresponding to multiple data keys and time keys of any data group, data codes are generated for the multiple data keys and time codes are generated for the time keys, so as to obtain multiple data codes and time codes corresponding to the data group. Wherein, the character length of the data code corresponding to any of the data keys is less than the character length of the data key, and the character length of the time code corresponding to any of the time keys is less than the character length of the time key.

10. The method according to claim 7, characterized in that, The method further includes: Based on the data codes corresponding to multiple data keys and the time codes corresponding to time keys of any data group, a data code table for the data group is generated to obtain the data code tables corresponding to the multiple data groups respectively.

11. The method according to claim 3, characterized in that, Also includes: The target data packet is sent to the receiving device, which then decompresses the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain the multiple data records; the multiple data records are converted into multiple valid data according to a conversion method opposite to the preset format conversion method; and the multiple valid data are restored to obtain the multiple detection data.

12. The method according to claim 3, characterized in that, The process of reading multiple detection data from the data storage system includes: Read multiple industrial testing data points obtained from the testing of the target industrial equipment from the data storage system.

13. A data processing method, characterized in that, include: The system receives a target data packet after compressing multiple detection data sets. The target data packet is obtained by reading multiple detection data sets from a data storage system, identifying valid data within these sets, and then converting each set of valid data into corresponding data records according to a preset format conversion method. These data records are then compressed using a preset data compression algorithm. Each set of detection data sets corresponds to data content and time content. The data content includes multiple data keys and the corresponding acquisition data. The time content includes a time key and the acquisition time. The process of converting the multiple valid data sets into corresponding data records according to the preset format conversion method to obtain multiple data records involves: based on the multiple data keys corresponding to the multiple valid data sets, converting data sets with identical data keys into corresponding data records. Effective data are divided into the same data group to obtain at least one data group; wherein, each of the at least one data group includes at least one effective data; for any data group, multiple data keys and time keys corresponding to at least one effective data in the data group are extracted to obtain multiple data keys and time keys corresponding to the data group, so as to obtain multiple data keys and time keys corresponding to the at least one data group respectively; based on the multiple data keys and time keys corresponding to any data group, the acquisition data of at least one effective data in the data group at each of the multiple data keys and the acquisition time corresponding to the time key are extracted to obtain acquisition data records corresponding to the at least one effective data, so as to obtain at least one acquisition data record corresponding to the at least one data group respectively; the multiple data records constituted by at least one acquisition data record corresponding to at least one data group respectively are determined; Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain the multiple data records; The multiple data records are converted into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method; The multiple valid data points are processed to restore the data and obtain the multiple detection data points.

14. The method according to claim 13, characterized in that, Each of the multiple valid data entries corresponds to data content and time content; the time content includes a time key and the collection time. The process of restoring the multiple valid data to obtain the multiple detection data includes: Based on the collection time corresponding to the multiple valid data, two valid data with the same data content and adjacent to each other are determined as valid data in a detection group, so as to obtain at least one detection group and two valid data corresponding to the at least one detection group. For any detection group, using two valid data points in the detection group and the data acquisition frequency, the detection data of the detection group is reconstructed to obtain at least two detection data points corresponding to the detection group. The plurality of valid data is determined by identifying other valid data that are not assigned to any detection group and the plurality of detection data consisting of at least two detection data corresponding to each of the at least one detection group.

15. The method according to any one of claim 13 or 14, characterized in that, The decompression algorithm based on the data compression algorithm, used to decompress the target data packet and obtain the multiple data records, includes: Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain at least one data group corresponding to multiple data codes and time codes, as well as at least one collected data record. The plurality of data records are defined as at least one data record corresponding to at least one data group.

16. The method according to claim 15, characterized in that, The step of converting the multiple data records into multiple valid data records according to a conversion method opposite to the preset format conversion method includes: For any data group, the multiple data codes and time codes corresponding to the data group are decoded respectively to obtain the data keys corresponding to the multiple data codes and the time keys corresponding to the time codes, so as to obtain the multiple data keys and time keys corresponding to the at least one data group. Based on multiple data keys and a time key corresponding to any data group, key data restoration is performed on at least one collected data record corresponding to the data group to obtain at least one valid data record corresponding to the data group; wherein, any valid data record includes data content and time content; the data content includes: multiple data keys and the collected data corresponding to each data key; the time content includes the time key and the collection time; Determine multiple valid data sets consisting of at least one valid data set corresponding to each of the at least one data set.

17. The method according to claim 16, characterized in that, For any given data group, the process of decoding the multiple data codes and time codes corresponding to the data group to obtain the data keys corresponding to the multiple data codes and the time keys corresponding to the time codes, thereby obtaining the multiple data keys and time keys corresponding to the at least one data group, includes: Receive data code tables corresponding to multiple data groups respectively; wherein, the data code table is generated based on the data code of each of the multiple data keys corresponding to the at least one data group and the time code of the time key; The data code table is queried to determine the data keys corresponding to the multiple data codes of any data group and the time keys corresponding to the time codes, so as to obtain the multiple data keys and time keys corresponding to the at least one data group; wherein, any two different data keys correspond to different data codes.

18. The method according to claim 13, characterized in that, The multiple detection data include: multiple industrial detection data obtained from the data storage system for the detection of the target industrial equipment; The target data packet after receiving multiple compressed detection data includes: Receive the target data packet, which is a compressed version of multiple industrial testing data from the target industrial equipment.

19. A method for processing detection data of industrial equipment, characterized in that, include: The system receives a target data packet containing compressed industrial detection data from a target industrial equipment. The target data packet consists of multiple industrial detection data points obtained from sensing the target industrial equipment, identifying valid data points within these data points, and then converting each valid data point into a corresponding data record according to a preset format conversion method. This results in multiple data records, which are then compressed using a preset data compression algorithm. Each industrial detection data point corresponds to both data content and time content. The data content includes multiple data keys and the corresponding acquisition data. The time content includes a time key and the acquisition time. The process of converting the multiple valid data points into corresponding data records according to the preset format conversion method to obtain multiple data records involves: based on the multiple data keys corresponding to the valid data points, ... Multiple valid data with the same data key are grouped into the same data group to obtain at least one data group; wherein, each of the at least one data group includes at least one valid data; for any data group, multiple data keys and time keys corresponding to at least one valid data in the data group are extracted to obtain multiple data keys and time keys corresponding to the data group, thereby obtaining multiple data keys and time keys corresponding to the at least one data group respectively; based on the multiple data keys and time keys corresponding to any data group, the acquisition data of at least one valid data in the data group at each of the multiple data keys and the acquisition time corresponding to the time key are extracted to obtain acquisition data records corresponding to the at least one valid data, thereby obtaining at least one acquisition data record corresponding to the at least one data group respectively; the multiple data records consisting of at least one acquisition data record corresponding to at least one data group are determined. Based on the decompression algorithm corresponding to the data compression algorithm, the target data packet is decompressed to obtain the multiple data records; The multiple data records are converted into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method; Data restoration processing is performed on the multiple valid data to obtain the multiple industrial testing data.

20. The method according to claim 19, characterized in that, The multiple detection data include: Multiple industrial testing data points obtained from the testing of the target industrial equipment are read from the data storage system.

21. A data processing device for testing industrial equipment, characterized in that, include: The data acquisition module is used to acquire multiple industrial detection data points obtained from sensing the target industrial equipment; The effective identification module is used to identify the effective data in the multiple industrial test data and obtain multiple effective data. The first conversion module is used to convert the multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records. The multiple industrial testing data each correspond to data content and time content. The data content includes multiple data keys and the acquisition data corresponding to each data key. The time content includes a time key and the acquisition time. The conversion of the multiple valid data into corresponding data records according to the preset format conversion method to obtain multiple data records includes: based on the multiple data keys corresponding to the multiple valid data, grouping valid data with the same multiple data keys into the same data group, thereby obtaining at least one data group. Each at least one data group includes at least one valid data record. For any given data group, extract multiple data keys and time keys corresponding to at least one valid data point in the data group to obtain multiple data keys and time keys corresponding to the data group, thereby obtaining multiple data keys and time keys corresponding to the at least one data group respectively; based on the multiple data keys and time keys corresponding to any given data group, extract the acquisition data of at least one valid data point in the data group at each of the multiple data keys and the acquisition time corresponding to the time key, thereby obtaining acquisition data records corresponding to the at least one valid data point, thereby obtaining at least one acquisition data record corresponding to the at least one data group respectively; determine the multiple data records consisting of at least one acquisition data record corresponding to at least one data group respectively; The data compression module is used to compress the multiple data records based on a preset data compression algorithm to obtain a compressed target data packet.

22. A data processing apparatus, characterized in that, include: The data reading module is used to read multiple pieces of detection data from the data storage system; The effective identification module is used to identify the effective data among the multiple detection data and obtain multiple effective data. The first conversion module is used to convert the multiple valid data into corresponding data records according to a preset format conversion method, thereby obtaining multiple data records. Each of the multiple detection data points corresponds to data content and time content. The data content includes multiple data keys and the acquisition data corresponding to each data key. The time content includes a time key and the acquisition time. The conversion of the multiple valid data into corresponding data records according to the preset format conversion method to obtain multiple data records includes: based on the multiple data keys corresponding to the multiple valid data points, grouping valid data points with identical data keys into the same data group, thereby obtaining at least one data group. Each of the at least one data group includes at least one valid data point. For any given data group, extract multiple data keys and time keys corresponding to at least one valid data point in the data group to obtain multiple data keys and time keys corresponding to the data group, thereby obtaining multiple data keys and time keys corresponding to the at least one data group respectively; based on the multiple data keys and time keys corresponding to any given data group, extract the acquisition data of at least one valid data point in the data group at each of the multiple data keys and the acquisition time corresponding to the time key, thereby obtaining acquisition data records corresponding to the at least one valid data point, thereby obtaining at least one acquisition data record corresponding to the at least one data group respectively; determine the multiple data records consisting of at least one acquisition data record corresponding to the at least one data group respectively. The data compression module is used to compress the multiple data records based on a preset data compression algorithm to obtain a compressed target data packet.

23. A data processing apparatus, characterized in that, include: A data receiving module is used to receive a target data packet after compression of multiple detection data. The target data packet is obtained by a computing device reading multiple detection data from a data storage system. The module identifies valid data from the multiple detection data, obtaining multiple valid data. According to a preset format conversion method, the multiple valid data are converted into corresponding data records, obtaining multiple data records. Based on a preset data compression algorithm, the multiple data records are compressed. Each of the multiple detection data corresponds to data content and time content. The data content includes multiple data keys and the acquisition data corresponding to each data key. The time content includes a time key and the acquisition time. The step of converting the multiple valid data into corresponding data records according to the preset format conversion method to obtain multiple data records includes: based on the multiple data keys corresponding to the multiple valid data, converting the multiple data keys into corresponding data records, obtaining multiple data records, and then... Identical valid data are grouped into the same data group to obtain at least one data group; wherein, each of the at least one data group includes at least one valid data; for any data group, multiple data keys and time keys corresponding to at least one valid data in the data group are extracted to obtain multiple data keys and time keys corresponding to the data group, thereby obtaining multiple data keys and time keys corresponding to the at least one data group; based on the multiple data keys and time keys corresponding to any data group, the acquisition data of at least one valid data in the data group at each of the multiple data keys and the acquisition time corresponding to the time key are extracted to obtain acquisition data records corresponding to the at least one valid data, thereby obtaining at least one acquisition data record corresponding to the at least one data group; the multiple data records constituted by at least one acquisition data record corresponding to at least one data group are determined; The data decompression module is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain the multiple data records. The second conversion module is used to convert the multiple data records into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method; The data restoration module is used to perform data restoration processing on the multiple valid data to obtain the multiple detection data.

24. A data processing device for testing industrial equipment, characterized in that, include: A data receiving module is used to receive a target data packet compressed from multiple industrial detection data points of a target industrial equipment. The target data packet consists of multiple industrial detection data points sensed by the target industrial equipment, valid data points identified within these data points, and after obtaining multiple valid data points, the data points are converted into corresponding data records according to a preset format conversion method. These data records are then compressed using a preset data compression algorithm. Each set of industrial detection data points corresponds to data content and time content. The data content includes multiple data keys and the corresponding acquisition data for each data key. The time content includes a time key and the acquisition time. The process of converting the multiple valid data points into corresponding data records according to the preset format conversion method to obtain multiple data records includes: multiple data keys corresponding to each valid data point... Data keys are used to group valid data with the same data key into the same data group to obtain at least one data group; wherein, each of the at least one data group includes at least one valid data; for any data group, multiple data keys and time keys corresponding to at least one valid data in the data group are extracted to obtain multiple data keys and time keys corresponding to the data group, so as to obtain multiple data keys and time keys corresponding to the at least one data group respectively; based on the multiple data keys and time keys corresponding to any data group, the acquisition data of at least one valid data in the data group is extracted respectively from the acquisition data of each of the multiple data keys and the acquisition time corresponding to the time key, so as to obtain the acquisition data record corresponding to each of the at least one valid data, so as to obtain at least one acquisition data record corresponding to each of the at least one data group; the multiple data records constituted by the at least one acquisition data record corresponding to each of the at least one data group are determined. The data decompression module is used to decompress the target data packet based on the decompression algorithm corresponding to the data compression algorithm to obtain the multiple data records. The second conversion module is used to convert the multiple data records into multiple valid data records according to a conversion method that is the opposite of the preset format conversion method; The data restoration module is used to perform data restoration processing on the multiple valid data to obtain the multiple industrial testing data.

25. A computing device, characterized in that, It includes: a storage component and a processing component; the storage component is used to store one or more computer instructions; the one or more computer instructions are invoked by the processing component to execute the method according to any one of claims 1 to 2.

26. A computing device, characterized in that, It includes: a storage component and a processing component; the storage component is used to store one or more computer instructions; the one or more computer instructions are invoked by the processing component to execute the method according to any one of claims 3 to 12.

27. A computing device, characterized in that, It includes: a storage component and a processing component; the storage component is used to store one or more computer instructions; the one or more computer instructions are invoked by the processing component to execute the method according to any one of claims 13 to 18.

28. A computing device, characterized in that, It includes: a storage component and a processing component; the storage component is used to store one or more computer instructions; the one or more computer instructions are invoked by the processing component to execute the method according to any one of claims 19 to 20.

Images