Information lossless electronic submission system

Abstract

The invention discloses an information lossless electronic submission system, relates to the technical field of information transmission and analysis, and solves the problems that data formats are diversified, data loss is easily caused in a conversion process, proper transmission protocols and processing modes cannot be selected in a targeted manner, and the attention on link stability is insufficient in a transmission process. In order to solve the technical problem that data transmission is unstable or failed possibly due to the fact that data transmission is not stable, data is accurately divided into private data and conventional data according to data content, proper transmission protocols are selected for different types of data, and different packaging processing is performed according to the data types, so that the security and pertinence of data transmission are improved, and the data transmission efficiency is improved. By monitoring the stability of a transmission link, different processing is performed on private data and conventional data according to the stability of the link, and a corresponding conventional data processing and matching mode is adopted for an unstable link, so that the stability and efficiency of data transmission are improved, and the data can be transmitted more safely and efficiently.

Description

Technical Field

[0001] The present invention relates to the technical field of information transmission and analysis, and in particular to a lossless electronic reporting system for information. Background Art

[0002] With the development of information technology, data reporting has been widely used in various fields. In the process of data reporting, it is very important to ensure the lossless transmission of data.

[0003] The patent application with publication number CN214756508U discloses a device and system for lossless reporting of relay protection information of a substation, wherein the device comprises: a plurality of information acquisition devices connected to the protection device of the substation, for acquiring the fixed value information of the protection device; a lossless electronic conversion device connected to the plurality of the information acquisition devices, for converting the fixed value information into a unified format; and a first communication device connected to the lossless electronic conversion device, for sending the converted fixed value information.

[0004] However, when some existing reporting systems are in use, they may not be able to fully and accurately collect the required information during the data collection process. The data formats are diverse and data loss is likely to occur during the conversion process. The data classification is not detailed enough, and it is impossible to select the appropriate transmission protocol and processing method in a targeted manner. Insufficient attention is paid to link stability during the transmission process, which may lead to unstable or failed data transmission. Summary of the invention

[0005] In view of the shortcomings of the prior art, the present invention provides an information lossless electronic reporting system, which solves the problems of diverse data formats and easy data loss during the conversion process, the inability to select appropriate transmission protocols and processing methods in a targeted manner, and insufficient attention to link stability during the transmission process, which may lead to unstable or failed data transmission.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solutions: an information lossless electronic reporting system, comprising:

[0007] The information collection module is used to collect the data information required to be reported, and transmit the collected data information to the information classification processing module;

[0008] An information classification processing module is used to analyze the acquired data information, analyze and convert the data format of the data information to obtain format conversion data, and classify the data content corresponding to the format conversion data to obtain privacy data and regular data, generate data classification information, and transmit it to the classification information adaptive processing module;

[0009] The classification information adaptive processing module is used to process the obtained data classification information. By determining the corresponding transmission protocol according to different data contents, and performing data encapsulation processing on different classified data to obtain encapsulated data. At the same time, secondary classification is performed according to the data capacity of the encapsulated data to obtain large-capacity encapsulated data and small-capacity encapsulated data, and secondary classification information is generated. Then it is transmitted to the information transmission analysis module;

[0010] The information transmission analysis module is used to process the obtained secondary classification information. By selecting a suitable compression method for the large-capacity data to obtain compressed data, and performing transmission processing on the privacy data and the normal data according to the transmission conditions corresponding to different transmission links to generate transmission information. Then it is transmitted to the reporting processing generation module;

[0011] The reporting processing generation module is used to transmit the data information according to the generated transmission information.

[0012] As a further solution of the present invention, the specific manner in which the information classification processing module analyzes the data information is as follows:

[0013] Obtain all data information and label it as i, and i = 1, 2,..., j, where j represents the number of data information. Then obtain the data format corresponding to the data information, and at the same time obtain the transmission loss corresponding to different data formats. Select the data format with the smallest transmission loss as the standard format. Then convert the data information i according to the standard format to obtain format conversion data.

[0014] As a further solution of the present invention, the specific manner in which the information classification processing module generates data classification information is as follows:

[0015] Obtain all the format conversion data, and at the same time obtain the data content corresponding to the format conversion data. Classify the format conversion data according to the data content to obtain privacy data and normal data, and denote them as a and b respectively, where a = 1, 2,..., n, where b = 1, 2,..., m, where n and m respectively represent the number of privacy data and normal data. At the same time, transmit the classified privacy data and normal data to the classification information adaptive processing module.

[0016] As a further solution of the present invention, the specific manner in which the classification information adaptive processing module processes the data classification information is as follows:

[0017] Obtain the corresponding private data and regular data in the data classification information, then select the corresponding transmission protocols for the private data and regular data respectively, and conduct transmission analysis based on the selected transmission protocols. At the same time, perform encapsulation processing on the private data and regular data, obtain the private data, and identify the corresponding data types of the private data, and perform different encapsulation processing according to different data types. Similarly, analyze the regular data and obtain the encapsulated data, and then conduct secondary classification on the encapsulated data.

[0018] As a further solution of the present invention, the specific manner in which the classification information adaptive processing module conducts secondary classification on the encapsulated data is as follows:

[0019] Obtain the corresponding private encapsulated data in the encapsulated data, then obtain the data capacity corresponding to the private encapsulated data, and compare the data capacity with the preset capacity. At the same time, classify the private encapsulated data with a data capacity greater than the preset capacity as high-privacy encapsulated data, and classify the private encapsulated data with a data capacity less than the preset capacity as low-privacy encapsulated data;

[0020] Similarly, classify the regular encapsulated data in the encapsulated data and generate secondary classification information, and then transmit the secondary classification information to the information transmission analysis module.

[0021] As a further solution of the present invention, the specific manner in which the information transmission analysis module processes the secondary classification information is as follows:

[0022] Obtain the high-privacy data and high-regular data corresponding to the secondary classification information, then perform compression processing on them respectively to obtain private compressed data and regular compressed data. At the same time, obtain the corresponding transmission link and label it as o, and o = 1, 2,..., p, where p represents the number of transmission links, and take time T as the period to obtain the transmission speed fluctuation difference corresponding to transmission link o, and compare the obtained transmission speed fluctuation difference with the preset difference;

[0023] If the transmission speed fluctuation difference is greater than the preset difference, it indicates that the transmission situation of the corresponding transmission link is unstable, and mark it as an unstable link. On the contrary, if the transmission speed fluctuation difference is less than the preset difference, it indicates that the transmission situation of the corresponding transmission link is stable, and mark it as a stable link.

[0024] As a further solution of the present invention, the specific manner in which the information transmission analysis module conducts transmission processing on the private data according to the transmission situations corresponding to different transmission links to generate transmission information is as follows:

[0025] Obtain all stable links, obtain the corresponding transmission speeds, sort the stable links from largest to smallest according to the transmission speeds, then obtain the privacy-compressed data and the low-encapsulation privacy data, obtain the corresponding data capacities, and bundle the privacy-compressed data and the low-encapsulation privacy data to obtain a privacy transmission data packet;

[0026] Generate privacy transmission data packets in this way, obtain the combined capacities corresponding to the privacy transmission data packets, and sequentially perform transmission matching with the stable links from largest to smallest according to the combined capacities, and generate transmission information.

[0027] As a further solution of the present invention, the specific manner in which the information transmission analysis module processes conventional data according to the transmission conditions corresponding to different transmission links to generate transmission information is as follows:

[0028] Then obtain all unstable links, obtain the corresponding transmission speeds, obtain the conventional compressed data and the low-encapsulation conventional data, and generate conventional transmission data packets in the same way as the processing method of the privacy data. Then, sequentially perform transmission matching with the unstable links from largest to smallest according to the combined capacities of the conventional transmission data packets, and generate transmission information.

[0029] The present invention provides an information lossless electronic submission system. Compared with the prior art, it has the following

[0030] Beneficial effects:

[0031] The present invention accurately classifies data into privacy data and conventional data according to the data content, selects appropriate transmission protocols for different types of data, and performs different encapsulation processes according to the data types, improving the security and pertinence of data transmission. By monitoring the stability of the transmission links, obtaining the transmission speed fluctuation difference with a time period of T, comparing it with the preset difference, marking the stable links and unstable links, and performing different processes on the privacy data and conventional data according to the link stability, bundling the privacy-compressed data and the low-encapsulation privacy data to generate a privacy transmission data packet, and matching and transmitting it with the stable link according to the combined capacity; also adopting corresponding conventional data processing and matching methods for the unstable links, improving the stability and efficiency of data transmission, and ensuring that the data can be transmitted more safely and efficiently. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a system principle block diagram of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0034] Embodiment 1. Please refer to Figure 1 , this application provides a lossless electronic submission system for information, including: an information collection module, an information classification and processing module, a classification information adaptive processing module, an information transmission analysis module, and a submission processing and generation module. And it can be known from Figure 1 that the above functional modules are unidirectionally electrically connected.

[0035] The information collection module is used to collect the data information to be submitted, and at the same time transmit the collected data information to the information classification and processing module.

[0036] The information classification and processing module is used to analyze the acquired data information, obtain format conversion data by analyzing and converting the data format of the data information, classify the privacy data and regular data according to the data content corresponding to the format conversion data, generate data classification information, and at the same time transmit it to the classification information adaptive processing module.

[0037] Obtain all the data information and label it as i, and i = 1, 2,..., j, where j represents the number of data information. Then obtain the data format corresponding to the data information, and at the same time obtain the transmission loss corresponding to different data formats. And the transmission loss here represents the transmission loss of the data information itself. Then select the data format corresponding to the minimum transmission loss as the standard format. And there may be a situation of lossless transmission loss in the standard format here. Then convert the data information i according to the standard format to obtain format conversion data;

[0038] For example, if the data information is a picture, its possible formats are JPEG, PNG, etc. The JPEG format may lose some image details during compression, resulting in transmission loss, while the PNG format can achieve lossless transmission in some cases. Further, convert the data formats corresponding to all data information to the PNG format.

[0039] Next, obtain all format conversion data, where the format conversion data includes data information that has undergone format conversion and data information that has not undergone format conversion. At the same time, obtain the data content corresponding to the format conversion data, and classify the format conversion data according to the data content to obtain private data and regular data, denoted as a and b respectively, where a = 1, 2, …, n, where b = 1, 2, …, m, where n and m represent the quantities of private data and regular data respectively. At the same time, transmit the classified private data and regular data to the classification information adaptive processing module. For example, assume there is a data set containing employee information. After format conversion, the data set contains information such as the names, ages, contact information, salaries, and ID numbers of employees. Among them, data such as salaries and ID numbers that involve personal privacy are classified as private data.

[0040] The classification information adaptive processing module is used to process the obtained data classification information. By determining the corresponding transmission protocol according to different data contents, and performing data encapsulation processing on different classified data to obtain encapsulated data. At the same time, perform secondary classification on the encapsulated data according to the data capacity of the encapsulated data to obtain large-capacity encapsulated data and small-capacity encapsulated data, and generate secondary classification information. Then transmit it to the information transmission analysis module.

[0041] Obtain the corresponding private data and regular data in the data classification information, and then select the corresponding transmission protocols for the private data and regular data respectively. Specifically, one is the secure protocol based on HTTP (such as HTTPS), and the other is the private network transmission protocol (such as VPN within an enterprise, etc.). The selection of the transmission protocol is based on the actual situation of the data, and perform transmission analysis based on the selected transmission protocol. At the same time, perform encapsulation processing on the private data and regular data, obtain the private data, and at the same time identify the data types corresponding to the private data, and perform different encapsulation processing according to different data types. The specific encapsulation processing includes data frame encapsulation and file encapsulation. Among them, data frame encapsulation is mainly for types such as text, images, audio, or video, while file encapsulation is for different files. Similarly, analyze the regular data and obtain the encapsulated data. Here, the encapsulated data includes private encapsulated data and regular encapsulated data;

[0042] For example, in an enterprise's office system, the employee's payslip belongs to private data and usually exists in the form of an electronic spreadsheet file (such as.xlsx). Perform file encapsulation on it, record the relevant information of the file at the file header, and add a hash value at the file tail. While the employee's daily work report document (such as.docx format) belongs to regular data and also undergoes file encapsulation processing. During the transmission process, the payslip data can be selected to be transmitted through the VPN within the enterprise, while the work report document can be selected to be transmitted using the HTTPS protocol according to the actual situation.

[0043] Obtain the corresponding privacy encapsulated data in the encapsulated data, and then obtain the data capacity corresponding to the privacy encapsulated data. This data capacity can be measured by a built-in file or data size measurement tool in the system, in units such as bytes, kilobytes, megabytes, etc., depending on the size range of the data. Compare the data capacity with a preset capacity, and the specific value of the preset capacity is set by the operator himself. At the same time, classify the privacy encapsulated data with a data capacity greater than the preset capacity as high-privacy encapsulated data, and classify the privacy encapsulated data with a data capacity less than the preset capacity as low-privacy encapsulated data. Similarly, classify the regular encapsulated data in the encapsulated data and generate secondary classification information, and then transmit the secondary classification information to the information transmission analysis module.

[0044] Information transmission analysis module, which is used to process the obtained secondary classification information. Compress the large-capacity data by selecting a suitable compression method to obtain compressed data, and perform transmission processing on the privacy data and the regular data according to the transmission conditions corresponding to different transmission links to generate transmission information, and then transmit it to the reporting processing generation module.

[0045] Obtain the high-privacy data and high-regular data corresponding to the secondary classification information, and then perform compression processing on them respectively. During the compression process, it is necessary to analyze according to the integrity of the compressed data itself, and select the compression method with the least data loss among all compression methods as the standard to further compress the two to obtain privacy compressed data and regular compressed data. At the same time, obtain the corresponding transmission link and label it as o, and o = 1, 2,..., p, where p represents the number of transmission links. Take time T as the period to obtain the transmission speed fluctuation difference corresponding to transmission link o, and compare the obtained transmission speed fluctuation difference with a preset difference. The specific value of the preset difference is set by the operator. If the transmission speed fluctuation difference is greater than the preset difference, it means that the transmission condition of the corresponding transmission link is unstable, and mark it as an unstable link. On the contrary, if the transmission speed fluctuation difference is less than the preset difference, it means that the transmission condition of the corresponding transmission link is stable, and mark it as a stable link;

[0046] Suppose there is a data transmission system for a large e-commerce enterprise. The enterprise has three transmission links, i.e., p = 3, which are the internal network link of the enterprise (0 = 1), the Internet link through a telecommunications operator (0 = 2), and the backup mobile network link (0 = 3). The transmission speed is monitored in a cycle of every hour (T = 1 hour). The operator sets a preset difference of 10 Mbps based on past experience and network conditions. During the monitoring process, it is found that the transmission speed of the Internet link through the telecommunications operator (0 = 2) fluctuates between 50 Mbps and 100 Mbps within one hour, and the fluctuation difference is 50 Mbps, which is greater than the preset difference of 10 Mbps. Therefore, this link is marked as an unstable link. While the transmission speed of the internal network link of the enterprise (o = 1) fluctuates between 95 Mbps and 98 Mbps, and the fluctuation difference is 3 Mbps, which is less than the preset difference, so it is marked as a stable link. Privacy-compressed data and regular compressed data can be preferentially transmitted through the stable link. For the unstable link, optimization can be considered or it can be used as a backup only when the stable link fails.

[0047] Then obtain all the stable links, and obtain the corresponding transmission speeds. Here, the transmission speed is the average value of the transmission speeds corresponding to the stable links within the time period T. At the same time, sort the stable links in descending order according to the transmission speed. Then obtain the privacy-compressed data and the low-encapsulation privacy data, and obtain the corresponding data capacities. At the same time, bundle the privacy-compressed data and the low-encapsulation privacy data to obtain a privacy transmission data packet. Here, the low-encapsulation privacy data corresponding to the maximum and minimum capacities in the privacy-compressed data are bundled pairwise, and so on to generate privacy transmission data packets. Then obtain the combined capacity corresponding to the privacy transmission data packets, and sequentially perform transmission matching with the stable links in descending order according to the combined capacity, and generate transmission information;

[0048] Then obtain all the unstable links, and obtain the corresponding transmission speeds. At the same time, obtain the regular compressed data and the low-encapsulation regular data, and generate regular transmission data packets in the same way as the processing method of the privacy data. Then sequentially perform transmission matching with the unstable links in descending order according to the combined capacity of the regular transmission data packets, and generate transmission information;

[0049] Transmit the generated transmission information to the reporting processing generation module.

[0050] The reporting processing generation module is used to transmit the data information according to the generated transmission information.

[0051] Some of the data in the above formula are numerically calculated by taking their dimensions. At the same time, the content not described in detail in this specification belongs to the prior art well-known to those skilled in the art.

[0052] The above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. An information lossless electronic reporting system, characterized in that: include: The information collection module is used to collect the data information required to be reported, and transmit the collected data information to the information classification processing module; An information classification processing module is used to analyze the acquired data information, analyze and convert the data format of the data information to obtain format conversion data, and classify the data content corresponding to the format conversion data to obtain privacy data and regular data, generate data classification information, and transmit it to the classification information adaptive processing module; The classification information adaptive processing module is used to process the acquired data classification information, determine the corresponding transmission protocol according to different data contents, and perform data encapsulation processing on different classification data to obtain encapsulated data, and perform secondary classification according to the data capacity of the encapsulated data to obtain large-capacity encapsulated data and small-capacity encapsulated data, and generate secondary classification information, which is then transmitted to the information transmission analysis module; The information transmission analysis module is used to process the acquired secondary classification information, obtain compressed data by selecting a suitable compression method for large-capacity data, and perform transmission processing on private data and regular data according to the transmission conditions corresponding to different transmission links, generate transmission information, and then transmit it to the reporting processing generation module; The reporting processing generation module is used to transmit data information according to the generated transmission information.

2. According to claim 1, the information lossless electronic reporting system is characterized in that: The specific way in which the information classification processing module analyzes the data information is as follows: All data information is obtained and labeled as i, where i=1, 2, ..., j, where j represents the number of data information. Then the data format corresponding to the data information is obtained, and the transmission loss corresponding to different data formats is obtained. The data format corresponding to the minimum transmission loss is selected as the standard format. Then the data information i is converted according to the standard format to obtain format conversion data.

3. The information lossless electronic reporting system according to claim 1 is characterized in that: The specific method of generating data classification information by the information classification processing module is as follows: All format conversion data are obtained, and at the same time, the data content corresponding to the format conversion data is obtained, and the format conversion data is classified according to the data content to obtain privacy data and regular data, and are denoted as a and b respectively, where a=1, 2, ..., n, and b=1, 2, ..., m, where n and m represent the number of privacy data and regular data respectively, and the classified privacy data and regular data are transmitted to the classification information adaptive processing module.

4. The information lossless electronic reporting system according to claim 1 is characterized in that: The specific method in which the classification information adaptive processing module processes the data classification information is as follows: Obtain the corresponding privacy data and regular data in the data classification information, then select the corresponding transmission protocols for the privacy data and regular data respectively, and perform transmission analysis based on the selected transmission protocols. At the same time, encapsulate the privacy data and regular data to obtain the privacy data. At the same time, identify the data type corresponding to the privacy data, and perform different encapsulation processing according to different data types. Similarly, analyze the regular data and obtain the encapsulated data, and then perform secondary classification on the encapsulated data.

5. The information lossless electronic reporting system according to claim 4 is characterized in that: The specific method of the classification information adaptive processing module to perform secondary classification on the encapsulated data is: Obtain the privacy encapsulated data corresponding to the encapsulated data, then obtain the data capacity corresponding to the privacy encapsulated data, and compare the data capacity with the preset capacity, and classify the privacy encapsulated data with a data capacity greater than the preset capacity as high-privacy encapsulated data, and classify the privacy encapsulated data with a data capacity less than the preset capacity as low-privacy encapsulated data; Similarly, the regular encapsulation data in the encapsulation data is classified and secondary classification information is generated, and then the secondary classification information is transmitted to the information transmission analysis module.

6. The information lossless electronic reporting system according to claim 1 is characterized in that: The specific method in which the information transmission analysis module processes the secondary classification information is as follows: Obtain high privacy data and high regular data corresponding to the secondary classification information, and then compress them respectively to obtain privacy compressed data and regular compressed data, and at the same time obtain the corresponding transmission link and mark it as o, where o=1, 2, ..., p, where p represents the number of transmission links, and obtain the transmission speed fluctuation difference corresponding to the transmission link o with time T as a period, and compare the obtained transmission speed fluctuation difference with the preset difference; If the transmission speed fluctuation difference is greater than the preset difference, it means that the transmission situation of the corresponding transmission link is unstable, and it is marked as an unstable link. Conversely, if the transmission speed fluctuation difference is less than the preset difference, it means that the transmission situation of the corresponding transmission link is stable, and it is marked as a stable link.

7. The information lossless electronic reporting system according to claim 1 is characterized in that: The specific manner in which the information transmission analysis module performs transmission processing on the private data according to the transmission conditions corresponding to different transmission links to generate transmission information is as follows: Obtain all stable links and the corresponding transmission speeds, and sort the stable links according to the transmission speed from large to small. Then obtain the privacy compression data and low-encapsulation privacy data, and obtain the corresponding data capacity. At the same time, bundle the privacy compression data with the low-encapsulation privacy data to obtain a privacy transmission data packet. In this way, a privacy transmission data packet is generated, and the combined capacity corresponding to the privacy transmission data packet is obtained. At the same time, the transmission is matched with the stable link in order from large to small according to the combined capacity, and the transmission information is generated.

8. The information lossless electronic reporting system according to claim 1 is characterized in that: The specific manner in which the information transmission analysis module performs transmission processing on conventional data to generate transmission information according to the transmission conditions corresponding to different transmission links is as follows: Then, all unstable links are obtained, and the corresponding transmission speeds are obtained. At the same time, conventional compressed data and low-encapsulation conventional data are obtained. Conventional transmission data packets are generated in the same way as privacy data. Then, according to the combined capacity of the conventional transmission data packets, they are matched with the unstable links in order from large to small, and transmission information is generated.

Images