A computer data transmission system

Abstract

The present invention relates to the field of data processing technology, and in particular to a computer data transmission system, comprising: a file initiating terminal, a preprocessing module, a first optimization module, a second optimization module, a third optimization module and a file receiving terminal; the preprocessing module evaluates the file to be transmitted, determines the transmission mode of the file to be transmitted according to the initial capacity obtained by the evaluation, and in the case where the file to be transmitted needs to be segmented, the second segmentation standard is modified by optimizing the file to be transmitted and determining the final segmentation standard, thereby obtaining a number of actual segmented files, and completing the transmission of the target content according to the requirements of the control instruction. After the file to be transmitted is segmented, the present invention realizes parallel transmission, fully utilizes the network bandwidth, speeds up the overall transmission speed, saves the transmission time, and makes it more flexible to manage the transmission process to maximize the transmission efficiency.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a computer data transmission system. Background Art

[0002] Large file transfers have become a daily routine for enterprises, whether it is data exchange between enterprises, remote office, cross-border collaboration, etc. With the traditional full-volume transfer method, as files become larger and larger, work efficiency and transfer speed become bottleneck issues.

[0003] Chinese patent publication number CN107453843A discloses a computer data transmission system, including a computer device, a network device and a server, wherein the computer device includes: a check matrix generation module, used to generate a low-density parity check code check matrix; a structured data encoding module, used to encode the structured data with the above-mentioned density parity check code check matrix, and convert the structured data into structured data with a preset data encoding format; an unstructured data processing module, which obtains preset attribute information of each file in the unstructured data, obtains N fields in the structured data with a preset data encoding format that correspond to the N files in the unstructured data one by one according to the number N of files in the unstructured data, and adds the preset attribute information of each file in the unstructured data as an extension field of the corresponding field in the structured data to constitute a reference to the corresponding file in the unstructured data, wherein the structured data has an extension field The field is used to form a composite field with the corresponding extension field; a data splicing module is used to splice the file header, structured data with a preset data encoding format and unstructured data in sequence to form semi-structured data; a computer data sending module is used to send the semi-structured data; the network device includes: a data receiving module, used to receive the semi-structured data; a data transmission rate adjustment module, used to adjust the transmission rate of the network device, including a counter; a data output module, used to output the semi-structured data to the server; a data transmission control module, used to control the data transmission process of the network device according to the transmission rate, including the working process of the data receiving module and the data output module; the server includes: a server data transmission module, used to receive the semi-structured data from the network device; a data decoding module, used to decode the semi-structured data; a storage module, used to store the decoded data; a control module, used to control the operation of the server.

[0004] It can be seen that the current computer data transmission system has low transmission efficiency and complex management of the transmission process. Summary of the invention

[0005] To this end, the present invention provides a computer data transmission system to overcome the problems of low transmission efficiency and complex management of transmission process in the computer data transmission system in the prior art.

[0006] To achieve the above object, the present invention provides a computer data transmission system, comprising:

[0007] A file initiating terminal is used to send the file to be transmitted according to the control instruction;

[0008] A pre-processing module, used for initially segmenting the file to be transmitted to form a plurality of first segmented files;

[0009] A first optimization module, used to determine whether to start a type of self-check mode according to each primary segmentation file, and determine a first optimization file according to the type of self-check mode;

[0010] A second optimization module, used for performing secondary segmentation on the first optimization file to form a plurality of secondary segmentation files and determining whether to start a second type of self-checking mode;

[0011] A third optimization module, configured to divide the first optimization file three times according to the second type of self-check mode to form a plurality of three-divided files and determine whether to start a correction mode;

[0012] A file receiving terminal, used for receiving a plurality of actual segmented files obtained when the first optimized file is segmented according to the final segmentation standard;

[0013] The control instructions include: the standard capacity of the whole file and the standard capacity of the divided file.

[0014] Further, the preprocessing module includes: an evaluation unit, a first judgment unit and a first segmentation unit;

[0015] The evaluation unit is used to evaluate the size of the file to be transmitted to obtain the initial capacity of the file to be transmitted;

[0016] The first determination unit is used to determine the transmission mode of the file to be transmitted according to the initial capacity;

[0017] The first segmentation unit is used to execute a first segmentation mode, wherein the first segmentation mode is to perform an initial segmentation on the file to be transmitted according to a first segmentation standard to form a plurality of first-segmented files;

[0018] The first segmentation standard is segmentation according to a standard number of pages.

[0019] Further, the first optimization module includes: a second judgment unit, a first identification unit and an editing unit;

[0020] The second judgment unit is used for determining whether to start the type of self-check mode according to the first capacity of each once-divided file;

[0021] The first identification unit is used to execute the first type of self-checking mode, where the first type of self-checking mode is to identify each type of data in the file to be transmitted to obtain a type of actual location information corresponding to each type of data;

[0022] The editing unit is used to delete the type of data in the file to be transmitted according to the type of actual location information to form the first optimized file.

[0023] Furthermore, the second optimization module includes: a second segmentation unit, a third judgment unit and a second recognition unit;

[0024] The second segmentation unit is used to execute a second segmentation mode, wherein the second segmentation mode is to perform secondary segmentation on the first optimization file according to the first segmentation standard to form a plurality of secondary segmentation files;

[0025] The third judgment unit is used to determine whether to start the second self-check mode according to the second capacity of each secondary split file;

[0026] The second identification unit is used to execute the second type of self-checking mode, and the second type of self-checking mode is to identify each of the second types of data in the first optimization file.

[0027] Further, the third optimization module includes: a third segmentation unit, a fourth judgment unit and a correction unit;

[0028] The third segmentation unit is used to execute a third segmentation mode, wherein the third segmentation mode is to segment the first optimization file three times according to a second segmentation standard to form a plurality of three-segmentation files; wherein the second segmentation standard is to segment according to the number of occurrences of the initial two-category standard;

[0029] The fourth determination unit is used to determine whether to start the correction mode according to the third capacity of each of the three divided files;

[0030] The correction unit is used to execute the correction mode, and the correction mode is to correct the initial number of occurrences of the second-category standard to obtain the actual number of occurrences of the second-category standard.

[0031] Further, the first judgment unit can determine the transmission mode according to the absolute value of the first difference combined with a preset overall transmission capacity evaluation value;

[0032] If the absolute value of the first difference is greater than the overall transmission capacity evaluation value and the initial capacity is greater than the overall file standard capacity, the first judgment unit determines that the transmission mode is: split-transmission;

[0033] The first absolute value of the difference is the absolute value of the difference between the initial capacity and the standard capacity of the entire file.

[0034] Further, for any of the once-divided files, the second judgment unit can determine whether the once-divided file meets a type of single opening determination condition according to the second difference absolute value combined with a preset type of self-check opening evaluation value;

[0035] If the absolute value of the second difference is greater than the first type of self-check opening evaluation value, and the first capacity is greater than the split file standard capacity, the second judgment unit determines that the once split file meets the first type of single opening judgment condition;

[0036] The second absolute value of the difference is the absolute value of the difference between the first capacity and the standard capacity of the split file.

[0037] Furthermore, the second judgment unit determines whether to start the self-check mode according to the number of items that meet the single start-up judgment condition of the type;

[0038] If the number of items in each of the once-divided files that meet the single activation determination condition is greater than or equal to 1, the second determination unit determines to activate the self-check mode.

[0039] Further, for any of the secondary split files, the third judgment unit determines that the secondary split file meets the second-category single opening judgment condition based on the absolute value of the third difference being greater than a preset second-category self-check opening evaluation value and the second capacity being greater than the standard capacity of the split file; and can start the second-category self-check mode when the number of items meeting the second-category single opening judgment condition is greater than or equal to 1;

[0040] For any of the three-partition files, the fourth judgment unit determines that the three-partition file meets the correction single start judgment condition based on that the absolute value of the fourth difference is greater than the preset correction start evaluation value and the third capacity is greater than the standard capacity of the partion file; and can start the correction mode when the number of items that meet the correction single start judgment condition is greater than or equal to 1;

[0041] The third absolute value of the difference is the absolute value of the difference between the second capacity and the standard capacity of the divided file; and the fourth absolute value of the difference is the absolute value of the difference between the third capacity and the standard capacity of the divided file.

[0042] Furthermore, the correction unit corrects the second segmentation standard according to the correction mode to obtain the actual second-category standard occurrence number C1;

[0043] C1={[1-(R3'-R0')×a]×C0};

[0044] Wherein, C0 is the number of occurrences of the initial two-category standard, a is the first calculation adjustment parameter of the difference between the third capacity R3' and the segmented file standard capacity R0' for the actual number of occurrences of the two-category standard C1; {[1-(R3'-R0')×a]×C0} represents a maximum integer whose value does not exceed ([1-(R3'-R0')×a]×C0);

[0045] The correction unit can determine the final segmentation standard according to the actual number of occurrences of the second-class standard.

[0046] Compared with the prior art, the beneficial effect of the present invention lies in that the present invention evaluates the file to be transmitted and determines the transmission mode of the file to be transmitted according to the initial capacity obtained by the evaluation. In the case where the file to be transmitted needs to be segmented, the final segmentation standard is determined by optimizing the file to be transmitted and correcting the second segmentation standard, thereby obtaining a number of actual segmented files, and completing the transmission of the target content according to the requirements of the control instruction. After the file to be transmitted is segmented into multiple parts, these parts can be transmitted on the network at the same time, thereby realizing parallel transmission, making full use of the network bandwidth, and accelerating the overall transmission speed. If an error or loss occurs in a segmented part during the transmission process, only the affected part needs to be retransmitted without retransmitting the entire file, thereby improving the fault tolerance of the transmission and saving the transmission time. The segmentation of the file to be transmitted and then transmitting it can adapt to the network conditions to a certain extent. In the case of unstable network conditions or limited bandwidth, the segmented files can help adapt to these conditions, so that when the transmission of some segmented parts is affected, other parts can still continue to be transmitted, reducing the risk of the overall transmission. The segmentation of the file to be transmitted makes it possible to manage the transmission process more flexibly, and adjust the size and order of the segmentation of the transmission according to the network conditions and needs to maximize the transmission efficiency.

[0047] In particular, by determining the initial capacity of the file to be transmitted, and determining the transmission method that best meets the transmission standard for the file to be transmitted based on the initial capacity and the overall file standard capacity determined by the control instruction, when the transmission method is direct transmission, no additional steps are required, which is suitable for small files or network environments with high bandwidth, eliminating the decompression step, and the recipient can use it directly, reducing the time cost of transmission and reception. For transmission methods that require compression before transmission, the file size can be reduced by compressing the file to be transmitted, thereby reducing the transmission time and network bandwidth occupancy, and saving storage space. For files to be transmitted with a large initial capacity, by first splitting and then transmitting, the large file is split into small blocks. Even if a block fails during the transmission process, only the block needs to be retransmitted instead of the entire file, thereby improving the fault tolerance of the transmission. According to parallel transmission, the overall transmission speed is improved.

[0048] In particular, whether a type of single opening judgment condition is met is determined by the first capacity of each once-divided file, and whether a type of self-check mode is turned on is determined according to the number of items that meet the type of single opening judgment condition. The blank pages and repeated paragraphs obtained after executing the self-check mode are deleted to form a first optimized file. By deleting blank pages and repeated paragraphs, the file size can be effectively reduced, which means that the amount of data that needs to be transmitted during the transmission process is less, thereby reducing the time required for transmission and network bandwidth. A smaller file size means that the transmission process takes less time. By reducing unnecessary data transmission, file transmission is made more efficient and faster, achieving the purpose of saving transmission time and reducing network load. By deleting blank pages and repeated paragraphs, the reliability of transmission is also improved. Reducing the file size means that the data in the transmission process is more compact, reducing the possibility of transmission errors and losses. Deleting blank pages and repeated paragraphs is not only beneficial to transmission, but also optimizes the utilization of storage space. By reducing the file size, storage space can be saved, making files easier to manage and back up.

[0049] In particular, the second capacity of each secondary split file is used to determine whether it meets the second-category single opening judgment condition, and whether to start the second-category self-check mode is determined based on the number of items that meet the second-category single opening judgment condition. By obtaining the specific content in the first optimized file, the file can be segmented in a targeted manner. The file can be segmented into parts containing different types of content. A suitable transmission method can be selected according to the characteristics of the content to achieve more efficient transmission. Different compression algorithms and transmission optimization strategies can be used for different types of content. For example, a text compression algorithm can be used for text content, while a more suitable image compression or structure-based compression method can be used for pictures and tables, thereby minimizing the size of the transmitted data. Segmenting different types of content in the file can achieve parallel transmission optimization. Each part of the content can be transmitted independently, thereby improving the overall transmission speed and reducing transmission delay. In the above manner, targeted segmentation of file content and optimized transmission of content type can significantly improve the transmission speed while meeting the special needs of different content types. It is particularly beneficial for large files, complex documents or scenarios that require customized transmission strategies.

[0050] In particular, by correcting the number of occurrences of the initial two-category standard to obtain the final segmentation standard, targeted segmentation of the first optimized file can be achieved. Correcting the number of occurrences of the initial two-category standard can more accurately determine the segmentation standard. By analyzing the actual data and the frequency of occurrence, the structure and content of the file can be better understood, so as to formulate a segmentation standard that better meets the actual needs, thereby improving the segmentation accuracy. According to the corrected actual number of occurrences of the two-category standard, the segmentation point can be better determined to avoid unnecessary segmentation or merging, thereby maintaining the integrity and consistency of the file structure. Targeted file segmentation can optimize transmission efficiency, divide the file into appropriate parts, and adopt different transmission strategies according to different content types, thereby optimizing Maximize the transmission speed and efficiency. Accurate segmentation standards can reduce transmission costs. Avoiding unnecessary data transmission and processing can save bandwidth and resources, reduce transmission time and cost. The revised segmentation standards enhance the adaptability of the system, so that it can be dynamically adjusted according to actual conditions and needs, so as to better adapt to different types of files and transmission environments. The revised targeted segmentation can improve the user experience. Users can obtain the required content more quickly, reduce waiting time and transmission delays, thereby improving the overall user experience. By correcting the number of occurrences of the second category standard to obtain the final segmentation standard, more precise control and optimization of the file segmentation process can be achieved, thereby improving the efficiency and quality of file transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 This is a schematic diagram of the structure of a computer data transmission system according to an embodiment of the present invention;

[0052] Figure 2 This is a schematic diagram of the structure of a preprocessing module in a computer data transmission system according to an embodiment of the present invention;

[0053] Figure 3 This is a structural schematic diagram of a first optimization module in a computer data transmission system according to an embodiment of the present invention;

[0054] Figure 4 A schematic diagram of the structure of a second optimization module and a third optimization module in a computer data transmission system according to an embodiment of the present invention;

[0055] The figure includes: a file initiating terminal 1, a preprocessing module 2, a first optimization module 3, a second optimization module 4, a third optimization module 5 and a file receiving terminal 6. DETAILED DESCRIPTION

[0056] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0057] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0058] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0059] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0060] See also Figure 1-Figure 4 As shown, Figure 1 This is a schematic diagram of the structure of a computer data transmission system according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the structure of a preprocessing module in a computer data transmission system according to an embodiment of the present invention; Figure 3This is a structural schematic diagram of a first optimization module in a computer data transmission system according to an embodiment of the present invention; Figure 4 It is a schematic diagram of the structure of a second optimization module and a third optimization module in a computer data transmission system according to an embodiment of the present invention.

[0061] The present invention provides a computer data transmission system, comprising:

[0062] The file initiating terminal 1 is used to send the file to be transmitted according to the control instruction; the control instruction includes: target content, target object and transmission standard; wherein the target content is the file to be transmitted; the transmission standard includes: standard capacity of the whole file, standard capacity of the divided file and standard transmission speed;

[0063] Preprocessing module 2, including: an evaluation unit, a first judgment unit and a first segmentation unit;

[0064] The evaluation unit is used to evaluate the size of the file to be transmitted to obtain the initial capacity of the file to be transmitted;

[0065] The first determination unit is used to determine the transmission mode of the file to be transmitted according to the initial capacity;

[0066] The first segmentation unit is used to execute a first segmentation mode, wherein the first segmentation mode is to perform an initial segmentation on the file to be transmitted according to a first segmentation standard to form a plurality of first-segmented files; wherein the first segmentation standard is segmentation according to a standard number of pages;

[0067] The first optimization module 3 includes: a second judgment unit, a first recognition unit and an editing unit;

[0068] The second judgment unit is used to determine whether to start a type of self-check mode according to the first capacity of each once-divided file;

[0069] The first identification unit is used to execute the first type of self-checking mode, which is to identify each type of data in the file to be transmitted to obtain a type of actual location information corresponding to each type of data; wherein the first type of data includes: blank pages and repeated paragraphs;

[0070] The editing unit is used to delete the type of data in the file to be transmitted according to the type of actual location information to form a first optimized file;

[0071] The second optimization module 4 includes: a second segmentation unit, a third judgment unit and a second recognition unit;

[0072] The second segmentation unit is used to execute a second segmentation mode, wherein the second segmentation mode is to perform secondary segmentation on the first optimization file according to the first segmentation standard to form a plurality of secondary segmentation files;

[0073] The third judgment unit is used to determine whether to start the second type of self-check mode according to the second capacity of each secondary split file;

[0074] The second identification unit is used to execute the second-category self-checking mode, which is to identify each second-category data in the first optimization file to obtain the actual number of occurrences of the second category and the second-category actual position information corresponding to each second category data; the second category data includes: pictures, formulas and tables;

[0075] The third optimization module 5 includes: a third segmentation unit, a fourth judgment unit and a correction unit;

[0076] The third segmentation unit is used to execute a third segmentation mode, wherein the third segmentation mode is to segment the first optimization file three times according to a second segmentation standard to form a plurality of three-segmentation files; wherein the second segmentation standard is to segment according to the number of occurrences of the initial two-category standard;

[0077] The fourth determination unit is used to determine whether to start the correction mode according to the third capacity of each of the three divided files;

[0078] The correction unit is used to execute the correction mode, and the correction mode is to correct the second segmentation standard to obtain a final segmentation standard;

[0079] The file receiving terminal 6 is used to receive a plurality of actual segmented files obtained when the first optimized file is segmented according to the final segmentation standard.

[0080] By evaluating the file to be transmitted, the transmission method of the file to be transmitted is determined according to the initial capacity obtained by the evaluation. In the case where the file to be transmitted needs to be segmented, the final segmentation standard is determined by optimizing the file to be transmitted and correcting the second segmentation standard, thereby obtaining several actual segmented files, and completing the transmission of the target content according to the requirements of the control instruction. After the file to be transmitted is segmented into multiple parts, these parts can be transmitted on the network at the same time, thereby realizing parallel transmission, making full use of the network bandwidth, and accelerating the overall transmission speed. If an error or loss occurs in a segmented part during the transmission process, only the affected part needs to be retransmitted without retransmitting the entire file, thereby improving the fault tolerance of the transmission and saving transmission time. Segmenting the file to be transmitted and then transmitting it can adapt to network conditions to a certain extent. In the case of unstable network conditions or limited bandwidth, segmenting files can help adapt to these conditions, so that when the transmission of some segmented parts is affected, other parts can still continue to be transmitted, reducing the risk of overall transmission. Segmenting the file to be transmitted makes it possible to manage the transmission process more flexibly, and adjust the segmentation size and order of the transmission according to network conditions and needs to maximize transmission efficiency.

[0081] Specifically, in this embodiment, the evaluation unit can obtain the initial capacity R of the file to be transmitted;

[0082] The first judgment unit calculates a first difference absolute value S1 according to the initial capacity R and the overall file standard capacity R0, where S1=|R-R0|; and determines the transmission mode of the file to be transmitted according to the first difference absolute value;

[0083] If S1≤S10, the first determination unit determines that the transmission mode is: compression-transmission;

[0084] If S1>S10, and R>R0, the first determination unit determines that the transmission mode is: split-transmission;

[0085] If S1>S10, and R<R0, the first determination unit determines that the transmission mode is: direct transmission;

[0086] Among them, S10 is the overall transmission capacity evaluation value;

[0087] In this embodiment, the overall file standard capacity is set to 1GB, and the overall transmission capacity evaluation value is set to 0.35. The specific settings are also affected by hardware performance and network load. For example, during the actual transmission process, the corresponding hardware equipment has been used for a long time, resulting in poor hardware performance, and the network load is large. At this time, the overall file standard capacity should be set to 0.8GB, and the overall transmission capacity evaluation value should be set to 0.23.

[0088] By determining the initial capacity of the file to be transmitted, and determining the transmission method that best meets the transmission standard for the file to be transmitted based on the initial capacity and the overall file standard capacity determined by the control instruction, when the transmission method is direct transmission, no additional steps are required, which is suitable for small files or network environments with high bandwidth, eliminating the decompression step, and the receiver can use it directly, reducing the time cost of transmission and reception. For transmission methods that require compression before transmission, the file size can be reduced by compressing the file to be transmitted, thereby reducing the transmission time and network bandwidth occupancy, and saving storage space. For files to be transmitted with a large initial capacity, by first splitting and then transmitting, the large file is split into small blocks. Even if a block fails during the transmission process, only the block needs to be retransmitted instead of the entire file, thereby improving the fault tolerance of the transmission. According to parallel transmission, the overall transmission speed is improved.

[0089] Specifically, in this embodiment, when the transmission mode is: segmentation-transmission, the first segmentation unit performs initial segmentation on the file to be transmitted according to the first segmentation standard to form a plurality of first segmentation files;

[0090] In this embodiment, the standard number of pages is set to 5 pages. Therefore, the first segmentation standard is: the file to be transmitted is segmented every 5 pages, thereby forming a plurality of first-segment files. The specific setting of the standard number of pages is also affected by the hardware performance and the real-time network status. For example, in the case of poor hardware performance and poor real-time network status, the standard number of pages should be set to 2 pages.

[0091] For any of the once-divided files, the second judgment unit calculates a second difference absolute value S2 according to the first capacity R1' of the once-divided file and the standard capacity R0' of the divided file, where S2 = |R1'-R0'|;

[0092] If S2≤S20, the second judgment unit determines that the once-split file does not meet a type of single opening judgment condition;

[0093] If S2>S20, and R1'<R0', the second judgment unit determines that the once-split file does not meet a single opening judgment condition;

[0094] If S2>S20, and R1'>R0', the second judgment unit determines that the once-split file meets a single opening judgment condition;

[0095] Among them, S20 is a type of self-check start evaluation value;

[0096] In this embodiment, the standard capacity of the split file is set to 0.2GB, and the evaluation value of the first type of self-check is set to 0.1. The specific setting is also affected by the actual transmission index. The actual transmission index in this embodiment is that at the same transmission time, the transmission speed of the file to be transmitted must be ranked in the top 10% of all the files to be transmitted at the same transmission time. The actual transmission index is set according to the type of the file to be transmitted. For example, when the type of the file to be transmitted is military confidential information, the actual transmission index at this time is 3%;

[0097] If each of the once-split files does not meet the one-type single start determination condition, the second determination unit determines not to start the one-type self-check mode, and the file initiating terminal 1 sends each of the once-split files as the actual split files to the file receiving terminal 6;

[0098] If any one of the items in each of the once-divided files meets the single start-up determination condition of the type, the second determination unit determines to start the self-check mode of the type;

[0099] The first identification unit identifies the file to be transmitted according to the type of self-check mode, thereby obtaining the blank pages and the repeated paragraphs in the file to be transmitted; the editing unit deletes the blank pages and the repeated paragraphs to form the first optimized file.

[0100] Whether a type of single opening judgment condition is met is determined by the first capacity of each once-divided file, and whether a type of self-check mode is turned on is determined according to the number of items that meet the type of single opening judgment condition. The blank pages and repeated paragraphs obtained after executing the self-check mode are deleted to form a first optimized file. By deleting blank pages and repeated paragraphs, the file size can be effectively reduced, which means that less data needs to be transmitted during the transmission process, thereby reducing the time and network bandwidth required for transmission. A smaller file size means that the transmission process takes less time. By reducing unnecessary data transmission, file transmission is made more efficient and faster, thereby achieving the purpose of saving transmission time and reducing network load. By deleting blank pages and repeated paragraphs, the reliability of transmission is also improved. Reducing the file size means that the data in the transmission process is more compact, reducing the possibility of transmission errors and losses. Deleting blank pages and repeated paragraphs is not only beneficial to transmission, but also can optimize the utilization of storage space. By reducing the file size, storage space can be saved, making files easier to manage and back up.

[0101] Specifically, in this embodiment, the second segmentation unit performs secondary segmentation on the first optimization file according to the second segmentation mode to form a plurality of secondary segmentation files;

[0102] For any of the secondary split files, the third judgment unit calculates a third difference absolute value S3 according to the second capacity R2' of the secondary split file and the standard capacity R0' of the split file, where S3 = |R2'-R0'|;

[0103] If S3≤S30, the third judgment unit determines that the secondary split file does not meet the second-type single opening judgment condition;

[0104] If S3>S30, and R2'<R0', the third judgment unit determines that the secondary split file does not meet the second type single opening judgment condition;

[0105] If S3>S30, and R2'>R0', the third judgment unit determines that the secondary split file meets the second type of single opening judgment condition;

[0106] Among them, S30 is the evaluation value of the second type of self-test start;

[0107] In this embodiment, the standard capacity of the split file is set to 0.2GB, and the evaluation value of the second type of self-check is set to 0.08. The specific settings are also affected by the actual transmission indicators.

[0108] If each secondary split file does not meet the second type single start determination condition, the third determination unit determines not to start the second type self-check mode, and the file initiating terminal 1 sends each secondary split file as the actual split file to the file receiving terminal 6;

[0109] If any one of the secondary split files meets the second type single start determination condition, the third determination unit determines to start the second type self-check mode;

[0110] The second identification unit identifies the second type of data in the first optimization file according to the second type of self-check mode, thereby obtaining the second type of actual occurrence times P and the second type of actual position information corresponding to each second type of data.

[0111] Whether the second-category single opening judgment condition is met is determined by the second capacity of each secondary split file, and whether the second-category self-check mode is turned on is determined according to the number of items that meet the second-category single opening judgment condition. By obtaining the specific content in the first optimized file, the file can be segmented in a targeted manner. The file can be segmented into parts containing different types of content. A suitable transmission method can be selected according to the characteristics of the content to achieve more efficient transmission. Different compression algorithms and transmission optimization strategies can be used for different types of content. For example, a text compression algorithm can be used for text content, while a more suitable image compression or structure-based compression method can be used for pictures and tables, thereby minimizing the size of the transmitted data. Different types of content in the file can be segmented to achieve parallel transmission optimization. Each part of the content can be transmitted independently, thereby improving the overall transmission speed and reducing transmission delay. In the above manner, targeted segmentation of file content and optimized transmission of content type can significantly improve the transmission speed while meeting the special needs of different content types. It is especially beneficial for large files, complex documents or scenarios that require customized transmission strategies.

[0112] Specifically, in this embodiment, the third segmentation unit segments the first optimization file three times according to the second segmentation standard to form a plurality of three-segmentation files;

[0113] In this embodiment, the number of occurrences of the initial two-category standard is set to 3 times, so the second segmentation standard is: when the second-category data appears twice in a row in the first optimization file, it is segmented to form a number of three-segment files; the specific setting of the number of occurrences of the initial two-category standard is also affected by the hardware performance and the real-time network status. For example, in the case of poor hardware performance and poor real-time network status, the number of occurrences of the initial two-category standard should be set to 1 time;

[0114] For any of the three-partition files, the fourth judgment unit calculates a fourth difference absolute value S4 according to the third capacity R3' of the three-partition file and the standard capacity R0' of the partition file, where S4=|R3'-R0'|;

[0115] If S4≤S40, the fourth determination unit determines that the three-part file does not meet the modified single opening determination condition;

[0116] If S4>S40, and R3'<R0', the fourth determination unit determines that the three-partition file does not meet the modified single opening determination condition;

[0117] If S4>S40, and R3'>R0', the fourth determination unit determines that the three-partition file meets the modified single opening determination condition;

[0118] Among them, S40 is the correction opening evaluation value;

[0119] In this embodiment, the standard capacity of the split file is set to 0.2 GB, and the correction start evaluation value is set to 0.05. The specific settings are also affected by the actual transmission index;

[0120] If each of the three-part split files does not meet the correction single start determination condition, the fourth determination unit determines not to start the correction mode, and the file initiating terminal 1 sends each of the three-part split files as the actual split files to the file receiving terminal 6;

[0121] If any one of the three divided files meets the correction single start determination condition, the fourth determination unit determines to start the correction mode;

[0122] Under the condition that the correction mode is turned on, the correction unit corrects the second segmentation standard according to the correction mode to obtain the actual number of occurrences of the second category standard C1;

[0123] C1={[1-(R3'-R0')×a]×C0};

[0124] Among them, C0 is the number of occurrences of the initial two-category standard, a is the first calculation adjustment parameter of the difference between the third capacity R3' and the segmented file standard capacity R0' for the actual number of occurrences of the two-category standard C1; {[1-(R3'-R0')×a]×C0} means that the value is the maximum integer not exceeding ([1-(R3'-R0')×a]×C0).

[0125] In this embodiment, the first calculation adjustment parameter is set to 0.7. The specific setting is also affected by the actual number of occurrences of the second category obtained by the second recognition unit during the actual transmission process. For example, if the second category of data contained in the file to be transmitted is relatively large, the first calculation adjustment parameter should be set to 0.45.

[0126] The correction unit determines the final segmentation standard according to the number of occurrences of the actual second-class standard;

[0127] The file receiving terminal 6 receives a plurality of actual segmented files obtained when the first optimized file is segmented according to the final segmentation standard.

[0128] By correcting the number of occurrences of the initial two-category standard to obtain the final segmentation standard, targeted segmentation of the first optimized file can be achieved. Correcting the number of occurrences of the initial two-category standard can more accurately determine the segmentation standard. By analyzing the actual data and the frequency of occurrence, the structure and content of the file can be better understood, so as to formulate a segmentation standard that better meets the actual needs, thereby improving the segmentation accuracy. According to the corrected actual number of occurrences of the two-category standard, the segmentation point can be better determined to avoid unnecessary segmentation or merging, thereby maintaining the integrity and consistency of the file structure. Targeted file segmentation can optimize transmission efficiency and divide the file into appropriate parts. Different transmission strategies can be adopted according to different content types, thereby maximizing Maximize the transmission speed and efficiency. Accurate segmentation standards can reduce transmission costs. Avoiding unnecessary data transmission and processing can save bandwidth and resources, reduce transmission time and costs. The revised segmentation standards enhance the adaptability of the system, so that it can be dynamically adjusted according to actual conditions and needs, so as to better adapt to different types of files and transmission environments. The revised targeted segmentation can improve user experience. Users can obtain required content more quickly, reduce waiting time and transmission delays, thereby improving the overall user experience. By correcting the number of occurrences of the second category standard to obtain the final segmentation standard, more precise control and optimization of the file segmentation process can be achieved, thereby improving the efficiency and quality of file transmission.

[0129] The calculation compensation parameters and the calculation adjustment parameters described in the present invention have two functions: one is to balance the left and right dimensions of the formula, and the other is to adjust the numerical results. No specific assignment is performed in this embodiment. In addition, the calculation formulas in this embodiment are used to intuitively reflect the adjustment relationship between the various numerical values, such as positive correlation and negative correlation. Unless otherwise specified, the parameter values ​​that are not specifically limited to numerical values ​​are all positive.

[0130] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0131] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A computer data transmission system, characterized in that: include: A file initiating terminal is used to send the file to be transmitted according to the control instruction; A pre-processing module, used for initially segmenting the file to be transmitted to form a plurality of first segmented files; A first optimization module, used to determine whether to start a type of self-check mode according to each primary segmentation file, and determine a first optimization file according to the type of self-check mode; A second optimization module, used for performing secondary segmentation on the first optimization file to form a plurality of secondary segmentation files and determining whether to start a second type of self-checking mode; A third optimization module, configured to divide the first optimization file three times according to the second type of self-check mode to form a plurality of three-divided files and determine whether to start a correction mode; A file receiving terminal, used for receiving, when the correction mode is turned on, a plurality of actual segmented files obtained when the first optimized file is segmented according to the final segmentation standard; Wherein, based on the first optimization module determining not to start the first type of self-check mode, the file initiating terminal sends each of the first-segmented files as the actual segmented files to the file receiving terminal; Based on the third optimization module determining that the correction mode is not enabled, the file initiating terminal sends the three-part files as the actual parting files to the file receiving terminal; The control instructions include: the standard capacity of the whole file and the standard capacity of the split file; The preprocessing module includes: an evaluation unit, a first judgment unit and a first segmentation unit; The evaluation unit is used to evaluate the size of the file to be transmitted to obtain the initial capacity of the file to be transmitted; The first determination unit is used to determine the transmission mode of the file to be transmitted according to the initial capacity; The first segmentation unit is used to execute a first segmentation mode, wherein the first segmentation mode is to perform an initial segmentation on the file to be transmitted according to a first segmentation standard to form a plurality of first-segmented files; Wherein, the first segmentation standard is segmentation according to the standard number of pages; The first optimization module includes: a second judgment unit, a first identification unit and an editing unit; The second judgment unit is used to determine whether to start the type of self-check mode according to the first capacity of each once-divided file; The first identification unit is used to execute the first type of self-checking mode, where the first type of self-checking mode is to identify each type of data in the file to be transmitted to obtain a type of actual location information corresponding to each type of data; The editing unit is used to delete the type of data in the to-be-transmitted file according to the type of actual location information to form the first optimized file; The second optimization module includes: a second segmentation unit, a third judgment unit and a second recognition unit; The second segmentation unit is used to execute a second segmentation mode, wherein the second segmentation mode is to perform secondary segmentation on the first optimization file according to the first segmentation standard to form a plurality of secondary segmentation files; The third judgment unit is used to determine whether to start the second self-check mode according to the second capacity of each secondary split file; The second identification unit is used to execute the second type of self-checking mode, and the second type of self-checking mode is to identify each of the second types of data in the first optimization file; The third optimization module includes: a third segmentation unit, a fourth judgment unit and a correction unit; The third segmentation unit is used to execute a third segmentation mode, wherein the third segmentation mode is to segment the first optimization file three times according to a second segmentation standard to form a plurality of three-segmentation files; wherein the second segmentation standard is to segment according to the number of occurrences of the initial two-category standard; The fourth determination unit is used to determine whether to start the correction mode according to the third capacity of each of the three divided files; The correction unit is used to execute the correction mode, and the correction mode is to correct the initial number of occurrences of the second-category standard to obtain the actual number of occurrences of the second-category standard.

2. The computer data transmission system according to claim 1, characterized in that: The first judgment unit can determine the transmission mode according to the absolute value of the first difference combined with a preset overall transmission capacity evaluation value; If the absolute value of the first difference is greater than the overall transmission capacity evaluation value and the initial capacity is greater than the overall file standard capacity, the first judgment unit determines that the transmission mode is: split-transmission; The first absolute value of the difference is the absolute value of the difference between the initial capacity and the standard capacity of the entire file.

3. The computer data transmission system according to claim 2, characterized in that: For any of the once-split files, the second judgment unit can determine whether the once-split file meets a type of single opening judgment condition according to the second difference absolute value combined with a preset type of self-check opening evaluation value; If the absolute value of the second difference is greater than the first type of self-check opening evaluation value, and the first capacity is greater than the split file standard capacity, the second judgment unit determines that the once split file meets the first type of single opening judgment condition; The second absolute value of the difference is the absolute value of the difference between the first capacity and the standard capacity of the split file.

4. The computer data transmission system according to claim 3, characterized in that: The second judgment unit determines whether to start the self-check mode according to the number of items that meet the single start-up judgment condition of the type; If the number of items in each of the once-divided files that meet the single activation determination condition is greater than or equal to 1, the second determination unit determines to activate the self-check mode.

5. The computer data transmission system according to claim 4, characterized in that: For any of the secondary split files, the third judgment unit determines that the secondary split file meets the second-category single opening judgment condition based on the absolute value of the third difference being greater than a preset second-category self-check opening evaluation value and the second capacity being greater than the standard capacity of the split file; And when the number of items meeting the second type of single start determination condition is greater than or equal to 1, the second type of self-check mode can be started; For any of the three-partition files, the fourth judgment unit determines that the three-partition file meets the correction single opening judgment condition based on that the absolute value of the fourth difference is greater than the preset correction opening evaluation value and the third capacity is greater than the standard capacity of the partition file; And when the number of items meeting the correction single start determination condition is greater than or equal to 1, the correction mode can be started; The third absolute value of the difference is the absolute value of the difference between the second capacity and the standard capacity of the split file; The fourth difference absolute value is the absolute value of the difference between the third capacity and the standard capacity of the divided file.

6. The computer data transmission system according to claim 5, characterized in that: The correction unit corrects the second segmentation standard according to the correction mode to obtain the actual second-category standard occurrence number C1; C1={[1-(R3'-R0')×a]×C0}; Wherein, C0 is the number of occurrences of the initial two-category standard, a is the first calculation adjustment parameter of the difference between the third capacity R3' and the segmented file standard capacity R0' for the actual number of occurrences of the two-category standard C1; {[1-(R3'-R0')×a]×C0} represents a maximum integer whose value does not exceed ([1-(R3'-R0')×a]×C0); The correction unit can determine the final segmentation standard according to the actual number of occurrences of the second-class standard.

Images