A high-speed transmission method for large data between clients
Through one-pass-multiple overlapping data transmission method and sector data mapping technology, the problem of low high-speed transmission efficiency between large data clients in the existing technology is solved, and rapid system installation and maintenance is achieved, network pressure and configuration requirements are reduced, and maintenance efficiency is improved.
Patent Information
- Application Number
- CN202411832326.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-12
- Publication Date
- 2025-04-04
AI Technical Summary
When performing high-speed transmission between large data clients, the prior art has problems such as slow transmission speed, high configuration requirements, high network pressure and low maintenance efficiency, especially in the system configuration and security authentication of multiple computer groups in the local area network.
The overlapping data transmission method of one-pass multiple is adopted, combined with the sector data mapping method, to realize system data replication between the server and the client. Through the transmission scheduling module, the network configuration and data transmission status information of the client computer are collected, and the client computer that has completed 50% of the data transmission is designated as the data transmission source, and the data is transmitted to the next level client computer to form a multi-level diffused transmission structure.
It realizes the rapid completion of system installation and abnormal maintenance within the server and LAN, reduces the configuration requirements of the server and network, improves data transmission efficiency, reduces network communication pressure, reduces usage costs, and improves maintenance efficiency within computer groups.
Smart Images

Figure CN119766802A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a data processing technology, and in particular to a method and system for high-speed transmission between large data clients in a local area network. Background Art
[0002] Computers are tools that people cannot live without in their study and work today, and they are also indispensable equipment in various occasions in people's daily lives. The connection of the network further makes the use of computer clients more versatile and efficient. In some centralized use occasions, dozens or even hundreds of computers are needed to form a group for study or office work, so as to facilitate centralized use and centralized management. In these uses, network connection management is often carried out in a local area network set up under the same network segment. When a large number of computer clients need to install or maintain the system, according to the existing data transmission and sharing methods, it takes a lot of time to complete, which not only makes the operation time too long, but also affects the use of computer clients. The maintenance intensity involved in these devices is relatively large, so generally different methods are used to ensure that each computer maintains the same system configuration and security policy settings before use. When a computer system failure or security problem occurs, the system needs to be reconfigured. The existing method is mainly to download the corresponding system file data directly from the server through the network, and reconfigure the system for each computer separately. In a computer group consisting of multiple computers, each computer needs to download data from the server separately, form a local system in the local hard disk, and complete the system configuration. The methods of downloading data mainly include traditional broadcast transmission and BT transmission, but these transmission methods have many disadvantages. For computer groups with a large number of computers, the configuration and maintenance time will be too long and difficult, which will affect normal work and study.
[0003] The traditional broadcast transmission method has obvious disadvantages. Transmission range: Technically, broadcast packets cannot pass VLAN and can only be transmitted in one network segment. In the case of multiple network segments, a special switch or proxy is required. Transmission speed: There are many abnormal situations in broadcast transmission, which have a huge impact on the network environment. When there is a transmission abnormality among multiple machines, all transmission teams will be slowed down to the slowest one, and the transmission process will be abnormal, such as packet loss, disconnection, and retransmission. Reliability: In the case of multiple abnormal situations, the success rate of system transmission is not high. Flexibility: During the simultaneous interpretation process, the same standard environment must be run at the same time to send and receive at the same time, and no other operations are allowed during the process.
[0004] Broadcast transmission is broadcast from the beginning to the end. Clients join the transmission according to the queue. In case of abnormal situation, the transmission is broadcast again from the beginning each time.
[0005] Disadvantages of BT transmission method: 1. The image file exceeds 200G, and it takes a long time to generate the seed file, which is very unfriendly to mechanical hard drives. 2. Each time the image is updated, the seed needs to be regenerated. It takes time and CPU computing power to generate the seed for a large image. 3. There are too many transmission threads, which puts huge transmission pressure on the switch. 4. The flexibility is not high. The transmission file needs to enter a certain system state for centralized transmission before it can be used. 5. All machines need to be in the BT sending state before they can be transmitted in a shared manner. When only one of the 60 machines is abnormal, the other 59 machines have not entered the transmission state, which is equivalent to point-to-point transmission. BT is only used in the first deployment and does not play a role in daily use. 6. In abnormal situations, the process is to be sent again from the beginning. The process must be completed at one time. Incomplete situations are restarted and the full transmission is started from the beginning.
[0006] Traditional data transmission methods have high requirements for the configuration of servers and computers, put great pressure on servers and networks, and have a great impact on the network environment. They are less friendly to client computers in computer groups within the local area network of the same IP segment, resulting in low efficiency in system configuration and security authentication of computers in such computer groups, affecting the normal working needs of the computer groups and failing to achieve optimal usage results. Summary of the invention
[0007] The technical problem solved by the present invention is to provide a method for high-speed transmission between large data clients, which adopts a one-to-many overlapping data transmission method in a local area network, combined with a sector data mapping method to realize system data replication from server to client, and between clients, thereby reducing the configuration requirements of the server and the network, and achieving the effect of completing the maintenance work of large-capacity data sharing and replication in a computer group composed of a large number of computers at a high speed.
[0008] The technical solution of the present invention is:
[0009] A method for high-speed transmission between large data clients, wherein a server obtains data transmission status information of a first client computer, and when the data transmission status of a template file of the first client computer is a completion percentage setting value between greater than 30% and less than 100%, a transmission scheduling module of the server specifies the first client computer to send data to the next group of client computers in the computer group in the same local area network, the next group of client computers includes at least two client computers that need to receive data, and when the data transmission status information of the template file of a client computer in the next group of client computers obtained by the transmission scheduling module is the completion percentage setting value, the client computer is specified to send data to the next group of client computers; the transmission scheduling module assigns a group of client computers that need to receive data as new client computers that receive data for the client computers that have completed sending data, and starts to transmit template file data to them; until the transmission scheduling module obtains that the data transmission status information of the template files of all client computers that need to transmit data in the computer group is 100%.
[0010] The method for high-speed transmission of large data between clients as described above, wherein it comprises a server, a plurality of client computers and an authentication microsystem module, wherein the plurality of client computers are arranged as at least one computer group;
[0011] The server is connected to the client computer via a network, a trusted root system module and a data pointer storage module are installed in the server, the trusted root system module stores a template file of the trusted root system, and the data pointer storage module is used to store a data pointer file from a hard disk of the client computer;
[0012] The server is provided with a transmission scheduling module, which collects the network configuration status information and data transmission status information of the client computer, and designates a client computer as the first client computer. The authentication microsystem module stores a trusted authentication microsystem for comparing the data information of the server and the client computer; it is started at the same time as the client computer is started, and after the client computer passes the hardware trusted authentication, the data pointer file of the client computer stored on the server is mapped to the designated storage sector of the hard disk of the client computer; the authentication microsystem module compares the data of the trusted root system marked by the data pointer file with the data of the trusted root system of the corresponding storage sector of the hard disk, and performs security authentication on the client computer.
[0013] As described above, the high-speed transmission method between large data clients, wherein the transmission scheduling module collects the network configuration status information of the client computer, including the hardware device information of the CPU, hard disk, memory and network card of all client computers in the computer group and the network connection status information, the network connection status information includes the computer client online status, computer group status, operating system status and waiting time; the data transmission status information includes whether the transmitted data is the completion percentage setting value, and the completion percentage setting value is 50%; the transmission scheduling module specifies a client computer to receive data according to the performance of the computer hardware device information and the network connection status information.
[0014] As described above, the high-speed transmission method between large data clients, wherein the transmission scheduling module selects the designated client computer for sending data according to the following priority order: the client computer is online, the network card speed is high and the network type is the same, the operating system is the same, the completion degree of received data is 50%, it is in the same computer group, and the waiting time is short; the transmission scheduling module selects the designated client computer for receiving data according to the following selection condition priority order: the client computer is online, the network card speed is high and the network type is the same, the operating system is the same, it is in the same computer group, and the waiting time is short.
[0015] The method for high-speed transmission of large data between clients as described above, wherein the transmission scheduling module obtains computer group information of a first client computer designated to receive data, and further comprises confirming that the number of switch levels between the server and the first client computer is less than or equal to the number of switch levels between the server and other client computers in the computer group;
[0016] The transmission scheduling module obtains data transmission status information of other client computers other than the first client computer with a 50% completion rate, and designates the client computer as a client computer for sending data. If there is a first-level switch between another client computer designated as receiving data and the client computer for sending data, the other client computer is a next-level client computer of the switch; when the number of previous-level client computers that have completed data transmission is greater than or equal to one, the next-level client computer will not be used as a client computer for sending data of the previous-level client computer.
[0017] The high-speed transmission method between large data clients as described above, wherein, when the client computer receiving data has not completed 100% of the data reception and the client computer sending data has an abnormality, it stops sending data; the transmission scheduling module waits and designates another new client computer that has completed data reception greater than or equal to 50% and has a data transmission completion rate greater than that of the client computer receiving data as the client computer sending data, and sends system data to the client computer receiving data.
[0018] As described above, the high-speed transmission method between large data clients, wherein the client computer receiving data enters a patrol state and sends a transmission request to the server every 30 seconds, and the transmission scheduling module waits and designates another client computer that has completed 100% of the data reception as the client computer sending data according to the priority order principle of the selection conditions, and sends system data to the client computer receiving data.
[0019] As described above, in the high-speed transmission method between large data clients, the hard disk of the client computer is provided with a local trusted root system storage area and a local dynamic data storage area, the local trusted root system storage area is a read-only storage area for loading template files from the trusted root system of the server, the local dynamic data storage area is an active storage area that allows the client computer to add or modify operations, the data pointer files of the local trusted root system storage area and the local dynamic data storage area are stored in the data pointer storage module of the server, and only the data of the storage sectors with the same data pointer mark are transmitted during data transmission.
[0020] The method for high-speed transmission of large data between clients as described above, wherein, after completing 50% data transmission to a first client computer, the server designates the first client computer to transmit data to the next group of client computers, thereby forming a first one-to-many transmission diffusion structure; the server designates another first client computer to perform data transmission, and after completing 50% data transmission to another first client computer, designates the other first client computer to transmit data to another next group of client computers that need to receive data, thereby forming a second one-to-many transmission diffusion structure; the client computers in the first one-to-many and the second one-to-many transmission diffusion structures do not overlap; and the server stops outward data transmission of the server after completing 100% data transmission to each first client computer.
[0021] The high-speed transmission method between large data clients as described above, wherein the authentication microsystem module is connected to an I / O control driver, the I / O control driver is used to identify and schedule input and output signals, and judge whether the trusted root system file data requested by the client computer exists in the specified sector of the local trusted root system storage area of its hard disk according to the data pointer file mapped by the authentication microsystem; if not, the server loads the requested trusted root system file data from the template file of the trusted root system to the specified sector, and stores the loaded data pointer file in the data pointer storage module of the server; if it exists, the next specified sector is judged according to the data pointer file mapped by the authentication microsystem; the I / O control driver judges the addition or modification operation of data in the local dynamic data storage area of the hard disk of the client computer, and sends and stores the data pointer of the storage sector where the addition or modification operation occurs to the data pointer storage module of the server.
[0022] From the above description, it can be seen that the present invention has the following advantages:
[0023] The large-scale data client-to-client high-speed transmission method of the present invention can quickly complete system installation and abnormal maintenance in the server and the computer group in the local area network. The mapping of sector data and pointer files is adopted to complete the copying and filling of data, and the data transmission control method of the computer group in the local area network is used to control the computer client to immediately start transmitting data to the client computer of the next level after receiving 50% of the system data, so as to complete the one-to-many continuous diffusion data transmission control of the server and the client computer in the computer group, and form a continuous multi-level continuous diffusion high-speed transmission structure, so that the client computers in the computer group can run at the same time without occupying the server, and the server and the client computer that completes the transmission can be performed when other client computers perform data transmission; the network communication pressure for network data transmission is reduced, and the impact on learning and work is reduced; at the same time, the hardware requirements for data transmission on the server, client computer and network configuration are reduced, the use cost is reduced, and the network impact of a large number of client computers performing data transmission and system security authentication is reduced, and the maintenance efficiency of the computers in the computer group is guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 A logical diagram of data transmission in a preferred embodiment of the present invention;
[0025] Figure 2 It is a structural diagram of a single client computer performing data transmission and transmission scheduling on a single client computer in a preferred embodiment of the present invention;
[0026] Figure 3ASchematic diagram of the real-time trusted authentication strategy of the present invention Figure 1 ;
[0027] Figure 3B Schematic diagram of the real-time trusted authentication strategy of the present invention Figure 2 . DETAILED DESCRIPTION
[0028] In order to have a clearer understanding of the technical features, purposes and effects of the present invention, specific embodiments of the present invention are now described with reference to the accompanying drawings.
[0029] A large-scale data high-speed transmission method between clients of the present invention is used in a scenario in which a computer group having a server and a large number of computer clients is provided. When the data files to be transmitted are large, the total amount of mirror files made by the system and software reaches 200G or more, and the operation requirements need to be deployed to the hard disk of each machine, the large-scale data high-speed transmission method between clients of the present invention performs data diffusion transmission through a multi-level diffusion high-speed transmission structure of one-to-many in the computer group in the local area network, and at the same time cleverly combines a method of immediately starting data transmission to the next level of client computer once the client computer obtains 50% or more of the data transmission volume, so that a large number of client computers can quickly complete the replication and authentication of system data, and large-scale data transmission no longer needs to occupy a large amount of network resources, and also reduces the hardware requirements for the server and client computers, reduces the pressure on the server and the network, minimizes the impact on the network environment, and improves the maintenance work efficiency of the computer group.
[0030] The present invention proposes a method for high-speed transmission of large data between clients. In a preferred embodiment, please refer to Figure 1 As shown in the logical structure diagram, the method adopted by the present invention is: the server obtains the data transmission status information of the first client computer, and when the data transmission status of the template file of the first client computer is a completion percentage setting value greater than 30% and less than 100%, the transmission scheduling module of the server specifies the first client computer to send data to the next group of client computers in the computer group in the same local area network; thereby, during the transmission process, as long as the client computer system data transmission volume reaches a value between 30% and less than 100%, the server will immediately assign the next-level client computer as the client computer receiving data, and the client computer sends the loaded system data to it; without waiting until the data completion reaches 100%, this setting can achieve a further huge efficiency improvement in the data transmission efficiency of this one-to-many transmission structure, so that the time for data transmission and copying is reduced by nearly one-fifth to one-half of the working time compared to the method of transmitting after 100% transmission is completed.
[0031] The next group of client computers includes at least two client computers that need to receive data. When the transmission scheduling module obtains the data transmission status information of the template file of the client computers in the next group of client computers as the completion percentage setting value, the client computer is designated to send data to the next group of client computers; the transmission scheduling module assigns a group of client computers that need to receive data as new client computers to receive data for the client computers that have completed sending data, and starts to transmit template file data to them; until the transmission scheduling module obtains that the data transmission status information of the template file of all client computers that need to transmit data in the computer group is 100%.
[0032] The transmission scheduling module of the server plays a role in scheduling and allocating the data transmission of the client computers, so that the method of the present invention can quickly complete the data transmission operation for a large number of client computers in the computer group in the same local area network, and through the multi-level high-speed diffusion transmission mode of one-to-many transmission, the server and the client computers can realize the data transmission operation that depends on the network transmission rate of the network card in the same address segment, such as 100M network card, 1000M network card, etc., which can achieve a very high transmission rate. Preferably, in the environment of a general precursor network, a one-to-two transmission method can be adopted. After the first level of transmission is completed, the two client computers that have completed the transmission of the first client computer at the first level continue to form a new client computer that sends data. Through the selection and designation of the server transmission scheduling module, two client computers that receive data are respectively designated for the above three client computers, so that the total number of client computers that receive data at the second level can reach 6, and so on, diffusion step by step, forming 6, 18, 54... Such a diffusion sequence only needs to pass a few transmission levels to complete the system data transmission of dozens to hundreds of client computers with security authentication maintenance. For example, a computer group under a server has 60 client computers, and each computer needs to copy and remake a system template file of about 200G. Taking a gigabit network card as an example, starting from the first level, each level only needs about 15-20 minutes to complete the transmission and authentication. At the same time, the method of starting to transmit to the next level before reaching 100% is adopted. Taking 50% as an example, 60 computers only need 3-4 levels of time to complete, that is, about 30-45 minutes to complete the system reset maintenance of 60 client computers. According to this diffusion and transmission method with overlapping transmission volume, the larger the number of computer groups, the shorter the time required for subsequent operations, because after reaching the third level, from 18 to 54, an increase of 36, only one more level of time is needed. Later, from 54 to 162, an increase of 108, it is only an increase of 2 levels. Therefore, adding a thousand client computers in the future basically does not increase the operation time. Of course, here, we also need to consider the configuration of the machine and other objective factors that affect the transmission rate. In fact, it only takes a short time, such as one to two hours, to complete data reset and maintenance of dozens to hundreds of client computers in a computer group.
[0033] The large-scale data high-speed transmission method between clients of the present invention as described above, in its preferred embodiment, comprises a server, a plurality of client computers and an authentication microsystem module, wherein the plurality of client computers are arranged as at least one computer group;
[0034] The server is connected to the client computer via a network, a trusted root system module and a data pointer storage module are installed in the server, the trusted root system module stores a template file of the trusted root system, and the data pointer storage module is used to store a data pointer file from a hard disk of the client computer;
[0035] The server is provided with a transmission scheduling module, which collects the network configuration status information and data transmission status information of the client computer, and designates a client computer as the first client computer. The authentication microsystem module stores a trusted authentication microsystem for comparing the data information of the server and the client computer; it is started at the same time as the client computer is started, and after the client computer passes the hardware trusted authentication, the data pointer file of the client computer stored on the server is mapped to the designated storage sector of the hard disk of the client computer; the authentication microsystem module compares the data of the trusted root system marked by the data pointer file with the data of the trusted root system of the corresponding storage sector of the hard disk, and performs security authentication on the client computer.
[0036] The server is provided with a transmission scheduling module, which collects the network configuration status information and data transmission status information of the client computer, designates a client computer as the first client computer, and the authentication microsystem module stores a trusted authentication microsystem for comparing the data information of the server and the client computer; it is started at the same time when the client computer is started, and after the client computer passes the hardware trusted authentication, the data pointer file of the client computer stored on the server is mapped to the designated storage sector of the hard disk of the client computer; the authentication microsystem module compares the data of the trusted root system marked by the data pointer file with the data of the trusted root system of the corresponding storage sector of the hard disk, and performs security authentication on the client computer; after passing the above-mentioned trusted authentication, according to the mapping of the data pointer file on the hard disk of the client computer, the system data is filled in the corresponding sector of the hard disk of the client computer, and then the client computer is started to perform security authentication of the hard disk system sector. Among them, by utilizing the data mapping method of separating the data pointer and the hard disk storage sector, the technology of copying the template file to the storage sector of the target hard disk is completed, so that the transmission method of the present invention performs a one-to-one corresponding security verification while completing the transmission to form a complete template file. Only when the data on the corresponding storage sector of the hard disk of the client computer that completes the data reception is completely consistent with the data content in the data pointer, the system can be started normally. In this way, the first security authentication protection layer is constructed for the transmission method of the present invention.
[0037] Please refer to Figure 2As shown, the server 1 is connected to the client computer 3 via a network, and a trusted root system module and a data pointer storage module are installed in the server 1. The trusted root system module stores a template file of the trusted root system, and the data pointer storage module is used to store data pointer files from the client computer 3; wherein, the data pointer file is a necessary data pointer file for starting and identifying data on the hard disk 31 of the client computer. The present invention removes the data pointer files on the hard disks of each client computer 3 and stores them on the server 1. The client computer 3 is installed with a hard disk 31 capable of loading the trusted root system from the server 1. Thereby, the data on the hard disk 31 of the client computer 3 can be identified, read or written only when the client computer 3 obtains the trust of the server 1 and is connected to the server 1; that is, Figure 3A As shown, when the client computer 3 is out of the monitoring of the server 1, the data of the storage sector of the hard disk 31 on the client computer 3 will lose the corresponding data pointer, and its data cannot be identified and read, and the hard disk 31 is displayed as an empty hard disk. This is a data splicing technology, which separates the read and write of the hard disk, marks the shareable part, and only transmits the same data as the shared template file between the clients. There is an independent write area on the hard disk of each client computer. After they are spliced with the read-only area, they can present a complete storage partition structure, and then, the operation management strategy of the server synchronization is superimposed, and the client computer can run the system or store data locally. At the same time, 100% completion of data transmission synchronization refers to the full completion of the same template data, and does not include data in other free read and write areas of the client.
[0038] The authentication microsystem module 2 of the present invention stores a trusted authentication microsystem for comparing the data information of the server 1 and the client computer 3. Figure 3A, which is configured between the server 1 and the client computer 3; the authentication microsystem is an authentication system that is started before the system layer of the client computer 3, and is started at the same time when the client computer 3 is started; during the startup and use process of the client computer 3, the authentication microsystem monitors the data changes of the client computer 3 throughout the process, and once the data changes abnormally, it is immediately determined to be untrustworthy. After the client computer 3 passes the hardware trusted authentication, the data pointer file of the client computer 3 stored on the server 1 is mapped to the hard disk 31 of the client computer 3; the authentication microsystem module 2 compares the data of the trusted root system marked by the data pointer file with the data of the trusted root system of the corresponding storage sector of the hard disk 31, and performs real-time trusted authentication on the client computer 3; if the data of the trusted root system marked by the data pointer is inconsistent with the data of the trusted root system of the storage sector, the client computer 3 is determined to be untrustworthy. That is to say, if there is already data on the client computer 3, the server 1 maps the data pointer file corresponding to the hard disk 31 of the client computer 3 to the hard disk 31 and activates the data on the hard disk 31. If the data content marked by the data pointer is inconsistent with the data on the hard disk 31, the data on the hard disk 31 cannot be recognized, and the data content indicated by the data pointer is missing. The server 1 will determine that the hard disk 31 of the client computer 3 is untrustworthy and there are illegal changes. The server 1 will immediately strip off the data pointer file, make the hard disk 31 of the client computer 3 appear empty, and terminate the operation of the client computer 3.
[0039] In a preferred embodiment, the authentication microsystem can be installed on the server side, or on the master boot area on the hard disk 31 of the client computer 3, or on the master boot area of a mobile storage device, so that after the client computer 3 is powered on and started, the authentication microsystem is first connected or started to perform trusted authentication for identity verification. In a preferred case, for example, authentication of hardware devices such as CPU, memory, hard disk, and network card, the authentication microsystem then controls and manages the trusted activation and loading of data on the hard disk 31 of the client computer 3.
[0040] Preferably, when the client computer 3 writes new data to the hard disk 31, the data pointer file of the hard disk 31 is stored in the data pointer storage module of the server 1. After the client computer 3 is authorized, whether it is the data of the template file of the trusted root system loaded from the server 1 or the local data input by the client computer 3, the data pointer of the newly added data on the storage sector of the hard disk 31 will be stored in the data pointer storage module of the server 1, and will not be directly stored on the hard disk 31, which effectively ensures that the data pointer on the hard disk will not be tampered with.
[0041] In the above-mentioned large-scale data high-speed transmission method between clients, in a preferred embodiment, the transmission scheduling module collects the network configuration status information of the client computer, including the hardware device information of the CPU, hard disk, memory and network card of all client computers in the computer group and the network connection status information, the network connection status information includes the computer client online status, computer group status, operating system status and waiting time; the data transmission status information includes whether the transmitted data is the completion percentage setting value, and the completion percentage setting value is 50%; the transmission scheduling module specifies a client computer to receive data according to the performance of the computer hardware device information and the network connection status information. In this way, the server can realize the transmission scheduling of the client computer through the transmission scheduling module, and determine which client computer has a better data transmission environment condition with the server or other client computers according to the hardware device information and the network connection status information, so the selected client computer is a computer that can communicate better with the server or with the specified client computer.
[0042] In the above-mentioned large-scale data high-speed transmission method between clients, in a preferred embodiment, the transmission scheduling module selects the designated client computer for sending data according to the following priority order: the client computer is online, the network card speed is high and the network type is the same, the operating system is the same, the received data completion degree is 50%, it is in the same computer group, and the waiting time is short; the transmission scheduling module selects the designated client computer for receiving data according to the following selection condition priority order: the client computer is online, the network card speed is high and the network type is the same, the operating system is the same, it is in the same computer group, and the waiting time is short. By selecting the optimal next client computer for receiving data, the data transmission rate can be guaranteed to be kept in the optimal state, and the overall data transmission rate of the entire computer group is improved as a whole.
[0043] As described above, in the preferred embodiment of the large-scale data high-speed transmission method between clients of the present invention, the present invention is also directed to a data transmission control method after adding a secondary switch when there are client computers with a number exceeding the number of single-stage switch connections under the same switch. In order to reduce the impact of network transmission speed, the present invention adopts the following processing: the transmission scheduling module obtains the computer group information of the first client computer designated to receive data, and also includes confirming that the number of switch levels between the server and the first client computer is less than or equal to the number of switch levels between it and other client computers in the computer group; for example, in the same computer group, it is possible that all client computers are connected to the server through only one switch, then there is no switch between the computers in the computer group, and the data transmission between them will not be affected by the switch.
[0044] The transmission scheduling module obtains data transmission status information of other client computers other than the first client computer with 50% completion, and designates the client computer as the client computer sending data. If there is a first-level switch between the other client computer designated as receiving data and the client computer sending data, the other client computer is the next-level client computer of the switch; when the number of the previous-level client computers that have completed data transmission is greater than or equal to one, the next-level client computer will not be used as the client computer sending data of the previous-level client computer. Therefore, in a computer group, due to the large number of computers, it is often necessary to set up more levels of switches to expand these client computers. Through the scheduling control of the present invention, the client computer that has completed 50% of the data reception can become the next client computer that hides the data sent to other client computers, forming a level by level, after the transmission is full of 50%, it continues to designate the client computer receiving data at the next level, and completes the scheduling of all client computer system file data that need data transmission by the aforementioned one-to-two multi-level high-speed diffusion transmission mode scheduling control. If there is a lower-level switch in the computer group, through the identification of network information, when there is a client computer that has completed the transmission in the state of direct connection with the upper-level switch, the client computer under the lower-level switch is prohibited from transmitting data to the client computer of the upper level. This can reduce the problem of reduced transmission efficiency caused by the existence of the switch barrier and also reduce the network application pressure of the client computer under the lower-level switch.
[0045] In the above-mentioned large-scale data high-speed transmission method between clients, in its preferred embodiment, it is inevitable that transmission anomalies will occur during data transmission, for example, the client computer responsible for data transmission has an anomaly and is offline, and cannot continue to transmit data; at this time, the client computer receiving data has not completed 100% of data reception; the transmission scheduling module waits and designates another new client computer that has completed data reception greater than or equal to 50% and whose data transmission completion degree is greater than that of the client computer receiving data as the client computer sending data, and sends system data to the client computer receiving data. Preferably, for the case of an abnormal client computer sending data, the present invention adopts the aforementioned transmission scheduling principle, and selects by comparing and judging multiple factors to designate a client computer with better transmission effect to be transmitted first, so that the overall data transmission speed is faster and the network pressure in the computer group is reduced.
[0046] The large-scale data client-to-client high-speed transmission method of the present invention as described above, in its preferred embodiment, further in order to improve the data transmission efficiency, and at the same time reduce the server scheduling calculation pressure and resource consumption, after the above-mentioned abnormal situation occurs, the client computer receiving the data enters the patrol state, and sends a transmission request to the server every 30 seconds, and the transmission scheduling module waits and designates another client computer that has completed 100% of the data reception as the client computer sending data according to the selection condition priority order principle, and sends system data to the client computer receiving the data. Preferably, for the client computer that stops receiving data due to an abnormality, after the patrol, the server will only reallocate the computer client with 100% data completion as the data transmission source, and send system data to it, so that the occurrence of unnecessary abnormal situations can be more effectively reduced, and at the same time, there will be almost no extension of the transmission time. The efficiency is improved from the side, and the pressure requirements on the server and the network are also reduced.
[0047] In the preferred embodiment of the large data client-to-client high-speed transmission method of the present invention, in order to better manage the data security of the client computer 3, the hard disk 31 of the client computer 3 is provided with a local trusted root system storage area 311 and a local dynamic data storage area 312, please refer to Figure 3B As shown, the local trusted root system storage area 311 is a read-only storage area for loading the template file of the trusted root system from the server 1, that is, the storage area can only be modified by the data downloaded from the server side, and it is a read-only storage area for the user of the client computer 3; and the local dynamic data storage area 312 is an active storage area that allows the client computer 3 to add or modify operations. The local dynamic data storage area 312 is used to store user dynamic data other than the trusted root system, allowing the user to modify it. The data pointer files of the local trusted root system storage area 311 and the local dynamic data storage area 312 are stored in the data pointer storage module of the server 1, and only the data of the storage sector with the same data pointer mark is transmitted during data transmission. Whether the local trusted root system storage area 311 or the local dynamic data storage area 312 is in operation, the data pointer needs to be stored in the data pointer file on the server 1; in a preferred embodiment, after the client computer 3 is shut down, the data pointer of the local trusted root system storage area 311 of the data pointer file of the client computer 3 on the server 1 is saved, and the data pointer of its local dynamic data storage area 312 can be saved or deleted; thereby, the remotely controlled client computer 3 can still read the data in the local dynamic data storage area 312 after the next startup, or form a remote control desktop that restores the local dynamic data storage area 312 upon restart.
[0048] 9. The method for high-speed transmission between large data clients as claimed in claim 8 is characterized in that after the server completes 100% data transmission to the first client computer, it designates the first client computer to transmit data to the next group of client computers, forming a first one-to-many transmission diffusion structure; the server designates another first client computer to perform data transmission, and after completing 100% data transmission to the other first client computer, it designates the other first client computer to transmit data to another next group of client computers that need to receive data, forming a second one-to-many transmission diffusion structure; the client computers in the first one-to-many and second one-to-many transmission diffusion structures are not repeated. In this embodiment, a double one-to-two high-speed diffusion transmission mode is proposed to further improve the transmission efficiency. The server actively transmits data to the two first client computers respectively, and after all are transmitted to 100%, the two first client computers are used as the starting point to perform data transmission operations for subsequent client computers in turn until the transmission of all client computers is completed, which can further improve the transmission efficiency. That is, a dual-path one-to-two high-speed diffusion data transmission structure is formed, which can almost achieve double the effect of a single-path structure in terms of speed and efficiency.
[0049] After completing 100% of the data transmission of each first client computer, the server stops the outward data transmission of the server to protect the working process of the server, so that it can process other working processes while scheduling data transmission, and reduce the impact on other work tasks.
[0050] The large-scale data client-to-client high-speed transmission method of the present invention, in its preferred embodiment, can be found in Figure 3A and Figure 3BAs shown, in a preferred embodiment, the authentication microsystem module 2 is connected to an I / O control driver 4, and the I / O control driver 4 is used to identify and schedule input and output signals, and judge whether the trusted root system file data requested by the client computer 3 exists in the designated sector of the local trusted root system storage area 311 of its hard disk 31 according to the data pointer file mapped by the authentication microsystem. If not, the server 1 loads the requested trusted root system file data from the template file of the trusted root system to the designated sector, and stores the loaded data pointer file in the data pointer storage module of the server 1; if it exists, the next designated sector is judged according to the data pointer file mapped by the authentication microsystem. The I / O control driver 4 can identify and schedule the file data that needs to be mounted from the server in response to the request of the client computer 3. In a specific implementation, the client computer 3 can choose to run different operating systems according to the request, and the data of different operating systems are stored in different storage sectors on the hard disk 31 with specific data pointers. Therefore, through the identification and scheduling of the I / O control driver 4, it can select to read the data of the operating system in the specified sector and start the corresponding operating system according to the request of the client computer 3. For example, in Windows and Linux systems, when the client computer 3 requests to start the Windows system, the I / O control driver 4 will select to read the data pointer with the Window trusted root system mark in the data pointer file, start the Windows system and the corresponding application, and the file data of the non-Windows system cannot be recognized under the operating system, that is, it does not exist, thereby achieving absolute isolation of data of different operating systems.
[0051] As described above, when the present invention dispatches the template file of the trusted root system on the server 1 to the hard disk 31 of the client computer 3 through the network, it adopts the monitoring of a more secure authentication microsystem. In order to ensure that multiple different operating systems can perform secure calculations in parallel on the same user hard disk 31, a slice-type data reading verification mode is adopted. The so-called slice-type is to classify different data on the hard disk 31 by the index of the data pointer in the storage sector. For example, when the user calls the Windows system, the data pointer is reorganized, and the operation track of the Windows system data block on the hard disk is notified to the hardware CPU, memory, motherboard, etc.; when calling the Linux system, the original data pointer is released to the server 1 for storage, and the new data pointer is restarted for scheduling, and the data block of the Linux system on the hard disk is called. All data blocks are stored on the hard disk in a slice-type architecture, and the data pointer is stored on the server 1, which is much more secure than the traditional discrete data storage mechanism.
[0052] As described above, in a preferred embodiment of the large-scale data high-speed transmission method between clients of the present invention, the I / O control driver 4 determines the data addition or modification operation of the local dynamic data storage area 312 of the hard disk 31 of the client computer 3, and sends and stores the data pointer of the storage sector where the addition or modification operation occurs to the data pointer storage module of the server 1.
[0053] The authentication microsystem mechanism is introduced into the I / O control driver layer to control the operation of the terminal master boot record, partition table, IDTable, ID index, etc. While using the autonomous encryption algorithm to verify and strengthen the security of the kernel system, the IDTable will use the data pointer of the server side to present the static data of the terminal distributed data as the sector data; and the IDindex integrates the I / O controller driver and the autonomous algorithm to meet the functions of the client computer 3 such as verification, authentication and security audit. The present invention essentially solves the problems of the operation and calculation speed of the trusted terminal, the bandwidth occupation of the network, and the high requirements for the server. The personalized data (user data) of the client computer 3 is divided into the client computer 3 and the server part, that is, the data of the local dynamic data storage area 312 and the local trusted root system storage area 311, and is presented under the control of the security process and authentication microsystem of both parties. Once the client computer 3 closes the security process, it will be immediately discovered by the server, and the server 1 will prohibit the server part of the personalized data from being accessed, so that the client computer 3 cannot obtain the correct data. Similarly, if the client computer 3 is offline, the same is true. Of course, if the client computer 3 is authorized to perform offline operations, it can obtain complete personalized data content locally, effectively ensuring that the client computer 3 always runs in a trusted environment and ensuring the security of data on the client computer 3.
[0054] In a preferred embodiment, Figure 3A and Figure 3B As shown, since the server 1 mounts the necessary data in the template file of the trusted root system to the hard disk 31 of the client computer 3 according to the request of the client computer 3, it can run the operating system and application programs. At the same time, the file data of the trusted root system that has been mounted on the client computer 3 is saved through the data pointer file stored on the server 1, so that when it is started and run next time, it is no longer necessary to repeatedly load the data of the template file of the trusted root system that has been loaded. It only needs to load new data according to the request of the client computer 3, which reduces the burden of network communication of this system.
[0055] The above description is only an illustrative embodiment of the present invention and is not intended to limit the scope of the present invention. Any equivalent changes and modifications made by any person skilled in the art without departing from the concept and principle of the present invention shall fall within the scope of protection of the present invention.
Claims
1. A method for high-speed transmission of large data between clients, characterized in that: The server obtains data transmission status information of the first client computer. When the data transmission status of the template file of the first client computer is a completion percentage setting value between greater than 30% and less than 100%, the transmission scheduling module of the server designates the first client computer to send data to the next group of client computers in the computer group in the same local area network, the next group of client computers includes at least two client computers that need to receive data, and when the data transmission status information of the template file of the client computers in the next group of client computers obtained by the transmission scheduling module is the completion percentage setting value, the client computer is designated to send data to the next group of client computers; the transmission scheduling module designates a group of client computers that need to receive data as new client computers that receive data for the client computers that have completed sending data, and starts to transmit template file data to them; Until the transmission scheduling module obtains that the data transmission status information of the template files of all the client computers in the computer group that need to transmit data is 100%.
2. The method for high-speed transmission of large data between clients as claimed in claim 1, characterized in that: It includes a server, a plurality of client computers and an authentication microsystem module, wherein the plurality of client computers are arranged as at least one computer group; The server is connected to the client computer via a network, a trusted root system module and a data pointer storage module are installed in the server, the trusted root system module stores a template file of the trusted root system, and the data pointer storage module is used to store a data pointer file from a hard disk of the client computer; The server is provided with a transmission scheduling module, the transmission scheduling module collects the network configuration status information and data transmission status information of the client computer, designates a client computer as the first client computer, and the authentication microsystem module stores a trusted authentication microsystem for comparing the data information of the server and the client computer; It is started simultaneously when the client computer is started. After the client computer passes the hardware trusted authentication, the data pointer file of the client computer stored on the server is mapped to the specified storage sector of the hard disk of the client computer; the authentication microsystem module compares the data of the trusted root system marked by the data pointer file with the data of the trusted root system of the corresponding storage sector of the hard disk to perform security authentication on the client computer.
3. The method for high-speed transmission of large data between clients as claimed in claim 2, characterized in that: The transmission scheduling module collects the network configuration status information of the client computer, including the hardware device information of the CPU, hard disk, memory and network card of all client computers in the computer group and the network connection status information, wherein the network connection status information includes the online status of the computer client, the computer group status, the operating system status and the waiting time; the data transmission status information includes whether the transmitted data is the completion percentage setting value, and the completion percentage setting value is 50%; the transmission scheduling module specifies a client computer to receive data according to the performance of the computer hardware device information and the network connection status information.
4. The method for high-speed transmission of large data between clients as claimed in claim 3, characterized in that: The transmission scheduling module selects the client computer designated to send data according to the following priority order: the client computer is online, the network card speed is high and the network type is the same, the operating system is the same, the received data completion degree is 50%, it is in the same computer group, and the waiting time is short; The transmission scheduling module selects the designated client computer for receiving data according to the following selection condition priority order: the client computer is online, has a high network card speed and the same network type, has the same operating system, is in the same computer group, and has a short waiting time.
5. The method for high-speed transmission of large data between clients as claimed in claim 4, characterized in that: The transmission scheduling module obtains computer group information of a first client computer designated to receive data, and further includes confirming that the number of switch levels between the server and the first client computer is less than or equal to the number of switch levels between the server and other client computers in the computer group; The transmission scheduling module obtains data transmission status information of other client computers other than the first client computer with a 50% completion rate, and designates the client computer as a client computer for sending data. If there is a first-level switch between another client computer designated as receiving data and the client computer for sending data, the other client computer is a next-level client computer of the switch; when the number of previous-level client computers that have completed data transmission is greater than or equal to one, the next-level client computer will not be used as a client computer for sending data of the previous-level client computer.
6. The method for high-speed transmission of large data between clients as claimed in claim 5, characterized in that: When the client computer receiving data has not completed 100% of the data reception and the client computer sending data has an abnormality, it stops sending data; the transmission scheduling module waits for and designates another new client computer that has completed data reception greater than or equal to 50% and has a data transmission completion rate greater than that of the client computer receiving data as the client computer sending data, and sends system data to the client computer receiving data.
7. The method for high-speed transmission of large data between clients as claimed in claim 6, characterized in that: The client computer receiving data enters a patrol state and sends a transmission request to the server every 30 seconds. The transmission scheduling module waits for and designates another client computer that has completed 100% of the data reception as the client computer sending data according to the priority order principle of the selection conditions, and sends system data to the client computer receiving data.
8. The method for high-speed transmission of large data between clients as claimed in claim 7, characterized in that: The hard disk of the client computer is provided with a local trusted root system storage area and a local dynamic data storage area. The local trusted root system storage area is a read-only storage area for loading template files from the trusted root system of the server, and the local dynamic data storage area is an active storage area that allows the client computer to add or modify operations. The data pointer files of the local trusted root system storage area and the local dynamic data storage area are stored in the data pointer storage module of the server, and only the data of the storage sectors with the same data pointer mark are transmitted during data transmission.
9. The method for high-speed transmission of large data between clients as claimed in claim 8, characterized in that: After completing 50% of the data transmission to the first client computer, the server designates the first client computer to transmit data to the next group of client computers, thereby forming a first one-to-many transmission diffusion structure; The server designates another first client computer to perform data transmission, and after completing 50% of the data transmission to the other first client computer, designates the other first client computer to transmit data to another next group of client computers that need to receive data, thereby forming a second one-to-many transmission diffusion structure; the client computers in the first one-to-many transmission diffusion structure and the second one-to-many transmission diffusion structure are not repeated; after completing 100% of the data transmission to each first client computer, the server stops the server's outward data transmission.
10. The method for high-speed transmission of large data between clients as claimed in claim 2, characterized in that: The authentication microsystem module is connected to an I / O control driver, which is used to identify and schedule input and output signals, and determine whether the trusted root system file data requested by the client computer exists in a specified sector of the local trusted root system storage area of its hard disk according to the data pointer file mapped by the authentication microsystem. If not, the server loads the requested trusted root system file data from the template file of the trusted root system to the specified sector, and stores the loaded data pointer file in the data pointer storage module of the server; If it exists, the next designated sector is judged according to the data pointer file mapped by the authentication microsystem; the I / O control driver judges the data addition or modification operation of the local dynamic data storage area of the hard disk of the client computer, and sends and stores the data pointer of the storage sector where the addition or modification operation occurs to the data pointer storage module of the server.