Method and equipment for user acquiring network data

[0024] There are a lot of repeatedly transmitted data in the network. For example, if multiple users in B place need to obtain the same data transmitted from A at different times, the data must be repeatedly transmitted from A to B at different times according to the needs of users. To meet the needs of different users in B. In order to reduce the bandwidth occupation of the backbone network caused by this, in the embodiment of the present invention, when a data access request is received, it is determined whether the data requested to be accessed is stored locally in the access network, and if so, it will be stored in the access network. The local data is sent to the user, otherwise, the data is obtained through the backbone network and sent to the user.

[0025] Wherein, it may also include: monitoring the number of times a certain data is acquired through the backbone network, and when the predetermined number is reached, storing the data locally in the access network. Through the statistics of the number of downloads of the same data, the hot information in the network is automatically saved locally in the access network for users to access, so as to reduce the occupation of transmission resources in the network.

[0026] In order to improve the utilization of the storage space and release the storage space in time to ensure the entry of new data, the embodiment of the present invention can also monitor the access status of the data stored locally in the access network to age the data stored locally in the access network. Deletion can be implemented by at least one of the following operations: monitor the interval time a certain data is accessed by the user, and delete the data when the interval time exceeds a predetermined time; or save it locally when the local storage space is full. Compare the access probability of the data in the storage space, and delete the data with low access probability in the local storage space according to the storage space requirements of the data that needs to be saved; when the local storage space is full, the data that needs to enter the local storage space will be deleted. The access probability is compared with the access probability of the locally stored data, and the data with low access probability in the local storage space is deleted (this method is suitable for when a certain data is acquired through the backbone network for a predetermined number of times, the access The situation where the data is saved locally on the network).

[0027] The specific implementation of the embodiments of the present invention in the actual application process will be described in detail below with reference to the accompanying drawings.

[0028] A processing solution for realizing user acquisition of network data provided by the embodiment of the present invention is shown in FIG. 1, and may specifically include the following steps:

[0029] Step 11. The local network device receives the data access request sent by the user;

[0030] Step 12. According to the data access request, determine whether the data required by the user is stored locally in the access network. If it is not stored locally in the access network, perform step 13; otherwise, perform step 15;

[0031] Step 13. If the data required by the user is not stored locally in the access network, the data is obtained through the backbone network and sent to the corresponding user, and the data is downloaded and counted to count the number of times a certain data has passed through the backbone For the number of Internet downloads, go to step 14;

[0032] Step 14. When the count of downloading the data through the backbone network reaches a predetermined number of times, the data is downloaded and saved locally, so that subsequent requests for the data can directly obtain the corresponding data locally;

[0033] Wherein, the specific setting method of the predetermined number of times can be manually set. For example, when the first access request for data is received, the system prompts the operator to enter the predetermined number of times corresponding to the data, and the operator enters the specific value as needed; or It is automatically set, such as the system default value as the predetermined number of times for each data.

[0034] Step 15. If the data required by the user has been stored locally in the access network, the data stored locally in the access network is sent to the user.

[0035] The data stored locally in the access network can be stored in the network device or in a specific storage device that communicates with the access network device.

[0036] In the above-mentioned embodiment of the present invention, it is also possible to perform aging and deletion of data stored locally in the access network by monitoring the access status of the data.

[0037] The specific aging deletion method can be implemented through at least one of the following operations:

[0038] The aging deletion method based on the time interval between data accesses monitors the interval time for a certain data to be accessed by the user. When the interval time exceeds the predetermined aging deletion time, the data is deleted. The aging deletion time can be based on the local idle storage. The size of the space is dynamically set. If the idle storage space is large (for example, greater than a certain threshold), the aging deletion time can be set longer, otherwise, the aging deletion time can be set to be shorter. The setting method can be set manually or automatically according to the needs of users;

[0039] An aging deletion method based on the comparison of data access probability, that is, when the local storage space is full, the access probability of new data that needs to enter the local storage space is compared with the access probability of the old data stored locally, and the access probability is deleted. Low old data. Specifically, it can compare the access probability of new data with the access probability of each old data, and determine whether the storage space occupied by all old data whose access probability is lower than the access probability of new data can meet the needs of new data. If possible, delete all or part of the old data whose access probability is lower than the new data access probability, and save the new data; otherwise, delete only the old data whose access probability is lower than the new data access probability, but refuse to save the old data New data, among which, when deleting part of the data whose access probability is lower than the new data's access probability, it only needs to meet the new data storage space requirements (the data whose access probability is lower than the new data's access probability can be randomly deleted, or it can be deleted according to the Data whose access probability is lower than the access probability of new data is deleted in descending order of access probability, etc.). The access probability refers to the number of times the same data is requested to be accessed within a unit time, and the unit of measurement may be times/hour. For example, the time interval for acquiring the new data through the backbone network for the first time and the Nth time is T 1 , Then N divided by T 1 The access probability of the new data can be obtained; the time interval from the first time to the last time the corresponding old data in the local storage space is obtained before the statistics of the access probability is T2 , In T 2 The number of times the old data is acquired within is M, then M is divided by T 2 The access probability of the old data can be obtained.

[0040] To prevent users from maliciously accessing a large amount of useless data in the local storage space, in the embodiment of the present invention, access authentication can be performed on access network users, and data access requests sent by users who have not passed the access authentication can be denied; The number of access requests for the same data from the same IP address can be monitored, and if it exceeds a predetermined value, the user's data access request is rejected, otherwise the data is sent to the user.

[0041] To facilitate the understanding of the foregoing embodiment of the present invention, the following takes the application of the embodiment of the present invention in the network system shown in FIG. 2 as an example to further describe the specific processing process for users to obtain network data:

[0042] In the network system shown in Figure 2, file server A and local network device B are connected to the backbone network, and users (N1-NN3) in the access network of B are all connected to local network device B. Currently, multiple users need to Access file XX on file server A at location A at different times.

[0043] User N1 sends an access request for file XX to local network device B, assuming that the access request for file XX is the first access request for file XX in the access network where user N1 is located;

[0044] The local network device B judges that the file XX is not stored locally in the access network, and the access request to the file XX is the first access request, then sets the downloaded count threshold for the file XX, for example, set the downloaded count threshold= 3;

[0045] The local network device B obtains the file XX in the file server A through the backbone network and sends it to the user N1. Since the access request to the file XX is the first access request to the file XX in the access network where the user N1 is located, the file XX is corresponding The number of download counts is set to 1, and the download count records the number of times the local network device B downloads the file XX from the file server A;

[0046] User N2 sends an access request for file XX to local network device B;

[0047] The local network device B judges that the file XX is not saved locally, and obtains the file XX in the file server A from the network device A through the backbone network and sends it to the user N2, and counts the download times corresponding to the file XX, that is, the file XX corresponds to The download count of is 2;

[0048] User N3 sends an access request for file XX to local network device B;

[0049] The local network device B judges that the file XX is not saved locally, it obtains the file XX in the file server A and sends it to the user N3, and accumulates the number of downloads corresponding to the file XX, which is 3. The download count reaches the preset downloaded threshold 3, so the file XX is downloaded to the local network device B or the local storage device associated with the local network device B;

[0050] When receiving the access request for the file XX again, the local network device B judges that the file XX has been saved locally, and therefore sends the locally saved file XX to the user who made the access request, instead of extracting data through the backbone network.

[0051] If the user at B place needs to access other same files on the file server A at A place at different times, such as file YY, file ZZ, etc., the same can be achieved by following the above steps.

[0052] Another method for realizing users to obtain network data provided by the embodiment of the present invention is shown in FIG. 3, which may specifically include the following steps:

[0053] Step 31: The local network device receives the data access request sent by the user;

[0054] Step 32: According to the data access request, determine whether the data required by the user is stored locally in the access network, if it is not stored locally in the access network, perform step 33, otherwise, perform step 35;

[0055] Step 33: Obtain the data through the backbone network and send it to the corresponding user, download and save the data locally in the access network, set an aging deletion time for the data, and perform step 34;

[0056] Step 34: When the access interval time of the data stored locally in the access network exceeds the corresponding aging deletion time, delete the data locally from the access network;

[0057] Step 35: If the data required by the user has been stored locally in the access network, the data stored in the local network device is sent to the user.

[0058] When the local storage space is full, in the above-mentioned embodiment of the present invention, the locally stored data can also be aged and deleted by the access probability comparison method, that is, the access probability of all locally stored old data is compared, as required The size of the space required for the new data to enter the local storage space, delete some or all of the old data with a low probability of being accessed (the old data with a low probability of being accessed can be deleted randomly, or deleted in descending order of the probability of being accessed Old data with a low probability of being accessed, etc.). The access probability refers to the number of times the same data is requested to be accessed within a unit time, and its measurement unit may be times/hour. For example, the time interval from the first time the old data is retrieved from the local storage space before the statistical access probability is T 2 , In T 2 The number of times the old data is acquired within is M, then M is divided by T 2 The access probability of the old data can be obtained.

[0059] The embodiment of the present invention also provides a device for enabling users to obtain network data. The structure is shown in Fig. 4. The specific implementation structure may include a data judgment module 41, a data sending module 42, and a data forwarding module 43, where:

[0060] The data judging module 41 is used to judge whether the data requested to be accessed is stored in the local storage space 48 of the access network according to the received data access request, and if so, notify the data sending module 42 to perform the data sending operation; otherwise , Notify the data forwarding module 43 to perform a data forwarding operation;

[0061] The data sending module 42 is configured to send the data requested by the user stored in the local storage space 48 of the access network to the user according to the notification sent by the data judgment module 41;

[0062] The data forwarding module 43 is configured to obtain the data requested by the user through the backbone network and send it to the user according to the notification sent by the data judgment module 41.

[0063] Among them, the device of the embodiment of the present invention may further include a data download module 44, which is used to download data required by users in the local access network through the backbone network and save them in the local storage space 48 of the access network, so as to facilitate local services. The user provides the corresponding data; the access statistics module 45 is used to count the number of times a certain data is acquired through the backbone network, and when the predetermined number is reached, the data download module 44 is notified to save the data locally in the access network 48 of storage space.

[0064] The local storage space 48 shown in FIG. 4 can be implemented by setting a data storage device in the device provided in the embodiment of the present invention, or can be implemented by a storage device located locally in the access network and associated with the device provided in the embodiment of the present invention.

[0065] In order to improve the utilization of storage space and release storage space in time to ensure the entry of new data, the device in this embodiment of the present invention may further include at least one of the following modules:

[0066] The time aging deletion module 46 is used to monitor the interval time for a certain data to be accessed by the user, and when the interval time exceeds a predetermined time, delete the data from the local storage space 48 of the access network;

[0067] Probability aging delete module one 471, used to compare the access probability of the data stored in the local storage space when the local storage space 48 is full, and delete the accessed data in the local storage space 48 according to the storage space requirements of the data to be saved Low probability data;

[0068] Probability aging delete module two 472, used to compare the access probability of the data that needs to enter the local storage space with the access probability of the data stored locally when the local storage space 48 of the access network is full, and will be accessed Data with a low probability is deleted from the local storage space 48 of the access network. Specifically, it can compare the access probability of new data with the access probability of each old data, and determine whether the storage space occupied by all old data whose access probability is lower than the access probability of new data can meet the needs of new data. If possible, delete all or part of the old data whose access probability is lower than the new data's access probability, and save the new data; otherwise, only delete the old data whose access probability is lower than the new data's access probability, but refuse to save the new data. In the new data, when deleting part of the data whose access probability is lower than the new data access probability, it only needs to meet the new data storage space requirement.

[0069] The access probability refers to the number of times the same data is acquired or accessed in a unit time, and the unit of measurement may be times/hour. For example, the time interval when the new data is acquired through the backbone network for the first time and the Nth time (N is the number of aging) is T 1 , Then N divided by T 1 The access probability of new data can be obtained; from the first time to the last time before the access probability is counted, the time interval between the corresponding old data in the local storage space is T 2 , In T 2 The number of times the old data is obtained or accessed is M, then M is divided by T 2 The access probability of the old data can be obtained.

[0070] To facilitate the understanding of the foregoing embodiments of the present invention, a specific storage network device is also provided. The specific implementation structure and working principle of the device will be described in detail below with reference to FIG. 5.

[0071] As shown in Figure 5, the structure of the corresponding storage network device includes a storage module 51, a network processor NP (Network Processor) 52, a central processing unit (CPU) 53, a user interface module 54 and a backbone network interface module 55, among which:

[0072] The storage module 51 is configured to store the received data locally in the access network, where the data includes data required by the user and message data sent by the network processor 52;

[0073] The storage module 51 usually adopts a magnetic disk storage medium, and according to different user requirements, a variety of different specifications and types of memories can be selected. The storage method can be classified storage, for example, the corresponding data can be classified and stored based on different service types such as Internet Protocol Television (Internet Protocol Television) and HDTV (High Definition Television); it can also be stored preferentially, such as through Set the priority for the data source IP address, and store the corresponding data preferentially based on the IP address.

[0074] The network processor (NP) 52 is used to send the corresponding data stored in the storage module 51 to the user according to the received data access request (that is, to realize the function of the data sending module 42 in FIG. 4), and to receive Data required by users in the local access network are transmitted to the storage module 51;

[0075] The central processing unit (CPU) 53 is respectively connected to the storage module 51 and the NP52, and controls and realizes the data transfer between the storage module 51 and the NP52, that is, it is used to add the data reported by the NP52 to the storage module 51.

[0076]The user interface module 54 is used to connect with users in the access network to realize data communication with the users;

[0077] The user interface module 54 supports an Ethernet-based protocol and can provide flexible configuration. To facilitate user access, the user interface module can also be connected to the CPU53 to provide users with the storage data information in the device, the access interval, the access frequency and other related storage information in real time through the file system of the CPU53.

[0078] The backbone network interface module 55 is used to connect to the backbone network to realize data communication with devices outside the access network.

[0079] Among them, the storage network device of the embodiment of the present invention may also include a field programmable logic array module (FPGA) 56, which is used to communicate with the NP52 and count the number of times a certain data is accessed by the user. When the predetermined number of times is reached, pass The CPU 53 notifies the storage module 51 to save the data.

[0080] In the storage network device provided by the foregoing embodiment of the present invention, the NP52 further includes a data forwarding module 523 and a data judgment module 522. The data forwarding module 523 is configured to send data according to received local access network users. The incoming data access request obtains the data required by the user through the backbone network and forwards it to the user; the data judgment module 521 is used to judge whether the requested data is stored locally in the access network, and if so, it passes The CPU 53 notifies the data sending module 522 to send the data to the user; otherwise, it notifies the data forwarding module 523 to obtain the data through the backbone network and send it to the user.

[0081] In order to improve the utilization of storage space and release storage space in time to ensure the entry of new data, the field programmable logic array module 56 may include at least one of the following modules:

[0082] The time aging delete module 561 is used to monitor the interval time for a certain data to be accessed by the user, and when the interval time exceeds a predetermined time, delete the data from the storage module 51 through the CPU 53;

[0083] Probability aging delete module one 562, used to compare the access probability of the data stored in the local storage space when the local storage space is full, and delete the local storage space according to the storage space requirements of the data that needs to be saved, and the access probability of the local storage space is low The data;

[0084] Probability aging delete module two 563, used to compare the access probability of the data that needs to enter the local storage space with the access probability of the data stored locally when the local storage space is full, and use the CPU53 to compare the access probability of the data with low access probability The data is deleted from the storage module 51. Specifically, it can compare the access probability of new data with the access probability of each old data, and determine whether the storage space occupied by all old data whose access probability is lower than the access probability of new data can meet the needs of new data. If possible, delete all or part of the old data whose access probability is lower than the new data's access probability, and save the new data; otherwise, only delete the old data whose access probability is lower than the new data's access probability, but refuse to save the new data. In the new data, when deleting part of the data whose access probability is lower than the new data access probability, it only needs to meet the new data storage space requirement.

[0085] The access probability refers to the number of times the same data is acquired or accessed within a unit time, and the unit of measurement may be times/hour. For example, the time interval when the new data is acquired through the backbone network for the first time and the Nth time (N is the number of aging) is T 1 , Then N divided by T 1 The access probability of the new data can be obtained; from the first time to the statistics before the access probability, the time interval between the last acquisition of the corresponding old data in the local storage space is T 2 , In T 2 The number of times the old data is obtained or accessed is M, then M is divided by T 2 The access probability of the old data can be obtained.

[0086] In the storage network device provided by the foregoing embodiment of the present invention, the NP, CPU, and FPGA can have multiple implementation structures, which can be connected or communicated in an appropriate manner to achieve the functions of the above-mentioned functional modules, and their specific working methods It can be:

[0087] (1) Realization of data identification and user identification functions: NP receives messages sent by users, recognizes the visits of different users through information such as the user's IP address and requested access file name in the messages, and receives data from the backbone network ; Through the analysis of some or all of the messages in layers 1 to 7 of the network, access to the same data is identified according to the file source IP address, port number, file check code, file date and other information in the data message;

[0088] (2) The realization of the data sending function: NP matches the message information of the data access request with the message information of the locally stored data, and sends the matching result to the CPU. If the matching data is found, the CPU sends the user locally Send the data; otherwise, the CPU obtains the data through the backbone network and sends it to the user;

[0089] (3) Realization of data storage and aging function: NP can but is not limited to adopt the structure of X11+DUNE. After some or all of the network 1-7 layers are deeply analyzed through the X11, the message The result of the analysis is attached to the data message in the form of a label and sent to the DUNE chip. The chip cooperates with the FPGA module to realize statistics and other related functions, which may specifically include:

[0090] The FPGA performs statistical calculations on the number of access times, access intervals, access probability, etc. of different data according to the message analysis results, and sends the calculation results to the CPU. The CPU compares the download count reported by the FPGA with the set aging The number of times, when the number of downloads reaches the number of aging, the corresponding data is saved to the storage module through the CPU control;

[0091] By comparing the data access interval reported by the FPGA with the set aging deletion time, determine whether the data needs to be deleted, and when it is determined that it needs to be deleted, delete the corresponding data stored in the storage module through the CUP control;

[0092] By comparing the access probability of the new data reported by the FPGA with the old data, it is determined whether to delete the old data to accept the new data. If so, the CPU controls to delete the data with low access probability stored in the storage module, and control the new data Save to the storage module.

[0093] It can be seen from the above description of the embodiment of the present invention that by adopting storage and routing technology, the data required by the user is downloaded and stored locally in the access network, so that users in the local access network can access, reducing the number of repeated transmissions of the same data. The resulting bandwidth occupancy of the backbone network.

[0094] In addition, the realization of IP multicast communication requires routers, hubs, switches and hosts between the multicast source and receiver to support IP multicast functions. If one of the links does not meet the requirements of multicast, multicast will not be implemented. , So the network equipment with low configuration will not be able to use multicast technology. However, the embodiments of the present invention have low requirements on the hardware for users to access the network, and only need network devices with storage capabilities or associated storage devices. The network optimization can be completed without changing the current network planning, and the network can be reduced. Optimize cost; in addition, the implementation of the embodiment of the present invention does not need to rent a long-distance backbone network, so compared with the wavelength division multiplexing technology, the cost of user access to the network is reduced.

[0095] The above are only the preferred specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or changes within the technical scope disclosed in the present invention. All replacements should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.