A method for fast transmission of broadband and narrowband data, edge server and terminal device

Abstract

The present invention discloses a method for fast transmission of broadband and narrowband data, an edge server and a terminal device. The terminal device responds to a user's search request and inquires whether there is a local cache. If there is a local cache, the data is first read from the local cache and returned to the user; regardless of whether there is a cache, the terminal device will request the content from the edge server to obtain a response from the edge server; if the edge server has a cache, the cache is returned to the terminal device so that the terminal device updates its cache content. Regardless of whether the cache exists or not, the edge server will access the cloud server, obtain the response and return it to the terminal device first, and at the same time determine whether the requested content is a hot spot, and according to the determination result, create, update or clear the cache content in the edge server. The present invention can reduce the network and server load, reduce network traffic, and effectively avoid the problem of excessive cache data affecting the performance of the edge server.

Description

Technical Field

[0001] The present invention belongs to the technical field of data transmission, and in particular to a method, an edge server and a terminal device for realizing fast transmission of broadband and narrowband data through an edge computing framework based on K3S. Background Art

[0002] With the rapid development of the times, information data in various scenarios has also increased significantly, even exponentially. At present, many scenarios use cloud computing models to process data. Cloud computing can be seen as a network that provides resources. It brings together many computing resources and realizes automatic resource management through software. When people use it, they automatically schedule resources through programs to realize rapid processing of data information. However, due to its centralized and platform-based characteristics, massive data needs to reach the cloud computing center for processing and storage, which makes the network bandwidth and computing center bear great pressure during the transmission and computing processes. In addition, in long-distance data transmission, the probability of data loss and theft increases, and security is greatly reduced. In this context, edge computing came into being.

[0003] Edge computing refers to building a platform as close to the data source as possible to provide fast and effective services to meet the requirements of real-time, security and privacy protection in data transmission. This does not mean processing data at the terminal, but real-time processing and analysis near the collection source, and data no longer needs to be uploaded to the cloud. Doing so can reduce network and server loads, reduce network traffic, reduce expenses, improve work efficiency, and flexibly adjust processing solutions.

[0004] However, due to the high real-time requirements of edge computing, the complex architecture (various types of terminals access the network), the wide variety of data, and the limited computing and storage capabilities of terminal devices, the edge computing framework cannot perfectly handle various situations. When the edge server cannot meet the data needs of the application, the real-time data processing task cannot be completed within the deadline, which will lead to task failure. Summary of the invention

[0005] In order to solve the above problems, the present invention introduces the concept of collaborative computing and storage. Collaborative computing refers to a geographically dispersed group of people collaborating with each other with the help of computers and network technology to jointly complete a task. The introduction of collaborative distribution can reduce the collaborative obstacles caused by time and space division, effectively improve the problems of insufficient resources in the data processing process, improve the quality and efficiency of group work, and thus improve the efficiency of task processing.

[0006] In order to further realize the requirements of "fast" and "smooth" in the edge computing framework, the concept of data caching is introduced on the basis of collaborative computing. In today's information age, "hotspot" information has always been the focus of people's attention. When "hotspot" data is frequently accessed, getting content from the remote cloud server each time will generate a lot of duplicate data, resulting in a waste of bandwidth and resources. Caching these "hotspot" data in the edge server can reduce data network transmission and increase access speed.

[0007] Based on this, the present invention provides a method, an edge server and a terminal device for realizing fast transmission of broadband and narrowband data through an edge computing framework based on k3s, so as to speed up data transmission by partial data caching.

[0008] To achieve the above object, the present invention adopts the following technical solution:

[0009] In a first aspect, the present invention provides a method for fast transmission of broadband and narrowband data, the method being executed on an edge server, comprising:

[0010] In response to the request of the terminal device, determine whether there is cached data locally; if there is cached data, first obtain the data from the local cache and return it to the terminal device, and then request the remote cloud server; if there is no cached data, directly request the remote cloud server;

[0011] The request content returned by the remote cloud server is returned to the terminal device; at the same time, it is determined whether the request content returned by the remote cloud server is a hotspot, and the local cache content is processed according to the determination result; wherein the hotspot refers to data whose number of requests within a set time meets preset conditions, or data whose requests have time regularity.

[0012] Furthermore, the processing of the local cache content includes creating, updating or deleting;

[0013] The determining whether the request content returned by the remote cloud server is a hotspot and processing the local cache content according to the determination result includes:

[0014] If the requested content is determined to be a hotspot and no cache exists locally, a relevant cache is created locally;

[0015] If the requested content is determined to be a hotspot and there is a local cache, the local related cache is updated;

[0016] If it is determined that the requested content is not a hotspot and there is a local cache, the local related cache is cleared.

[0017] Further, determining whether the request content is a hotspot includes:

[0018] If the response information is simple data, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset first search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the first search number threshold, then the request content is determined to be a hotspot;

[0019] If the response information is large file information, and the request address is fixed, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset second search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the second search number threshold, then the request content is determined to be a hotspot;

[0020] If the response information is file stream information, the request address is fixed, and the request has temporal regularity, then the request content is determined to be a regular hotspot.

[0021] Furthermore, the hotspot search times threshold is determined according to the size of the local remaining cache space, and the hotspot search times threshold is dynamically adjusted as the size of the local remaining cache space changes.

[0022] Furthermore, according to different data types, different thresholds for the number of hotspot searches are set.

[0023] Furthermore, if the response information is large file information, and the request address is fixed and is determined to be a hotspot, and there is no local cache, the file information is directly cached, and the cache of the file information is no longer updated in subsequent requests until the number of requests for the file exceeds a preset value or the cache time exceeds a preset duration, and the remote cloud server is requested for data once, and the cache is updated after receiving the data returned by the remote cloud server;

[0024] If it is subsequently determined that the requested content is no longer a hot spot, the cache of the file information is cleared.

[0025] Furthermore, if the request content is determined to be a regular hotspot, after the first request is updated in each update cycle, the update package is cached locally, and when a subsequent request from a terminal device is received, the update package is returned to the terminal device, and the cache is no longer updated in subsequent requests until the next update cycle arrives, when the cache is updated, the old update package cache is cleared, and a new update package is cached;

[0026] If it is subsequently determined that the request content is no longer a regular hotspot, the corresponding update package cache will be cleared.

[0027] Furthermore, the method for rapid transmission of broadband and narrowband data further includes:

[0028] In response to the same search request sent by multiple terminal devices within a set time, a request is made to the remote cloud server only when the first request is received.

[0029] Furthermore, for large file information, according to the characteristic that slicing is required when transmitting large files, the arriving data is compared, and the data that is repeated too much or fixed is cached.

[0030] Furthermore, the method for rapid transmission of broadband and narrowband data also includes, when there is no hotspot in the local cache at the beginning, randomly selecting request content as hotspot data according to the request record of the terminal device, and establishing a cache for it.

[0031] In a second aspect, the present invention provides a method for fast transmission of broadband and narrowband data, the method being executed on a terminal device, comprising:

[0032] In response to the received search request, check whether there is a local cache; if there is a local cache, read the data from the local cache first and then send the request to the edge server; if there is no local cache, send the request directly to the edge server;

[0033] Update the local cache based on the request content returned by the edge server.

[0034] In a third aspect, the present invention provides an edge server, comprising:

[0035] The second retrieval module is used to respond to the request of the terminal device and determine whether there is cached data locally; if there is cached data, first obtain the data from the local cache and return it to the terminal device, and then request the remote cloud server; if there is no cached data, directly request the remote cloud server;

[0036] The hotspot determination module is used to return the request content returned by the remote cloud server to the terminal device; and at the same time determine whether the request content returned by the remote cloud server is a hotspot;

[0037] The second cache update module is used to process the local cache content according to the judgment result of the hot spot judgment module; wherein the hot spot refers to data whose request times meet preset conditions within a set time, or data whose requests have time regularity.

[0038] Furthermore, the hotspot determination module is used to:

[0039] If the response information is simple data, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset first search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the first search number threshold, then the request content is determined to be a hotspot;

[0040] If the response information is large file information, and the request address is fixed, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset second search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the second search number threshold, then the request content is determined to be a hotspot;

[0041] If the response information is file stream information, the request address is fixed, and the request has temporal regularity, then the request content is determined to be a regular hotspot.

[0042] Furthermore, the second cache update module is used to:

[0043] If the requested content is determined to be a hotspot and no cache exists locally, a relevant cache is created locally;

[0044] If the requested content is determined to be a hotspot and there is a local cache, the local related cache is updated;

[0045] If it is determined that the requested content is not a hotspot and there is a local cache, the local related cache is cleared.

[0046] In a fourth aspect, the present invention provides a terminal device, comprising:

[0047] The first retrieval module is used to query whether there is a local cache in response to the received search request; if there is a local cache, first read the data from the local cache and then send the request to the edge server; if there is no local cache, directly send the request to the edge server;

[0048] The first cache update module is used to update the local cache according to the request content returned by the edge server.

[0049] The present invention provides an electronic device, comprising one or more processors, a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods described in the first aspect.

[0050] The present invention provides a readable storage medium having one or more programs stored thereon, wherein the one or more programs include instructions, which, when executed by a computing device, enable the computing device to execute any one of the methods described in the first aspect.

[0051] The present invention also provides an electronic device, comprising one or more processors, a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the methods described in the second aspect.

[0052] The present invention also provides a readable storage medium having one or more programs stored thereon, wherein the one or more programs include instructions, which, when executed by a computing device, enable the computing device to execute any one of the methods described in the second aspect.

[0053] Beneficial technical effects achieved by the present invention:

[0054] The present invention flexibly determines the content that needs to be cached by setting a preset program in the edge server, thereby accelerating data transmission by controlling the cache information in the edge server. This neither wastes cache space nor causes excessive overflow of cache resources, thereby improving the network transmission and access speed of data. The present invention has broad application prospects and can be applied to various scenarios for reducing transmission delays under the edge computing framework. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 It is the distribution map of terminal devices, edge servers and remote cloud servers;

[0056] Figure 2 This is a flow chart of a method for rapid transmission of broadband and narrowband data according to an embodiment of the present invention;

[0057] Figure 3 It is the determination and life cycle diagram of hot spots;

[0058] Figure 4 It is a schematic diagram of the terminal device structure of the present invention;

[0059] Figure 5 It is a schematic diagram of the edge server structure of the present invention. DETAILED DESCRIPTION

[0060] The present invention will be further described below in conjunction with specific examples. The following examples are only used to more clearly illustrate the technical solutions of the present invention, and are not intended to limit the scope of protection of the present invention.

[0061] The present invention provides a method for realizing fast transmission of broadband and narrowband data through an edge computing framework based on k3s, which accelerates data transmission by partially caching data, that is, in the process of accelerating data transmission, not all data needs to be cached, and the cached data needs to be screened. The method is implemented based on terminal devices, edge servers and remote cloud servers. The distribution of terminal devices, edge servers and remote cloud servers is as follows: Figure 1 shown.

[0062] In one embodiment, the present invention provides a method for fast transmission of broadband and narrowband data, the method being executed on an edge server and comprising:

[0063] In response to the request of the terminal device, determine whether there is cached data locally; if there is cached data, first obtain the data from the local cache and return it to the terminal device, and then request the remote cloud server; if there is no cached data, directly request the remote cloud server;

[0064] The request content returned by the remote cloud server is returned to the terminal device; at the same time, it is determined whether the request content returned by the remote cloud server is a hotspot, and the local cache content is processed according to the determination result; wherein the hotspot refers to data whose number of requests within a set time meets preset conditions, or data whose requests have time regularity.

[0065] In another embodiment, the present invention provides a method for fast transmission of broadband and narrowband data, the method being executed on a terminal device and comprising:

[0066] In response to the received search request, check whether there is a local cache; if there is a local cache, read the data from the local cache first and then send the request to the edge server; if there is no local cache, send the request directly to the edge server;

[0067] Update the local cache based on the request content returned by the edge server.

[0068] like Figure 2 FIG. 1 is a flow chart of a method for fast transmission of broadband and narrowband data provided by an embodiment of the present invention, the method specifically comprising:

[0069] Step S1, in response to a search request issued by a user in a terminal device, the terminal device performs a local search to check whether there is a local cache; if there is a local cache, proceed to step S2, otherwise, proceed to step S3;

[0070] Step S2: The terminal device first reads data from the local cache and returns it to the user, and then sends a request to the edge server;

[0071] Step S3, the terminal device directly sends a request to the edge server;

[0072] Step S4, in response to the request of the terminal device, the edge server determines whether there is cached data locally; if there is cached data, proceed to step S5, otherwise, proceed to step S6;

[0073] Step S5, the edge server first obtains data from the local cache and returns it to the terminal device, and then makes a request to the remote cloud server;

[0074] Step S6, the edge server directly requests the remote cloud server;

[0075] Step S7, the edge server returns the request content returned by the remote cloud server to the terminal device; at the same time, it determines whether the request content returned by the remote cloud server is a hotspot, and creates, updates or clears the cache content in the edge server according to the determination result;

[0076] Step S8: The terminal device updates the local cache according to the request content returned by the edge server.

[0077] In this method, when new data needs to be transmitted, it is first queried whether the same or similar data exists in the local cache of the terminal device or the cache space of the edge server. If so, the data in the cache can be directly transmitted to the target end, thereby saving data transmission time and being convenient and fast.

[0078] Among them, Figure 2 As shown, in step S7, it is determined whether the request content returned by the remote cloud server is a hotspot, and based on the determination result, the cache content in the edge server is newly created, updated or cleared, including:

[0079] Step S701, determining whether the request content returned by the remote cloud server is a hotspot, if it is determined to be a hotspot, proceeding to step S702, otherwise, proceeding to step S705;

[0080] Step S702, determine whether there is a cache in the edge server, if there is a cache, go to step 703; otherwise, go to step S704;

[0081] Step S703, updating the relevant cache in the edge server;

[0082] Step S704, creating a relevant cache in the edge server;

[0083] Step S705, determining whether there is a cache in the edge server, if there is a cache, clearing the relevant cache in the edge server.

[0084] Among them, hotspots refer to data whose number of requests within a set time meets preset conditions, or data whose requests have time regularity. Time regularity means that the time of requests presents periodic characteristics.

[0085] The hotspot determination criteria are different for different requests.

[0086] Among them, one valid data for judging whether a request is a hotspot is to count the total number of searches for the keyword and its associated fields within a time period, and the trend of the total number of searches within multiple consecutive time periods, and combine the two to be used as valid data for judging whether it is a hotspot. More specifically, if the total number of searches for the keyword and its associated fields within a time period exceeds a preset search number threshold, and the total number of searches for the keyword and its associated fields within multiple consecutive time periods exceeds the preset search number threshold, it can be judged as hotspot data.

[0087] For different data types, the search count threshold for determining hot spots is different, which is related to the user's search habits. Generally speaking, users search for simple return data more frequently, while searching for complex video stream data is relatively less frequent. Therefore, different search count thresholds can be set for different data types.

[0088] The hotspot judgment mechanism runs on the edge server. The present invention sets the operating body of this mechanism as a preset program, which is installed on the edge server in advance. Before installing the program, the size of the cache space on the edge server needs to be configured. If the cache space size needs to be modified later, the configuration needs to be modified and the program needs to be restarted.

[0089] In addition to being related to the data type, the search count threshold for hotspots is also related to the cache space capacity of the edge server. The search count threshold for hotspots can be flexibly determined by the size of the cache space. In other words, the search count threshold for determining the "hotspot" content will change depending on the remaining size of the cache space. When the remaining space is too small, the cleanup program will be started to clear the cache content that has significantly decreased in popularity, ensuring that the edge server is running in a healthy state.

[0090] The search count threshold for determining hotspots is not fixed. As the size of the remaining cache space in the edge server changes, the search count threshold will also change. First, the size of the remaining cache space must be determined. The larger the remaining space, the lower the search count threshold. The smaller the remaining space, the higher the search count threshold. Depending on the size of the remaining cache space, the given search count threshold is different.

[0091] In the present invention, different data types are divided into three types: simple data, large file information and file stream information. Among them, large file information refers to files or data with a size exceeding 20M. Simple data refers to other data except large file information and file stream information.

[0092] For different requests and responses, the hotspot determination criteria are different, such as Figure 3 As shown, the edge server determines whether the request is a hotspot, which can be divided into the following situations:

[0093] For general keyword requests, which have the characteristics of short content, frequent requests, and access address association, such as fixed files loaded in frequently visited web pages, this type of data belongs to simple data. At this time, if the response information of the request is judged to be simple data, and the total number of searches for the keyword and its associated fields within a time period exceeds the preset first search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the first search number threshold, then the request content is judged to be a hotspot;

[0094] For ordinary large file data, such as video stream information, which has the characteristics of a fixed request address, mutually associated request keywords, and the response information being video stream information, if the response information is judged to be large file information, and the request address is fixed, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset second search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the second search number threshold, then the request content is judged to be a hotspot;

[0095] For regular download requests, the requests have temporal regularity, that is, the request time is periodic. For example, for a certain APP, an update package of the APP is released every Monday, and the user will send a request for the update package every Monday. The request address of this type of request is fixed, and the returned data is file stream data. If the response information is judged to be file stream information, the request address is fixed, and the request has temporal regularity, then the request content is judged to be a regular hotspot. Among them, the first search count threshold and the second search count threshold are set with different values. For general keyword requests, the search return data is relatively simple and the search is more frequent, so the corresponding search count threshold is set higher; for large files, the search count threshold is set lower than that of general keyword requests.

[0096] After determining whether the request is a hotspot, the cache content in the edge server is newly created, updated, or cleared according to the determination result.

[0097] like Figure 3 As shown, for general keyword requests, if the request is determined to be hot data, it is determined whether there is a cache in the edge server. If there is no cache, a relevant cache is created in the edge server, such as caching the access address and other information related to the hot data; if a user continues to access, the edge server directly returns the cache information, and at the same time makes a request to the remote cloud server, and updates the cache information in the edge server according to the request result;

[0098] When the total number of searches for a keyword and its associated fields within a time period is lower than a preset first search number threshold, or although the total number of searches for a keyword and its associated fields within a time period exceeds the preset first search number threshold, but the total number of searches for the keyword and associated fields in multiple consecutive time periods does not exceed the first search number threshold, it is determined that the request is no longer a hot spot, and the corresponding entry and other content are cleared from the cache.

[0099] like Figure 3 As shown, for large file requests, taking video requests as an example, if the response information is video stream information, and the request address is fixed, and the request is judged to be hot data, then it is judged whether there is a cache in the edge server. If there is no cache, the edge server directly caches the video and does not update the cache of the video in subsequent requests;

[0100] When the number of requests for the video exceeds the preset value or the cache time exceeds the preset duration, a request is made to the remote cloud server, and the cache is updated after receiving the data returned by the remote cloud server. This method can prevent the source from updating data while the cache data is not synchronized in time, thus ensuring the real-time nature of the information.

[0101] If it is subsequently determined that the requested content is no longer a hot spot, the cache of the video information is cleared.

[0102] like Figure 3 As shown, for regular download requests, if the request content is determined to be a regular hotspot, the update package is cached in the edge server after the first request is updated each time. The edge server returns the update package to the terminal device when receiving subsequent requests, and no cache update is performed in subsequent requests;

[0103] When the next update cycle arrives, the cache is updated. During the update, the old update package cache is cleared and the new update package is cached. Only the latest update package is cached each time, and the historical version needs to be obtained from the remote cloud server.

[0104] When it is determined that the request is no longer a regular hotspot, the corresponding update package cache is cleared.

[0105] Among them, the condition for clearing the cache does not depend on the remaining size of the cache space, but completely depends on the disappearance of the hotspot attribute of the content. That is, in the hotspot judgment mechanism of the present invention, the size of the cache space is flexible, and whether it is a hotspot is rigid. The purpose of this is to always allocate cache space to real hotspots to ensure fast data transmission. When the cache space is sufficient, the hotspot judgment mechanism will adjust the search number threshold for determining hotspots of different data types according to the remaining size of the cache space in the edge server to form a closed loop with the new cache process, and always ensure that the content with a relatively high search number is a hotspot.

[0106] When the edge server has a cache corresponding to the user's query data, it will first return the data in the cache to the user, and at the same time make a request to the remote cloud server, update the existing cache data with the data returned by the remote cloud server, and wait for the next terminal user's query request before sending it again. This is equivalent to the cache data obtained by each user being the result of the previous round of cache updates. This approach can ensure that users can obtain relatively recent data at the fastest speed and ensure that the real-time nature of the data is not affected.

[0107] When the edge server responds to the end user's query, it will not record the end user's IP address. The edge server treats all query requests indiscriminately, so each query request from the end user can get the latest data at the fastest speed. When the edge server does not have the cache corresponding to the user's query data, it immediately requests the remote cloud server. When the edge server receives the data returned by the remote cloud server, the "hotspot judgment mechanism" on the edge server is triggered.

[0108] It is worth noting that for some large file data, the computer network itself has the characteristic of slicing when transmitting large files. The edge server can use this feature to compare the arriving data and cache the data that is repeated too much or fixed. This can effectively reduce the traffic in the network and speed up data transmission.

[0109] In a further implementation, the edge server does not always request information from the remote cloud server. When multiple users search for the same content at the same time, the edge server can perform similar throttling when requesting the remote cloud server, that is, if the same request is sent multiple times within a set time, the edge server will only execute the first time. This can effectively reduce the data traffic in the network and apply network resources to more needed requests.

[0110] The determination of cache content is only related to the current edge server, and the cache content of different edge servers is different.

[0111] In addition, when there is no hotspot in the edge server at the beginning, the edge server randomly selects the request content as the hotspot data according to the request record of the terminal device and creates a cache for it.

[0112] In the power system, you can first install a preset program, which has some built-in initial models (i.e., initializing hot spot judgment conditions for different types of data); then when the user accesses the system, the system will collect the user's access behavior data, and analyze and process these data in combination with big data processing technology. Finally, according to the data source, data type and other information combined with different initial models given by the program, the system will analyze and process them, and finally find the data that needs to be cached for caching, so as to achieve the purpose of improving data transmission speed.

[0113] The application of the method of the present invention in the power system is given below:

[0114] Application Example 1

[0115] When the power system finds that users in a certain area frequently visit a certain website to obtain a video information, it is determined to be a "hotspot" after analysis. Since the returned data is a video stream, the edge server can directly cache the corresponding video stream file without cache update. This can effectively reduce repeated content transmission, reduce the amount of data in the core network, reduce network bandwidth pressure, and also increase the speed at which users obtain resources. If the number of clicks exceeds the set value or the interval exceeds the set duration, a request can be made to the source data to prevent data updates and untimely cache updates. As time goes by, the popularity of the video slowly decreases, the number of clicks decreases, and the system determines that it is no longer a "hotspot". At this time, the previous cached data can be cleared to release cache space so that cached data from other "hotspots" can be stored smoothly.

[0116] Application Example 2

[0117] A power company frequently encountered similar problems. During this period, maintenance personnel searched for solutions to the fault very frequently. When it reached a certain level, the edge server related to it would consider this problem to be a "hotspot" and cache the related content. However, other edge servers did not receive such requests and naturally would not consider this problem to be a "hotspot" content. Then they would not cache these contents and leave the cache space for the content that really needs to be cached locally. The cache content in different edge servers is different. The hotspot judgment mechanism runs on the edge server, and the cache established for the hotspot is also on the edge server. The cached content is the return data obtained after the edge server initiates an application to the remote cloud server.

[0118] Application Example 3

[0119] For example Figure 3For the regular download requests shown in the figure, multiple people in a certain area use the same APP, which has a fixed update time and frequent update frequency. In this case, the "hotspot" judgment mechanism confirms that it is a regular hotspot. The update package can be cached in the edge server after the first person requests each update, so that others can obtain the update package more quickly. When the edge server obtains a new update package with the same source but different content, the old update package cache is cleared and the new one replaces the old one to continue working.

[0120] It can be seen from the above embodiments that the existence of the hotspot judgment mechanism and cache system in the edge server can reduce the network and server load, reduce network traffic, and thus reduce expenses, allowing users to obtain content faster, and the cache cleaning mechanism can also effectively avoid the problem of excessive cache data affecting the performance of the edge server.

[0121] The method of the present invention can improve the efficiency of data transmission, reduce the transmission cost, has a wide range of application prospects, and can be applied to various data transmission scenarios. Therefore, the present invention has high practical value and economic benefits.

[0122] like Figure 4 As shown, the present invention provides a terminal device, including:

[0123] The first retrieval module is used to query whether there is a local cache in response to the received search request; if there is a local cache, first read the data from the local cache and then send the request to the edge server; if there is no local cache, directly send the request to the edge server;

[0124] The first cache update module is used to update the local cache according to the request content returned by the edge server.

[0125] like Figure 5 As shown, the present invention provides an edge server, comprising:

[0126] The second retrieval module is used to respond to the request of the terminal device and determine whether there is cached data locally; if there is cached data, first obtain the data from the local cache and return it to the terminal device, and then request the remote cloud server; if there is no cached data, directly request the remote cloud server;

[0127] The hotspot determination module is used to return the request content returned by the remote cloud server to the terminal device; and at the same time determine whether the request content returned by the remote cloud server is a hotspot;

[0128] The second cache update module is used to process the local cache content according to the judgment result of the hot spot judgment module; wherein the hot spot refers to data whose request times meet preset conditions within a set time, or data whose requests have time regularity.

[0129] Furthermore, the hotspot determination module is used to:

[0130] If the response information is simple data, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset first search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the first search number threshold, then the request content is determined to be a hotspot;

[0131] If the response information is large file information, and the request address is fixed, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset second search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the second search number threshold, then the request content is determined to be a hotspot;

[0132] If the response information is file stream information, the request address is fixed, and the request has temporal regularity, then the request content is determined to be a regular hotspot.

[0133] Furthermore, the second cache update module is used to:

[0134] If the requested content is determined to be a hotspot and no cache exists locally, a relevant cache is created locally;

[0135] If the requested content is determined to be a hotspot and there is a local cache, the local related cache is updated;

[0136] If it is determined that the requested content is not a hotspot and there is a local cache, the local related cache is cleared.

[0137] The present invention also provides an electronic device, comprising one or more processors, a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any of the aforementioned methods.

[0138] The present invention also provides a readable storage medium having one or more programs stored thereon, wherein the one or more programs include instructions, and when the instructions are executed by a computing device, the computing device executes any one of the aforementioned methods.

[0139] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0140] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0141] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0142] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0143] The above are merely embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention are included in the scope of the claims of the present invention to be approved.

Claims

1. A method for rapid transmission of broadband and narrowband data, characterized in that: The method is executed on an edge server and includes: In response to the request of the terminal device, determine whether there is cached data locally; if there is cached data, first obtain the data from the local cache and return it to the terminal device, and then request the remote cloud server; if there is no cached data, directly request the remote cloud server; Return the request content returned by the remote cloud server to the terminal device; at the same time, determine whether the request content returned by the remote cloud server is a hotspot, and process the local cache content according to the determination result; wherein the hotspot refers to data whose number of requests within a set time meets the preset conditions, or data whose requests have time regularity; Determine whether the request content is a hotspot, including: If the response information is simple data, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset first search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the first search number threshold, then the request content is determined to be a hotspot; If the response information is large file information, and the request address is fixed, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset second search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the second search number threshold, then the request content is determined to be a hotspot; If the response information is file stream information, the request address is fixed, and the request has time regularity, then the request content is judged to be a regular hotspot; If the response information is simple data and is judged to be a hotspot, and there is no local cache, a relevant cache is created in the edge server; if a user continues to access, the edge server directly returns the cache information and makes a request to the remote cloud server at the same time, and updates the cache information in the edge server according to the request result; If the response information is large file information, and the request address is fixed, and it is judged to be a hot spot, and there is no local cache, the file information is directly cached, and the cache of the file information is no longer updated in subsequent requests, until the number of requests for the file exceeds the preset value or the cache time exceeds the preset time, and the remote cloud server is requested for data once, and the cache is updated after receiving the data returned by the remote cloud server; if it is subsequently determined that the request content is no longer a hot spot, the cache of the file information is cleared; If the request content is judged to be a regular hotspot, the update package will be cached locally after the first request is updated in each update cycle, and the update package will be returned to the terminal device when a subsequent request from the terminal device is received. The cache will no longer be updated in subsequent requests until the next update cycle arrives, when the cache will be updated, the old update package cache will be cleared, and the new update package will be cached. If it is subsequently judged that the request content is no longer a regular hotspot, the corresponding update package cache will be cleared.

2. The method for rapid broadband and narrowband data transmission according to claim 1, characterized in that: The processing of the local cache content includes creating, updating or deleting; The determining whether the request content returned by the remote cloud server is a hotspot and processing the local cache content according to the determination result includes: If the requested content is determined to be a hotspot and no cache exists locally, a relevant cache is created locally; If the requested content is determined to be a hotspot and there is a local cache, the local related cache is updated; If it is determined that the requested content is not a hotspot and there is a local cache, the local related cache is cleared.

3. The method for rapid broadband and narrowband data transmission according to claim 1, characterized in that: The hotspot search count threshold is determined according to the size of the local remaining cache space, and the hotspot search count threshold is dynamically adjusted as the size of the local remaining cache space changes.

4. The method for rapid broadband and narrowband data transmission according to claim 1, characterized in that: The search times threshold of the hotspot is set differently according to different data types.

5. The method for rapid broadband and narrowband data transmission according to claim 1, characterized in that: Also includes: In response to the same search request sent by multiple terminal devices within a set time, a request is made to the remote cloud server only when the first request is received.

6. The method for rapid broadband and narrowband data transmission according to claim 1, characterized in that: For large file information, according to the characteristic that large files need to be sliced ​​when transmitted, the arriving data is compared and the data that is repeated too much or fixed is cached.

7. The method for rapid broadband and narrowband data transmission according to claim 1, characterized in that: It also includes, when there is no hotspot in the local cache at the beginning, randomly selecting request content as hotspot data according to the request record of the terminal device, and establishing a cache for it.

8. An edge server, characterized in that: include: A second retrieval module is used to respond to the request of the terminal device and determine whether there is cached data locally; If there is cached data, the data is first obtained from the local cache and returned to the terminal device, and then a request is made to the remote cloud server; if there is no cached data, a request is made directly to the remote cloud server; The hotspot determination module is used to return the request content returned by the remote cloud server to the terminal device; and at the same time determine whether the request content returned by the remote cloud server is a hotspot; A second cache update module, used to process the local cache content according to the judgment result of the hot spot judgment module; wherein the hot spot refers to data whose number of requests within a set time meets a preset condition, or data whose requests have a time regularity; The hot spot determination module is used to: If the response information is simple data, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset first search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the first search number threshold, then the request content is determined to be a hotspot; If the response information is large file information, and the request address is fixed, and the total number of searches for the keyword and its associated fields within a time period exceeds a preset second search number threshold, and the total number of searches for the keyword and its associated fields within multiple time periods exceeds the second search number threshold, then the request content is determined to be a hotspot; If the response information is file stream information, the request address is fixed, and the request has time regularity, then the request content is judged to be a regular hotspot; The processing of the local cache content according to the judgment result of the hotspot judgment module includes: If the response information is simple data and is judged to be a hotspot, and there is no local cache, a relevant cache is created in the edge server; if a user continues to access, the edge server directly returns the cache information and makes a request to the remote cloud server at the same time, and updates the cache information in the edge server according to the request result; If the response information is large file information, and the request address is fixed, and it is judged to be a hot spot, and there is no local cache, the file information is directly cached, and the cache of the file information is no longer updated in subsequent requests, until the number of requests for the file exceeds the preset value or the cache time exceeds the preset time, and the remote cloud server is requested for data once, and the cache is updated after receiving the data returned by the remote cloud server; if it is subsequently determined that the request content is no longer a hot spot, the cache of the file information is cleared; If the request content is judged to be a regular hotspot, the update package will be cached locally after the first request is updated in each update cycle, and the update package will be returned to the terminal device when a subsequent request from the terminal device is received. The cache will no longer be updated in subsequent requests until the next update cycle arrives, when the cache will be updated, the old update package cache will be cleared, and the new update package will be cached. If it is subsequently judged that the request content is no longer a regular hotspot, the corresponding update package cache will be cleared.

9. The edge server according to claim 8, characterized in that: The second cache update module is used to: If the requested content is determined to be a hotspot and no cache exists locally, a relevant cache is created locally; If the requested content is determined to be a hotspot and there is a local cache, the local related cache is updated; If it is determined that the requested content is not a hotspot and there is a local cache, the local related cache is cleared.

10. An electronic device, characterized in that: The method comprises one or more processors, a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for executing any one of the methods according to claims 1 to 7.

11. A readable storage medium, characterized in that: One or more programs are stored thereon, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any one of the methods according to claims 1 to 7.

Images