Methods, apparatus, equipment, media and products for obtaining links and network information

Abstract

This disclosure provides a method, apparatus, device, medium, and product for obtaining links and network information. The method includes: detecting the status information of storage space, links on the application end, and network performance between the application end and the storage space; generating a storage space list corresponding to the storage space; obtaining links to be stored on the application end and storing them in the link list; determining the attribute information of the network information corresponding to the links; generating a link storage mapping table based on the link list, status information, network performance, and attribute information; and performing a network information acquisition operation based on the storage space list and the link storage mapping table. Through the embodiments of this disclosure, the convenience, efficiency, and reliability of obtaining links and their corresponding network information are improved.

Description

Technical Field

[0001] This disclosure relates to the field of communication technology, and more specifically, to a method, apparatus, device, medium, and product for acquiring link and network information. Background Technology

[0002] In today's information explosion era, frequently used cloud applications, browsers, instant messaging software, and online shopping apps often include functions such as saving, tagging, and browsing. Information linked to saved items and bookmarks may be deleted or updated. These information processing operations are typically performed manually, relying on human decision-making, which is not only time-consuming and inconvenient, but also prone to data loss or omission if not saved and updated promptly. Furthermore, using fragmented external hardware storage devices to store information, with files scattered across multiple devices, is prone to loss and also poses security risks.

[0003] In related technologies, user terminals often request multiple storage spaces to store network information, such as China Telecom Cloud Drive, Baidu Cloud Drive, Alibaba Cloud Drive, Tencent Cloud Drive, Huawei Cloud Drive, etc., but are not limited to these.

[0004] However, different cloud providers offer different clients, and a client from one vendor cannot access the cloud disks of another vendor. Users who register multiple storage spaces need to install multiple client software to use different cloud disks. Based on the existing solution, it is impossible to achieve unified management of the network information to be obtained and multiple storage spaces.

[0005] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0006] The purpose of this disclosure is to provide a method, apparatus, device, medium, and product for obtaining links and the network information corresponding to the links, for automatically obtaining links and automatically storing and updating the information corresponding to the links, avoiding the loss or absence of the information corresponding to the links, and overcoming the problems caused by the limitations and defects of related technologies, such as the inability to manage crawled network information in a unified manner based on multiple storage spaces.

[0007] According to a first aspect of the present disclosure, a method for obtaining a link and the network information corresponding to the link is provided, including:

[0008] The system detects the status information of the storage space, the connection of the application, and the network performance between the application and the storage space. The application runs on the cloud and / or a local terminal, and the storage space includes cloud space and / or local space.

[0009] Generate a list of storage spaces corresponding to the storage spaces;

[0010] The application retrieves links to be stored and stores them in a link list, and detects and updates the link list according to preset conditions. The links include at least one of the following: application links, settings links, favorite URL links, and stored tag links.

[0011] Determine the attribute information of the network information corresponding to the link;

[0012] Generate a link storage mapping table based on the link list, status information, network performance, and attribute information;

[0013] The network information is retrieved based on the storage space list and linked storage mapping table. The retrieval operations include crawling, transmitting, storing and updating.

[0014] In one exemplary embodiment of this disclosure, before detecting storage space status information, application connection, and network performance between the application and storage space, the method further includes:

[0015] Determine the link to the network information to be retrieved;

[0016] Identify the storage spaces that are associated with the application and create a list of all storage spaces.

[0017] Get access permission information for all storage spaces;

[0018] The available space, total space, and network performance of each storage space in the storage space list are initialized. The status information includes available space, total space, and network performance, but is not limited to these.

[0019] In one exemplary embodiment of this disclosure, detecting storage space status information, application connection, and network performance between the application and storage space includes:

[0020] The links on the application are inspected, and the links are used to obtain the network information corresponding to the links;

[0021] The system detects the parameters of available storage space, total storage space, and network performance based on preset detection conditions.

[0022] The process continues by polling and checking the identifiers of the storage spaces in the storage space list until all storage spaces have been checked.

[0023] After confirming that all storage space has been detected, the parameter values ​​of the detected available space, the parameter values ​​of the total space, and the parameter values ​​of network performance are written into the storage space list. Network performance includes at least one of latency, upload speed, download speed, and packet loss rate, but is not limited to these.

[0024] In one exemplary embodiment of this disclosure, the operation of obtaining network information based on the storage space list and the linked storage mapping table includes:

[0025] Determine the size of the network information corresponding to the links in the linked storage mapping table;

[0026] Sort the links corresponding to the network information according to the amount of data;

[0027] The network information is retrieved according to the sorting results of the links in the linked storage mapping table and the preset strategy.

[0028] In one exemplary embodiment of this disclosure, the operation of obtaining network information based on the storage space list and the linked storage mapping table further includes:

[0029] Determine the timeliness information of the network information corresponding to the links in the link storage mapping table;

[0030] Sort the links corresponding to the network information according to their timeliness;

[0031] The network information is retrieved according to the sorting results of the links in the linked storage mapping table and the preset strategy.

[0032] In one exemplary embodiment of this disclosure, generating a link storage mapping table based on a link list, status information, and attribute information includes:

[0033] Sort all storage space based on available space and / or network performance;

[0034] Based on the sorting results and preset strategies, select storage space with available space greater than the storage space required for network information;

[0035] Determine whether the storage space belongs to the category of the network information;

[0036] Based on the classification results, a directory is generated, and then a link storage mapping table is generated. The link storage mapping table includes the address of the link to the network information to be stored, the identifier of the storage space, and the directory of the storage space.

[0037] In one exemplary embodiment of this disclosure, it further includes:

[0038] Based on the correspondence between links and storage spaces in the link storage mapping table, the crawled network information is transmitted to the corresponding directory of the corresponding storage space for storage.

[0039] After storing the crawled network information, the links corresponding to the stored network information are parsed according to the attribute information of the links in the link storage mapping table to determine whether they are links to be stored or links to be deleted.

[0040] If the link corresponding to the already stored network information is a link to be stored, then the link to be stored is retained, and the network information corresponding to the link to be stored is checked for updates according to the preset strategy.

[0041] If the link corresponding to the stored network information is a link to be deleted, then delete the link to be deleted;

[0042] After processing the links to be stored or deleted, update the link list, storage space list, and link storage mapping table.

[0043] Submit the updated list of links, the updated list of storage spaces, and the updated link-storage mapping table to the autonomous decision-making module.

[0044] In one exemplary embodiment of this disclosure, it further includes:

[0045] The system checks whether the network information corresponding to the link to be stored has been updated according to a preset strategy.

[0046] If an update is detected to the network information corresponding to the link to be stored, then a preset update strategy is used to determine whether to replace the network information before the update with the network information after the update.

[0047] If it is determined that the network information before the update will be replaced with the network information after the update, then the corresponding network information before the update will be deleted and it will be determined whether the storage space size of the link to be stored meets the space size required by the network information after the update.

[0048] If it is determined that the storage space corresponding to the link to be stored is sufficient to meet the space requirements of the updated network information, then the updated network information is saved.

[0049] If it is determined that the storage space size corresponding to the link to be stored is not sufficient to meet the space size required by the updated network information, then a storage space with available space larger than the space required by the updated network information will be selected according to the storage space list and the preset strategy.

[0050] Determine if the reselected storage space contains a directory corresponding to the updated network information;

[0051] If it is determined that the reselected storage space has a directory corresponding to the updated network information, then the updated network information will be stored in that directory.

[0052] If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create the directory corresponding to the updated network information and record it as a new directory;

[0053] Store the updated network information in the newly created directory;

[0054] After storing the updated network information, update the link list, link storage mapping table, and storage space list;

[0055] Submit the updated list of links, the updated list of storage spaces, and the updated link storage mapping table to the autonomous decision-making module;

[0056] The updated link list, storage space list, and link-storage mapping table are fed back to the user interface on the application side, so that users can configure the link list, link-storage mapping table, and storage space list through the user interface.

[0057] In one exemplary embodiment of this disclosure, it further includes:

[0058] The system checks whether the network information corresponding to the link to be stored has been updated according to a preset strategy.

[0059] If an update is detected in the network information corresponding to the link to be stored, then a decision is made based on the preset update strategy to determine whether to save the updated network information.

[0060] If it is determined that the updated network information should be saved, then it is determined whether the storage space size corresponding to the link to be stored is sufficient to meet the space size required for the updated network information.

[0061] If it is determined that the storage space size corresponding to the link to be stored is sufficient to meet the space size required for the updated network information, then the updated network information is saved separately.

[0062] If it is determined that the storage space size corresponding to the link to be stored is not sufficient to meet the space size required by the updated network information, then a storage space with available space greater than the space required by the updated network information is selected again based on the link storage mapping table and the storage space list.

[0063] Determine if the reselected storage space contains a directory corresponding to the updated network information;

[0064] If it is determined that the reselected storage space has a directory corresponding to the updated network information, then the updated network information will be stored in that directory.

[0065] If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create the directory corresponding to the updated network information and record it as a new directory;

[0066] Store the updated network information in the newly created directory;

[0067] After storing the updated network information, update the link list, link storage mapping table, and storage space list;

[0068] Submit the updated list of links, the updated list of storage spaces, and the updated link storage mapping table to the autonomous decision-making module;

[0069] The updated link list, storage space list, and link-storage mapping table are fed back to the user interface on the application side, so that users can configure the link list, storage space list, and link-storage mapping table through the user interface.

[0070] According to a second aspect of the present disclosure, an apparatus for obtaining a link and network information corresponding to the link is provided, comprising:

[0071] The detection unit is configured to detect the status information of the storage space, the connection of the application, and the network performance between the application and the storage space. The application runs on the cloud and / or a local terminal, and the storage space includes cloud space and / or local space.

[0072] The generation unit is configured to generate a list of storage spaces corresponding to the storage spaces.

[0073] The acquisition unit is configured to acquire links to be stored from the application and store them in a link list, and to detect and update the link list according to preset conditions. The links include at least one of the following: application links, set links, favorite URL links, and stored tag links.

[0074] The unit is defined as determining the attribute information of the network information corresponding to the link.

[0075] The generation unit is also configured to generate a link storage mapping table based on the link list, status information, network performance, and attribute information;

[0076] The acquisition unit is also configured to perform acquisition operations on network information based on the storage space list and the linked storage mapping table. The acquisition operations include crawling, transmitting, storing and updating.

[0077] According to a third aspect of this disclosure, an electronic device is provided, comprising: a memory; and a processor coupled to the memory, the processor being configured to perform the method described above based on instructions stored in the memory.

[0078] According to a fourth aspect of this disclosure, a computer-readable storage medium is provided having a program stored thereon that, when executed by a processor, implements a method for obtaining a link and network information corresponding to the link as described in any of the preceding claims.

[0079] According to a fifth aspect of this disclosure, a computer program product is provided, comprising a computer program, characterized in that, when executed by a processor, the computer program implements a method for obtaining a link and network information corresponding to the link as described in any of the preceding claims.

[0080] This embodiment of the disclosure generates a storage space list corresponding to the storage space by detecting the status information of the storage space, the connection of the application terminal, and the network performance between the application terminal and the storage space. It also obtains the links to be stored on the application terminal and stores them in the link list, and detects and updates the link list according to preset conditions. This determines the attribute information of the network information corresponding to the link. Furthermore, it generates a link storage mapping table based on the link list, status information, network performance, and attribute information. Finally, it performs network information acquisition operations based on the storage space list and the link storage mapping table. This allows for unified invocation or simulation of the cloud provider's application terminal, and coordinates the use of multiple different storage spaces to complete the storage, updating, and editing of network information, thereby improving the convenience, efficiency, and reliability of acquiring network information.

[0081] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0082] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0083] Figure 1 A schematic diagram of an exemplary system architecture for obtaining links and the network information corresponding to those links, which can be applied to embodiments of this disclosure, is shown.

[0084] Figure 2 This is a flowchart of a method for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0085] Figure 3 This is a schematic diagram of an architecture for obtaining links and the network information corresponding to those links, as shown in an exemplary embodiment of this disclosure.

[0086] Figure 4 This is a flowchart illustrating a scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0087] Figure 5 This is a flowchart illustrating another scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0088] Figure 6 This is a flowchart illustrating another scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0089] Figure 7 This is a flowchart illustrating another scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0090] Figure 8 This is a flowchart illustrating another scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0091] Figure 9 This is a flowchart illustrating another scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0092] Figure 10 This is a flowchart illustrating another scheme for obtaining a link and the network information corresponding to the link in an exemplary embodiment of this disclosure;

[0093] Figure 11 This is a block diagram of an apparatus for obtaining a link and the network information corresponding to the link, according to an exemplary embodiment of the present disclosure.

[0094] Figure 12 This is a block diagram of an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation

[0095] The exemplary embodiments illustrated with reference to the accompanying drawings will now be described more fully. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will fully convey the concept of the exemplary embodiments to those skilled in the art in a more comprehensive and complete manner. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of these specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0096] Furthermore, the accompanying drawings are merely illustrative of this disclosure, and the same reference numerals in the drawings denote the same or similar parts, thus repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware units or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0097] The technical terms used in the embodiments of this disclosure are explained below:

[0098] Links: In the fields of computer science and information technology, links are mechanisms or means that connect one resource to another through hypertext or hypermedia. The main function of links is to enable users to navigate and access different documents, web pages, data, or programs.

[0099] Web crawling, in the fields of computer science and information technology, especially search engine technology, refers to the process of systematically browsing and fetching websites or web resources using automated programs (usually called crawlers or spiders). The purpose of crawling is to collect web page content or data for further processing, analysis, or storage.

[0100] Cloud computing refers to computing resources and services provided via the internet. Cloud computing means accessing and managing computing resources (such as servers, storage, databases, networks, software, analytics, etc.) through a network (usually the internet) rather than through local computing devices or private data centers.

[0101] Cloud storage: refers to an online storage service based on cloud computing technology, allowing users to upload, download, store, synchronize, and share files via the internet. Cloud storage provides a convenient, reliable, and flexible storage and management method, enabling users to access and manage their data or programs anytime, anywhere.

[0102] Cloud commerce refers to an e-commerce model that utilizes cloud computing technology and internet platforms to conduct business activities. It involves moving traditional business activities to the cloud and providing a cloud-based e-commerce solution.

[0103] Storage space: refers to online storage services based on cloud computing technology, providing users with virtual space for storing, managing, and sharing data. Storage space can be viewed as an online data warehouse, allowing users to access and manage data stored there anytime, anywhere via the internet.

[0104] Network performance refers to the efficiency and quality of data transmission within a computer network. The concept of network performance encompasses multiple aspects, including bandwidth, jitter, latency, throughput, reliability, and packet loss rate. Evaluating and optimizing network performance is crucial for ensuring the efficient operation of applications and services.

[0105] Figure 1 A schematic diagram of an exemplary system architecture is shown, illustrating a scheme for obtaining links and the network information corresponding to those links that can be applied according to embodiments of this disclosure.

[0106] like Figure 1As shown, system architecture 100 may include one or more of terminal devices 101, 102, and 103, a network 104, and a server 105. Network 104 serves as the medium for providing communication links between terminal devices 101, 102, and 103 and server 105. Network 104 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.

[0107] It should be understood that Figure 1 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, there can be any number of terminal devices, networks, and servers. For example, server 105 could be a server cluster composed of multiple servers.

[0108] Users can use terminal devices 101, 102, and 103 to interact with server 105 via network 104 to receive or send messages, etc. Terminal devices 101, 102, and 103 can be various electronic devices with displays, including but not limited to smartphones, tablets, laptops, and desktop computers, etc.

[0109] In some embodiments, the method for obtaining links and the network information corresponding to those links, as provided in this disclosure, is generally executed by terminal device 103. Accordingly, the apparatus for obtaining links and the network information corresponding to those links is generally located in terminal device 103 (or terminal device 101 or 102). In other embodiments, some terminals may have functions similar to those of server devices to execute this method.

[0110] The exemplary embodiments of this disclosure will now be described in detail with reference to the accompanying drawings.

[0111] Figure 2 This is a flowchart of a method for obtaining links and the network information corresponding to the links in an exemplary embodiment of this disclosure.

[0112] refer to Figure 2 Methods for obtaining links and their corresponding network information may include:

[0113] Step S202: Detect the status information of the storage space, the connection of the application, and the network performance between the application and the storage space. The application runs on the cloud and / or a local terminal, and the storage space includes cloud space and / or local space.

[0114] Step S204: Generate a list of storage spaces corresponding to the storage spaces;

[0115] Step S206: Obtain the links to be stored from the application and store them in the link list, and detect and update the link list according to preset conditions. The links include at least one of the following: application links, settings links, favorite URL links, and stored tag links.

[0116] Step S208: Determine the attribute information of the network information corresponding to the link.

[0117] In one exemplary embodiment of this disclosure, the attribute information includes, but is not limited to, the data volume, timeliness, and category of the network information. By determining the attribute information of the network information, the attribute information can serve as a logical basis for acquiring the network information. The attribute information can be automatically maintained in the background or pushed to the user interface for users to customize or personalize the attribute information.

[0118] Step S210: Generate a link storage mapping table based on the link list, status information, network performance, and attribute information.

[0119] Step S212: Obtain network information based on the storage space list and the linked storage mapping table. The obtaining operations include crawling, transmitting, storing and updating.

[0120] This embodiment of the disclosure generates a storage space list corresponding to the storage space by detecting the status information of the storage space, the connection of the application terminal, and the network performance between the application terminal and the storage space. It also obtains the links to be stored on the application terminal and stores them in the link list, and detects and updates the link list according to preset conditions. This determines the attribute information of the network information corresponding to the link. Furthermore, it generates a link storage mapping table based on the link list, status information, network performance, and attribute information. Finally, it performs network information acquisition operations based on the storage space list and the link storage mapping table. This allows for unified invocation or simulation of the cloud provider's application terminal, and coordinates the use of multiple different storage spaces to complete the storage, updating, and editing of network information, thereby improving the convenience, efficiency, and reliability of acquiring network information.

[0121] The following section details the steps involved in obtaining links and the corresponding network information.

[0122] In one exemplary embodiment of this disclosure, before detecting the state information of the storage space, the connection of the application, and the network performance between the application and the storage space, the method further includes:

[0123] Determine the link to the network information to be retrieved;

[0124] Identify the storage spaces that are associated with the application and create a list of all storage spaces.

[0125] Get access permission information for all storage spaces;

[0126] The available space, total space, and network performance of each storage space in the storage space list are initialized. The status information includes, but is not limited to, available space, total space, and network performance.

[0127] In one exemplary embodiment of this disclosure, network performance includes, but is not limited to, latency (ms) and upload / download rates (e.g., Mbps).

[0128] In one exemplary embodiment of this disclosure, network latency detection includes, but is not limited to, ping detection initiated by the terminal to the storage space.

[0129] In one exemplary embodiment of this disclosure, the method for testing the upload / download file rate includes, but is not limited to, uploading / downloading a test file, obtaining test data, or using historical data of the upload / download file as the data for this test, such as using the average rate of the previous three upload / download file records.

[0130] In one exemplary embodiment of this disclosure, detecting the status information of the storage space, the connection of the application, and the network performance between the application and the storage space includes:

[0131] The links on the application are inspected, and the links are used to obtain the network information corresponding to the links;

[0132] The system detects the parameters of available storage space, total storage space, and network performance based on preset detection conditions.

[0133] The process continues by polling and checking the identifiers of the storage spaces in the storage space list until all storage spaces have been checked.

[0134] After confirming that all storage space has been detected, the parameter values ​​of the detected available space, the parameter values ​​of the total space, and the parameter values ​​of network performance are written into the storage space list. Network performance includes at least one of latency, upload speed, download speed, and packet loss rate, but is not limited to these.

[0135] In one exemplary embodiment of this disclosure, the operation of obtaining network information based on the storage space list and the linked storage mapping table includes:

[0136] Determine the size of the network information corresponding to the links in the linked storage mapping table;

[0137] Sort the links corresponding to the network information according to the amount of data;

[0138] The network information is retrieved according to the sorting results of the links in the linked storage mapping table and the preset strategy.

[0139] In one exemplary embodiment of this disclosure, the operation of obtaining network information based on the storage space list and the linked storage mapping table further includes:

[0140] Determine the timeliness information of the network information corresponding to the links in the link storage mapping table;

[0141] Sort the links corresponding to the network information according to their timeliness;

[0142] The network information is retrieved according to the sorting results of the links in the linked storage mapping table and the preset strategy.

[0143] In one exemplary embodiment of this disclosure, the timeliness information includes, but is not limited to, the information age, validity period, reception time, storage time, and transmission time of the network information.

[0144] In the above embodiments, the order or priority of performing acquisition operations is determined by the attribute information and preset strategy of the corresponding network information, so as to further optimize the efficiency and reliability of processing network information. Users can set or edit the attribute information through the user interface, so that the background can determine the above order or priority according to the attribute information and preset strategy set by the user.

[0145] In one exemplary embodiment of this disclosure, generating a link storage mapping table based on a link list, status information, and attribute information includes:

[0146] Sort all storage space based on available space and / or network performance;

[0147] Based on the sorting results and preset strategies, select storage space with available space greater than the storage space required for network information;

[0148] Determine whether the storage space belongs to the category of the network information;

[0149] Based on the classification results, a directory is generated, and then a link storage mapping table is generated. The link storage mapping table includes the address of the link to the network information to be stored, the identifier of the storage space, and the directory of the storage space.

[0150] In the above embodiments, the background determines the directory in the storage space that the network information belongs to based on its classification, and then stores it. This not only facilitates the maintenance of network information, but also helps to delete the stored network information based on the classification, thereby reducing redundant storage data and releasing more available storage space in a timely manner.

[0151] In one exemplary embodiment of this disclosure, the classification includes, but is not limited to, text, images, audio, and data.

[0152] In one exemplary embodiment of this disclosure, the categories include, but are not limited to, work, education, medical care, tourism, finance, and weather.

[0153] In one exemplary embodiment of this disclosure, it further includes:

[0154] Based on the correspondence between links and storage spaces in the link storage mapping table, the crawled network information is transmitted to the directory corresponding to the storage space for storage.

[0155] After storing the crawled network information, the links corresponding to the stored network information are parsed according to the attribute information of the links in the link storage mapping table to determine whether they are links to be stored or links to be deleted.

[0156] If the link corresponding to the already stored network information is a link to be stored, then the link to be stored is retained, and the network information corresponding to the link to be stored is checked for updates according to the preset strategy.

[0157] If the link corresponding to the stored network information is a link to be deleted, then delete the link to be deleted;

[0158] After processing the links to be stored or deleted, update the link list, storage space list, and link storage mapping table.

[0159] Submit the updated list of links, the updated list of storage spaces, and the updated link-storage mapping table to the autonomous decision-making module.

[0160] In one exemplary embodiment of this disclosure, it further includes:

[0161] The system checks whether the network information corresponding to the link to be stored has been updated according to a preset strategy.

[0162] If an update is detected to the network information corresponding to the link to be stored, then a decision is made based on the preset update rules to determine whether to replace the network information before the update with the network information after the update.

[0163] If it is determined that the network information before the update will be replaced with the network information after the update, then the corresponding network information before the update will be deleted and it will be determined whether the storage space size of the link to be stored meets the space size required by the network information after the update.

[0164] If it is determined that the storage space corresponding to the link to be stored is sufficient to meet the space requirements of the updated network information, then the updated network information is saved.

[0165] If it is determined that the storage space size corresponding to the link to be stored is not sufficient to meet the space size required by the updated network information, then a storage space with available space larger than the space required by the updated network information will be selected from the storage space list.

[0166] Determine if the newly selected storage space exists in a directory corresponding to the updated network information category;

[0167] If it is determined that the reselected storage space has a directory corresponding to the updated network information category, then the updated network information will be stored in that directory.

[0168] If it is determined that the reselected storage space does not have a directory corresponding to the updated network information category, then create a directory corresponding to the updated network information category and record it as a new directory;

[0169] Store the updated network information in the newly created directory;

[0170] After storing the updated network information, update the link list, link storage mapping table, and storage space list;

[0171] Submit the updated list of links, the updated list of storage spaces, and the updated link storage mapping table to the autonomous decision-making module;

[0172] The updated link list, storage space list, and link-storage mapping table are fed back to the user interface on the application side, so that users can configure the link list, link-storage mapping table, and storage space list through the user interface.

[0173] In one exemplary embodiment of this disclosure, the preset strategy includes the period and / or events for detecting updates.

[0174] In one exemplary embodiment of this disclosure, it further includes:

[0175] The system checks whether the network information corresponding to the link to be stored has been updated according to a preset strategy.

[0176] If an update to the network information corresponding to the stored link is detected, the updated network information is then saved according to the preset update strategy.

[0177] If it is determined that the updated network information should be saved, then it is determined whether the storage space size corresponding to the link to be stored is sufficient to meet the space size required for the updated network information.

[0178] If it is determined that the storage space size corresponding to the link to be stored is sufficient to meet the space size required for the updated network information, then the updated network information is saved separately.

[0179] If it is determined that the storage space size corresponding to the link to be stored is not sufficient to meet the space size required by the updated network information, then a storage space with available space greater than the space required by the updated network information is selected again based on the link storage mapping table and the storage space list.

[0180] Determine if the newly selected storage space exists in a directory corresponding to the updated network information category;

[0181] If it is determined that the reselected storage space has a directory corresponding to the updated network information category, then the updated network information will be stored in that directory.

[0182] If it is determined that the reselected storage space does not have a directory corresponding to the updated network information category, then create a directory corresponding to the updated network information category and record it as a new directory;

[0183] Store the updated network information in the newly created directory;

[0184] After storing the updated network information, update the link list, link storage mapping table, and storage space list;

[0185] Submit the updated list of links, the updated list of storage spaces, and the updated link storage mapping table to the autonomous decision-making module;

[0186] The updated link list, storage space list, and link-storage mapping table are fed back to the user interface on the application side, so that users can configure the link list, storage space list, and link-storage mapping table through the user interface.

[0187] like Figure 3 As shown, this disclosure proposes an architecture 300 for obtaining links and the network information corresponding to the links. Based on pre-set parameters, the system automatically detects and makes autonomous decisions, dynamically allocates storage space, automatically crawls, transmits, saves and updates information to be stored, automatically deletes redundant information, and automatically optimizes the running status of the application and the running status of the storage space.

[0188] like Figure 3 As shown, the application runs multiple applications, each of which can set a large number of favorites, tags, addresses and other links. The information corresponding to these links may be deleted, modified or supplemented due to changes in circumstances. It is necessary to save and update the information corresponding to the links in a timely manner to avoid information loss or omission.

[0189] like Figure 3 As shown, users can have multiple storage spaces, and users can choose from these storage spaces to use for storage. The storage spaces used for storage constitute the target storage space of the application.

[0190] like Figure 3 As shown, the autonomous decision-making module, detection module, and information processing module run on the application side, respectively completing autonomous decision-making, detection, and information processing operations.

[0191] like Figure 3As shown, the autonomous decision-making module is connected to the user interface. The autonomous decision-making module can receive the operations performed by the user through the user interface and send them to the information processing module and the detection module. The detection module obtains the detection parameters from the autonomous decision-making module, initiates the detection operation by means of periodic detection or event-triggered detection, and feeds back the detection results to the autonomous decision-making module.

[0192] like Figure 3 As shown, the information processing module receives the information processing strategy, the list of links to be stored, the list of storage spaces, and the link storage mapping table from the autonomous decision-making module. Based on the strategy, it completes operations such as information crawling, transmission, storage, and updating. It also updates the link list, the list of storage spaces, and the link storage mapping table according to the requirements of the preset strategy, and feeds back the processed information and updated information to the autonomous decision-making module.

[0193] like Figure 3 As shown, there can be one or more storage spaces for storing information, forming a storage space set. The storage spaces are added by the user and managed by the autonomous decision-making module. The information corresponding to the link is stored in a subset of the storage space set, which is selected by the autonomous decision-making module based on the storage strategy and detection results.

[0194] like Figure 3 The architecture 300 shown above for obtaining links and the network information corresponding to those links is as follows: Figure 4 The core steps shown enable the acquisition of links and their corresponding network information, specifically including:

[0195] Step 402: Initialize the parameters of the application and the storage space.

[0196] Step 404: Determine whether a detection is triggered based on the strategy. If yes, proceed to step S406; otherwise, repeat step S404.

[0197] Step 406: Check network performance and storage space status.

[0198] Step 408: Detect the attributes such as the size of the information corresponding to the link, add the attributes to the link list and generate a link storage mapping table.

[0199] Step 410: Perform information processing operations such as web information crawling, transmission, storage, and deletion according to the strategy.

[0200] Step 412: Perform tracking, detection, and updates according to the strategy.

[0201] like Figure 4 Step 402, as shown, involves initializing the application's parameters as follows: Figure 5 As shown.

[0202] like Figure 5As shown, initializing the application's parameters includes the following steps:

[0203] Step 502: Set the information processing strategy for the application.

[0204] Step 504: Obtain access permissions for the application and the application itself.

[0205] Step 506: Initialize the list of links to be processed, including applications, links, URLs, etc., but not limited to these.

[0206] like Figure 4 Step 402, as shown, involves initializing the parameters of the storage space as follows: Figure 6 As shown.

[0207] like Figure 6 As shown, the steps for initializing the storage space parameters are as follows:

[0208] Step 602: Create a list of storage spaces.

[0209] Step 604: Obtain access permission information for the storage space.

[0210] Step 606: Initialize the available space, total space, network performance, and percentage of available space for each item in the storage space list.

[0211] In one exemplary embodiment of this disclosure, the initially created list of storage spaces can be empty, and the access permission information of the storage spaces includes, but is not limited to, usernames, passwords, etc.

[0212] In one exemplary embodiment of this disclosure, the storage space list maintains a mapping relationship between storage space ID, available space, total space, and network performance, but is not limited thereto.

[0213] In one exemplary embodiment of this disclosure, the storage space ID refers to the identifier of the created storage space, which can be the domain name of the site where the storage space is located; the available space refers to the remaining space of the user in the storage space, and the total space refers to the total space that the user can use in the storage space.

[0214] In one exemplary embodiment of this disclosure, network performance refers to the network performance between the user application and the storage space.

[0215] In one exemplary embodiment of this disclosure, network performance includes, but is not limited to, latency (ms) and upload / download rates (e.g., Mbps).

[0216] In one exemplary embodiment of this disclosure, parameters such as available space, total space, and network performance during the initialization phase can be set to empty.

[0217] like Figure 4Step 404 shows the determination of whether detection is triggered. The determination condition for triggering detection can be reaching the periodic detection time point or event triggering, etc.

[0218] In one exemplary embodiment of this disclosure, the detection cycle is set by the user in the autonomous decision-making module and sent to the detection module. Event triggering is initiated by external events, such as when the user adds a favorite or adds a link, which is automatically triggered.

[0219] like Figure 4 Step 406, as shown, involves detecting the storage space status and network performance as follows: Figure 7 As shown.

[0220] like Figure 7 As shown, the steps for detecting storage space status and network performance are as follows:

[0221] Step 702: Obtain the storage space list and access permission list.

[0222] Step 704: Determine whether all storage spaces have been detected. If yes, return; otherwise, proceed to step 706.

[0223] Step 706: Obtain the available space, total space, and percentage of available space in the storage space.

[0224] Step 708: Detect the network performance between the application and the storage space.

[0225] Step 710: Update the status parameters of the storage space with the detection results and report the storage space ID, available space, total space, network performance, etc., but not limited to these.

[0226] like Figure 7 In step 702 shown, the storage space list is generated by the autonomous decision-making module when initializing the storage space status and is sent to the detection module, and the storage space access permission list is sent to the detection module by the autonomous decision-making module.

[0227] like Figure 7 In step 704, it is determined whether the storage space detection is complete. The detection module polls the storage space list to determine whether the detection of all storage spaces has been completed.

[0228] like Figure 7 In step 706 shown, the storage space to be detected is selected from the storage space list. The detection module simulates a client or calls the cloud merchant client to log in to the storage space and obtains the user's available space, total space and percentage of available space in that storage space.

[0229] like Figure 7In step 708, the network performance between the application and the storage space mainly includes, but is not limited to, the network latency of the application accessing the storage space and the upload / download rate. Network latency detection includes, but is not limited to, pinging the storage space initiated by the terminal; the upload / download rate testing methods include, but are not limited to, uploading / downloading test files, and obtaining test data includes, but is not limited to, using historical upload / download data as the data for this test, such as using the average rate of the previous three upload / download records.

[0230] like Figure 7 In step 710 shown, the status parameters of the storage space include, but are not limited to, storage space ID, available space, total space, and network performance.

[0231] like Figure 7 In step 710 shown, the state parameters of the storage space are updated with the detection results and reported to the autonomous decision-making module.

[0232] like Figure 4 Step 408, as shown, involves detecting attributes such as the size of the information corresponding to the link, adding these attributes to the link list, and generating a link storage mapping table. Figure 8 As shown.

[0233] like Figure 8 As shown, the steps for detecting attributes such as the size of the information corresponding to a link, adding these attributes to the link list, and generating a link storage mapping table are as follows:

[0234] Step 802: Initialize the list of links to be stored on the application side.

[0235] Step 804: Obtain the storage link and access permissions from the application.

[0236] Step 806: Detect the attributes such as the size of the information corresponding to the link, and add the attributes to the link list.

[0237] Step 808: Determine the professional category of the information corresponding to the link to be stored.

[0238] Step 810: Sort storage space by available space or network performance.

[0239] Step 812: Select a storage space with a larger space than the information corresponding to the link to be stored, based on the sorting results and preset strategy.

[0240] Step 814: Determine if the storage space has a corresponding information category. If the storage space has a corresponding category, proceed to step S818, that is, establish a linked storage mapping table. If not, proceed to step S816, create a corresponding directory.

[0241] Step S816: Create a new directory.

[0242] Step S818: Establish a linked storage mapping table and send it to the autonomous decision-making module.

[0243] like Figure 4 Step 410, as shown, involves performing information processing operations such as crawling, transmitting, storing, and deleting information according to the strategy. Figure 9 As shown.

[0244] like Figure 9 As shown, the steps for performing information processing operations such as crawling, transmitting, storing, and deleting information according to the strategy are as follows:

[0245] Step 902: Obtain the list of links to be stored on the application side.

[0246] Step 904: Sort the links to be stored according to the user-defined strategy.

[0247] Step 906: Determine if the link to the information to be stored is 0. If yes, return; otherwise, proceed to step S908.

[0248] Step 908: If it is determined that the number of links to the information to be stored is not 0, then according to the link storage mapping table and the storage space list, crawl, transmit, and save the information corresponding to the links to be stored to the storage space.

[0249] Step 910: According to the strategy, retain the links that need to be updated and detect, delete the links that are no longer needed, and update the link list, the link storage mapping table, and the storage space list.

[0250] Step 912: Send the updated list of links, the link storage mapping table, and the storage space list to the autonomous decision-making module.

[0251] like Figure 4 Step 412, as shown, involves performing tracking, detection, and updates based on the strategy. Figure 10 As shown.

[0252] like Figure 10 As shown, the steps for tracking, detecting, and updating according to the strategy are as follows:

[0253] Step 1002: In accordance with the policy requirements, trigger update detection for links that require update detection.

[0254] Step 1004: Determine whether an update has been detected. If yes, proceed to step S1006; otherwise, proceed to step S1002.

[0255] Step 1006: Determine whether to replace or resave based on the strategy. If it is to replace, proceed to step S1008; if it is to resave, proceed to step S1022.

[0256] Step 1008: If the strategy determines that it is a replacement, delete the original information and determine whether the space meets the space size required for the replacement information. If yes, proceed to step S1010; otherwise, proceed to step S1012.

[0257] Step 1010: Save the new information.

[0258] Step 1012: Select a storage space larger than the new information.

[0259] Step 1014: Determine if there is a corresponding directory. If yes, proceed to step S1016; otherwise, proceed to step S1018.

[0260] Step 1016: Save the new information to the corresponding directory.

[0261] Step 1018: Create the corresponding directory and save the new information to the newly created directory.

[0262] Step 1020: Update the available space and total space of the target storage space, update the linked storage mapping table, and provide it to the decision module.

[0263] Step 1022: If the strategy determines that the data needs to be saved again, then determine whether the original space meets the space size required for the new information. If yes, then proceed to step S1024; otherwise, proceed to step S1026.

[0264] Step 1024: Save the new information.

[0265] Step 1026: Select a storage space larger than the new information.

[0266] Step 1028: Determine if there is a corresponding directory. If yes, proceed to step S1030; otherwise, proceed to step S1032.

[0267] Step 1030: Save the new information to the corresponding directory.

[0268] Step 1032: Create the corresponding directory and save the new information to the newly created directory.

[0269] Step 1034: Update the available space and total space of the target storage space, update the linked storage mapping table, and provide it to the decision module.

[0270] Corresponding to the above method embodiments, this disclosure also provides an apparatus for obtaining links and the network information corresponding to the links, which can be used to execute the above method embodiments.

[0271] Figure 11 This is a block diagram of an apparatus for obtaining links and network information corresponding to links, according to an exemplary embodiment of this disclosure.

[0272] refer to Figure 11 The device 1100 for obtaining links and the network information corresponding to those links may include:

[0273] The detection unit 1102 is configured to detect the status information of the storage space, the connection of the application, and the network performance between the application and the storage space. The application runs on the cloud and / or a local terminal, and the storage space includes cloud space and / or local space.

[0274] The generation unit 1104 is configured to generate a list of storage spaces corresponding to the storage spaces;

[0275] The acquisition unit 1106 is configured to acquire links to be stored from the application and store them in a link list, and to detect and update the link list according to preset conditions. The links include at least one of the following: application links, set links, favorite URL links, and stored tag links.

[0276] Unit 1108 is configured to determine the attribute information of the network information corresponding to the link.

[0277] The generation unit 1104 is further configured to generate a link storage mapping table based on the link list, the status information, the network performance, and the attribute information.

[0278] The acquisition unit 1106 is further configured to perform acquisition operations on network information based on the storage space list and the linked storage mapping table. The acquisition operations include crawling, transmitting, storing and updating.

[0279] In one exemplary embodiment of this disclosure, the apparatus 1100 for obtaining links and the network information corresponding to the links is further configured to:

[0280] Identify the links for the network information to be retrieved and generate a corresponding list of links;

[0281] Identify the storage spaces that are associated with the application and create a list of all storage spaces.

[0282] Get access permission information for all storage spaces;

[0283] The available space, total space, and network performance of each storage space in the storage space list are initialized. The status information includes available space, total space, percentage of available space, and network performance, but is not limited to these.

[0284] In one exemplary embodiment of this disclosure, the detection unit 1102 is further configured as follows:

[0285] The links on the application are inspected, and the links are used to obtain the network information corresponding to the links;

[0286] The system detects the parameters of available storage space, total storage space, and network performance based on preset detection conditions.

[0287] The process continues by polling and checking the identifiers of the storage spaces in the storage space list until all storage spaces have been checked.

[0288] After confirming that all storage space has been detected, the parameter values ​​of the detected available space, the parameter values ​​of the total space, and the parameter values ​​of network performance are written into the storage space list. Network performance includes at least one of latency, upload speed, download speed, and packet loss rate.

[0289] In one exemplary embodiment of this disclosure, the acquisition unit 1106 is further configured as follows:

[0290] Determine the size of the network information corresponding to the links in the linked storage mapping table;

[0291] Sort the links corresponding to the network information according to the amount of data;

[0292] The network information is retrieved according to the sorting results of the links in the linked storage mapping table and the preset strategy.

[0293] In one exemplary embodiment of this disclosure, the acquisition unit 1106 is further configured as follows:

[0294] Determine the timeliness information of the network information corresponding to the links in the link storage mapping table;

[0295] Sort the links corresponding to the network information according to their timeliness;

[0296] The network information is retrieved according to the sorting results of the links in the linked storage mapping table and the preset strategy.

[0297] In one exemplary embodiment of this disclosure, the generation unit 1104 is further configured as follows:

[0298] Sort all storage space based on available space and / or network performance;

[0299] Based on the sorting results and preset strategies, select storage space with available space greater than the storage space required for network information;

[0300] Determine whether the storage space belongs to the category of the network information;

[0301] Based on the classification results, a link storage mapping table is generated. The link storage mapping table includes the address of the link to the network information to be stored, the identifier of the storage space, and the directory of the storage space.

[0302] In one exemplary embodiment of this disclosure, the apparatus 1100 for obtaining links and the network information corresponding to the links is further configured to:

[0303] Based on the correspondence between links and storage spaces in the link storage mapping table, the crawled network information is transmitted to the corresponding directory of the corresponding storage space for storage.

[0304] After storing the crawled network information, the links corresponding to the stored network information are parsed according to the attribute information of the links in the link storage mapping table to determine whether they are links to be stored or links to be deleted.

[0305] If the link corresponding to the already stored network information is a link to be stored, then the link to be stored is retained, and the network information corresponding to the link to be stored is checked for updates according to the preset strategy.

[0306] If the link corresponding to the stored network information is a link to be deleted, then delete the link to be deleted from the link list;

[0307] After processing the links to be stored or deleted, update the link list, storage space list, and link storage mapping table.

[0308] Submit the updated list of links, the updated list of storage spaces, and the updated link-storage mapping table to the autonomous decision-making module.

[0309] In one exemplary embodiment of this disclosure, the apparatus 1100 for obtaining links and the network information corresponding to the links is further configured to:

[0310] The system checks whether the network information corresponding to the link to be stored has been updated according to a preset strategy.

[0311] If an update is detected to the network information corresponding to the link to be stored, then a decision is made based on the preset update rules to determine whether to replace the network information before the update with the network information after the update.

[0312] If it is determined that the network information before the update will be replaced with the network information after the update, then the corresponding network information before the update will be deleted and it will be determined whether the storage space size of the link to be stored meets the space size required by the network information after the update.

[0313] If it is determined that the storage space corresponding to the link to be stored is sufficient to meet the space requirements of the updated network information, then the updated network information is saved.

[0314] If it is determined that the storage space size corresponding to the link to be stored is not sufficient to meet the space size required by the updated network information, then a storage space with available space larger than the space required by the updated network information will be selected from the storage space list.

[0315] Determine if the reselected storage space contains a directory corresponding to the updated network information;

[0316] If it is determined that the reselected storage space has a directory corresponding to the updated network information, then the updated network information will be stored in that directory.

[0317] If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create the directory corresponding to the updated network information and record it as a new directory;

[0318] Store the updated network information in the newly created directory;

[0319] After storing the updated network information, update the link list, link storage mapping table, and storage space list;

[0320] Submit the updated list of links, the updated list of storage spaces, and the updated link-storage mapping table to the autonomous decision-making module;

[0321] The updated link list, storage space list, and link-storage mapping table are fed back to the user interface on the application side, so that users can configure the link list, link-storage mapping table, and storage space list through the user interface.

[0322] In one exemplary embodiment of this disclosure, the apparatus 1100 for obtaining links and the network information corresponding to the links is further configured to:

[0323] The system checks whether the network information corresponding to the link to be stored has been updated according to a preset strategy.

[0324] If an update is detected in the network information corresponding to the link to be stored, then determine whether to save the updated network information according to the preset update rules.

[0325] If it is determined that the updated network information should be saved, then it is determined whether the storage space size corresponding to the link to be stored is sufficient to meet the space size required for the updated network information.

[0326] If it is determined that the storage space size corresponding to the link to be stored is sufficient to meet the space size required for the updated network information, then the updated network information is saved separately.

[0327] If it is determined that the storage space size corresponding to the link to be stored is not sufficient to meet the space size required by the updated network information, then a storage space with available space greater than the space required by the updated network information is selected again based on the link storage mapping table and the storage space list.

[0328] Determine if the reselected storage space contains a directory corresponding to the updated network information;

[0329] If it is determined that the reselected storage space has a directory corresponding to the updated network information, then the updated network information will be stored in that directory.

[0330] If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create the directory corresponding to the updated network information and record it as a new directory;

[0331] Store the updated network information in the newly created directory;

[0332] After storing the updated network information, update the link list, link storage mapping table, and storage space list;

[0333] Submit the updated list of links, the updated list of storage spaces, and the updated link storage mapping table to the autonomous decision-making module;

[0334] The updated link list, storage space list, and link-storage mapping table are fed back to the user interface on the application side, so that users can configure the link list, storage space list, and link-storage mapping table through the user interface.

[0335] Since the functions of the device 1100 have been described in detail in their respective method embodiments, they will not be repeated here.

[0336] It should be noted that although several modules or units for the operation of the device have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0337] In an exemplary embodiment of this disclosure, an electronic device capable of implementing the above-described method is also provided.

[0338] Those skilled in the art will understand that various aspects of this disclosure can be implemented as systems, methods, or program products. Therefore, various aspects of this disclosure can be specifically implemented in the following forms: entirely in hardware, entirely in software (including firmware, microcode, etc.), or in a combination of hardware and software, collectively referred to herein as “circuit,” “module,” or “system.”

[0339] The following reference Figure 12 To describe an electronic device 1200 according to such an embodiment of the present disclosure. Figure 12 The electronic device 1200 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0340] like Figure 12 As shown, the electronic device 1200 is manifested in the form of a general-purpose computing device. The components of the electronic device 1200 may include, but are not limited to: at least one processing unit 1210, at least one storage unit 1220, and a bus 1230 connecting different system components (including storage unit 1220 and processing unit 1210).

[0341] In one exemplary embodiment of this disclosure, the storage unit stores program code that can be executed by the processing unit 1210, causing the processing unit 1210 to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure. For example, the processing unit 1210 can perform the method shown in the embodiments of this disclosure.

[0342] Storage unit 1220 may include readable media in the form of volatile storage units, such as random access memory (RAM) 12201 and / or cache memory 12202, and may further include read-only memory (ROM) 12203.

[0343] Storage unit 1220 may also include a program / utility 12204 having a set (at least one) of program modules 12205, such program modules 12205 including but not limited to: operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.

[0344] Bus 1230 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.

[0345] Electronic device 1200 can also communicate with one or more external devices 1240 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 1200, and / or with any device that enables electronic device 1200 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 1250. Furthermore, electronic device 1200 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 1260. As shown, network adapter 1260 communicates with other modules of electronic device 1200 via bus 1230. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 1200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data storage systems.

[0346] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, terminal device, or network device, etc.) to execute the methods described in the embodiments of this disclosure.

[0347] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the methods described above is stored. In some possible implementations, various aspects of this disclosure may also be implemented as a program product including program code, which, when the program product is run on a terminal device, causes the terminal device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure.

[0348] The program product for implementing the above-described method according to embodiments of the present disclosure can employ a portable compact disc read-only memory (CD-ROM). The CD-ROM is used to store program code and can run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, the readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0349] In one exemplary embodiment of this disclosure, the readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0350] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or conveying a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0351] The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.

[0352] In exemplary embodiments of this disclosure, a computer program product is also provided. This computer program product can be loaded or stored on any combination of one or more readable media. It can be written in any combination of one or more programming languages ​​to perform the operations of this disclosure. The programming languages ​​include object-oriented programming languages—such as Java, C++, etc.—and conventional procedural programming languages—such as the "C" language or similar programming languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0353] Furthermore, the above figures are merely illustrative of exemplary embodiments according to this disclosure and are not intended to be limiting. It is readily understood that the processes shown in the above figures do not indicate or limit the temporal order of these processes. Additionally, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0354] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and concept of this disclosure are indicated by the claims.

Claims

1. A method for obtaining links and the network information corresponding to those links, characterized in that, include: Detect the status information of the storage space, the connection of the application, and the network performance between the application and the storage space; Generate a list of storage spaces corresponding to the aforementioned storage space; Obtain the links to be stored from the application and store them in the link list; Determine the attribute information of the network information corresponding to the link; Generate a link storage mapping table based on the link list, the status information, the network performance, and the attribute information, including: The link storage mapping table is generated based on the link list, status information, and attribute information, including: Sort all storage space based on available space and / or network performance; Based on the sorting results and preset strategies, select storage space with available space greater than the storage space required for network information; Determine whether the storage space belongs to the category of the network information; A directory is generated based on the classification results, and then a link storage mapping table is generated. The link storage mapping table includes the address of the link to the network information to be stored, the identifier of the storage space, and the directory of the storage space. The network information acquisition operation based on the storage space list and the linked storage mapping table includes: Determine the data size or timeliness information of the network information corresponding to the links in the link storage mapping table; Sort the links corresponding to the network information according to the data volume or the timeliness information; The network information is acquired according to the sorting results of the links in the link storage mapping table and a preset strategy.

2. The method for obtaining links and the network information corresponding to the links as described in claim 1, characterized in that, Before detecting the storage space status information, the application's connection, and the network performance between the application and the storage space, the following steps are also included: Determine the link of the network information to be acquired; Identify the storage spaces that are associated with the application and create a storage space list that includes all of the storage spaces. Obtain access permission information for all of the aforementioned storage spaces; The available space, total space, and network performance of each storage space in the storage space list are initialized.

3. The method for obtaining links and corresponding network information as described in claim 1, characterized in that, Detecting the status information of the storage space, the connection of the application, and the network performance between the application and the storage space includes: The links on the application are detected, and the links are used to obtain the network information corresponding to the links; The parameters of available space, total space, and network performance of the storage space are detected according to preset detection conditions. The process continues until all storage spaces in the storage space list have been polled and detected. After confirming that all the storage spaces have been detected, the parameter values ​​of the detected available space, the parameter values ​​of the total space, and the parameter values ​​of the network performance are written into the storage space list.

4. The method for obtaining links and the network information corresponding to the links as described in claim 1, characterized in that, Also includes: According to the correspondence between the links and the storage spaces in the link storage mapping table, the crawled network information is transmitted to the directory corresponding to the storage space for storage. After storing the crawled network information, the links corresponding to the stored network information are parsed according to the attribute information of the links in the link storage mapping table and identified as links to be stored or links to be deleted. If the link corresponding to the stored network information is the link to be stored, then the link to be stored is retained, and the network information corresponding to the link to be stored is checked for updates according to a preset strategy. If the link corresponding to the stored network information is the link to be deleted, then delete the link to be deleted; After processing the links to be stored or the links to be deleted, update the link list, the storage space list, and the link storage mapping table.

5. The method for obtaining links and the network information corresponding to the links as described in claim 1, characterized in that, Also includes: The network information corresponding to the link to be stored is checked for updates according to a preset strategy. If an update is detected in the network information corresponding to the link to be stored, then a decision is made based on a preset update rule as to whether to replace the network information before the update with the network information after the update. If it is determined that the network information before the update will be replaced with the network information after the update, then the corresponding network information before the update will be deleted and it will be determined whether the storage space size corresponding to the link to be stored meets the space size required by the network information after the update. If it is determined that the storage space size corresponding to the link to be stored meets the space size required by the updated network information, then the updated network information is saved. If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, then a storage space with available space larger than the space required by the updated network information is selected again according to the storage space list. Determine whether the directory corresponding to the updated network information exists in the newly selected storage space; If it is determined that the newly selected storage space contains a directory corresponding to the updated network information, then the updated network information is stored in that directory. If it is determined that the newly selected storage space does not contain a directory corresponding to the updated network information, then the directory corresponding to the updated network information is created and recorded as the new directory; Store the updated network information in the newly created directory; After storing the updated network information, update the link list, the link storage mapping table, and the storage space list.

6. The method for obtaining links and the network information corresponding to the links as described in claim 1, characterized in that, Also includes: The network information corresponding to the link to be stored is checked for updates according to a preset strategy. If an update is detected in the network information corresponding to the link to be stored, then it is determined whether to save the updated network information according to the preset update rules. If it is determined that the updated network information should be saved separately, then it is determined whether the storage space size corresponding to the link to be stored meets the space size required by the updated network information. If it is determined that the storage space size corresponding to the link to be stored meets the space size required by the updated network information, then the updated network information is stored separately. If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, then a storage space with available space larger than the space required by the updated network information is selected again according to the link storage mapping table and the storage space list. Determine whether the directory corresponding to the updated network information exists in the newly selected storage space; If it is determined that the newly selected storage space contains a directory corresponding to the updated network information, then the updated network information is stored in that directory. If it is determined that the newly selected storage space does not contain a directory corresponding to the updated network information, then the directory corresponding to the updated network information is created and recorded as the new directory; Store the updated network information in the newly created directory; After storing the updated network information, update the link list, the link storage mapping table, and the storage space list.

7. An apparatus for obtaining links and the network information corresponding to those links, characterized in that, include: The detection unit is configured to detect the status information of the storage space, the connection of the application, and the network performance between the application and the storage space. The generation unit is configured to generate a list of storage spaces corresponding to the storage space; The acquisition unit is configured to acquire the links to be stored from the application and store them in the link list; The determining unit is configured to determine the attribute information of the network information corresponding to the link; The generation unit is further configured to generate a link storage mapping table based on the link list, the status information, the network performance, and the attribute information, including: The link storage mapping table is generated based on the link list, status information, and attribute information, including: Sort all storage space based on available space and / or network performance; Based on the sorting results and preset strategies, select storage space with available space greater than the storage space required for network information; Determine whether the storage space belongs to the category of the network information; A directory is generated based on the classification results, and then a link storage mapping table is generated. The link storage mapping table includes the address of the link to the network information to be stored, the identifier of the storage space, and the directory of the storage space. The acquisition unit is further configured to perform an acquisition operation on the network information based on the storage space list and the link storage mapping table, including: Determine the data size or timeliness information of the network information corresponding to the links in the link storage mapping table; Sort the links corresponding to the network information according to the data volume or the timeliness information; The network information is acquired according to the sorting results of the links in the link storage mapping table and a preset strategy.

8. An electronic device, characterized in that, include: Memory; as well as A processor coupled to the memory, the processor being configured to execute, based on instructions stored in the memory, the method for obtaining links and network information corresponding to the links as described in any one of claims 1-6.

9. A computer-readable storage medium having a program stored thereon, which, when executed by a processor, implements the method for obtaining a link and network information corresponding to the link as described in any one of claims 1-6.

10. A computer program product, comprising a computer program, characterized in that, When executed by a processor, the computer program implements the method for obtaining links and network information corresponding to the links as described in any one of claims 1-6.

Images