Method and device for acquiring link and network information, equipment, medium and product

Abstract

The invention provides a method, a device, equipment, a medium and a product for acquiring link and network information. The method comprises the following steps: detecting state information of a storage space, a link of an application end and network performance between the application end and the storage space; generating a storage space list corresponding to the storage space; obtaining a to-be-stored link of the application end and storing the to-be-stored link to a link list; determining attribute information of network information corresponding to the link; generating a link storage mapping table according to the link list, the state information, the network performance and the attribute information; and obtaining the network information according to the storage space list and the link storage mapping table. According to the embodiment of the invention, the convenience, efficiency and reliability of obtaining the link and the network information corresponding to the link are improved.

Description

Background Art

[0002] At present, in the era of information explosion, cloud applications, browsers, instant messaging software, online shopping software, etc. that users often use contain functions such as collection, identification, and browsing. The information corresponding to the collection, bookmark, and other links may be deleted or updated. These information processing operations are usually carried out manually and by human decision-making, which is not only time-consuming and labor-intensive, but also inconvenient to use. In addition, if scattered external hardware storage devices are used to store information, the information files are scattered in multiple external hardware storage devices, which are easy to lose and also pose a security risk.

[0003] In the related art, user terminals often apply for multiple storage spaces to store network information, such as Tianyi Cloud Disk, Baidu Cloud Disk, Alibaba Cloud Disk, Tencent Cloud Disk, Huawei Cloud Disk, etc., but not limited to these.

[0004] However, different cloud vendors provide different clients, and one vendor's client cannot access another vendor's cloud disk. User terminals that register for multiple storage spaces need to install multiple client software to use different cloud disks. Based on the existing solution, it is impossible to achieve coordinated management of the required network information and multiple storage spaces.

[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0006] The purpose of the present disclosure is to provide a method, device, equipment, medium and product for obtaining links and network information corresponding to the links, which are used to automatically obtain links and automatically store and update the information corresponding to the links, avoid the loss or missing of the information corresponding to the links, and overcome the problems such as the inability to coordinate the management of crawled network information based on multiple storage spaces due to the limitations and defects of related technologies.

[0007] According to a first aspect of an embodiment of the present disclosure, a method for obtaining a link and network information corresponding to the link is provided, comprising: Detecting status information of the storage space, the link of the application end, and the network performance between the application end and the storage space, where the application end runs on the cloud and / or the local terminal, and the storage space includes the cloud space and / or the local space; Generate a storage space list corresponding to the storage space; Obtaining links to be stored on the application side and storing them in a link list, and detecting and updating the link list according to preset conditions, wherein the links include at least one of application links, set links, favorite website links, and stored tag links; Determine attribute information of network information corresponding to the link; Generate a link storage mapping table based on the link list, status information, network performance and attribute information; The network information is acquired according to the storage space list and the link storage mapping table, and the acquisition operation includes crawling, transmitting, storing and updating.

[0008] In an exemplary embodiment of the present disclosure, before detecting the storage space status information, the link of the application end, and the network performance between the application end and the storage space, the method further includes: Determine the link of the network information to be acquired; Determine the storage space associated with the application end, and create a storage space list including all storage spaces; Get access permissions for all storage spaces; The available space, total space and network performance of each storage space in the storage space list are initialized, and the status information includes the available space, total space and network performance, but is not limited thereto.

[0009] In an exemplary embodiment of the present disclosure, detecting storage space status information, a link of an application end, and network performance between the application end and the storage space includes: Detect the link on the application side, which is used to obtain the network information corresponding to the link; Testing parameter values ​​of available space, total space, and network performance of storage space according to preset testing conditions; Perform polling detection according to the identifiers of the storage spaces in the storage space list until the detection of all storage spaces is completed; After determining that the detection of all storage space is completed, the parameter values ​​of the detected available space, the parameter values ​​of the total space and the parameter values ​​of the network performance are written into the storage space list. The network performance includes at least one of latency, upload rate, download rate and packet loss rate, but is not limited to these.

[0010] In an exemplary embodiment of the present disclosure, the operation of acquiring network information according to the storage space list and the link storage mapping table includes: Determine the data volume of the network information corresponding to the link in the link storage mapping table; Sort the links corresponding to the network information according to the amount of data; The network information is acquired according to the sorting result of the links in the link storage mapping table and the preset strategy.

[0011] In an exemplary embodiment of the present disclosure, the operation of acquiring network information according to the storage space list and the link storage mapping table further includes: Determine time validity information of network information corresponding to the link in the link storage mapping table; Sort the links corresponding to the network information according to the timeliness information; The network information is acquired according to the sorting result of the links in the link storage mapping table and the preset strategy.

[0012] In an exemplary embodiment of the present disclosure, generating a link storage mapping table according to the link list, the state information and the attribute information includes: Sort all storage spaces by available space and / or network performance; Selecting a storage space whose available space is larger than the storage space required for the network information according to the sorting result and the preset strategy; Determine whether the storage space has the category to which the network information belongs; A directory is generated according to the determination result of the classification, and then a link storage mapping table is generated. The link storage mapping table includes the address of the link of the network information to be stored, the identification of the storage space and the directory of the storage space.

[0013] In an exemplary embodiment of the present disclosure, it further includes: According to the correspondence between the links and the storage space in the link storage mapping table, the crawled network information is transmitted to the directory corresponding to the corresponding storage space for storage; After the crawled network information is stored, the link corresponding to the stored network information is parsed as a link to be stored or a link to be deleted according to the attribute information of the link in the link storage mapping table; If the link corresponding to the stored network information is a link to be stored, the link to be stored is retained, and the network information corresponding to the link to be stored is detected according to a preset strategy to see whether it is updated; If the link corresponding to the stored network information is a link to be deleted, then the link to be deleted is deleted; After completing the processing of the link to be stored or the link to be deleted, updating the link list, the storage space list and the link storage mapping table; Submit the updated link list, the updated storage space list and the updated link storage mapping table to the autonomous decision module.

[0014] In an exemplary embodiment of the present disclosure, it further includes: Detect whether the network information corresponding to the link to be stored is updated according to the preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, determining whether to replace the network information before the update with the updated network information according to a preset update strategy; If it is determined that the network information before the update is replaced with the updated network information, the corresponding network information before the update is deleted and it is determined whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, the updated network information is saved; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselect a storage space with available space larger than the space required by the updated network information according to the storage space list and the preset policy; Determine whether the reselected storage space has a directory corresponding to the updated network information; If it is determined that the reselected storage space has a directory corresponding to the updated network information, the updated network information is stored in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create a directory corresponding to the updated network information and record it as a newly created directory; Store the updated network information in the newly created directory; After completing the storage of the updated network information, updating the link list, the link storage mapping table and the storage space list; Submitting the updated link list, the updated storage space list, and the updated link storage mapping table to the autonomous decision module; The updated link list, storage space list and link-storage mapping table are fed back to the user interaction interface of the application end, so that the user can set the link list, link-storage mapping table and storage space list through the user interaction interface.

[0015] In an exemplary embodiment of the present disclosure, it further includes: Detect whether the network information corresponding to the link to be stored is updated according to the preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, it is determined whether to save the updated network information separately according to the preset update strategy; If it is determined to store the updated network information separately, then determining whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, then the updated network information is stored separately; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselect a storage space whose available space is larger than the space required by the updated network information according to the link storage mapping table and the storage space list; Determine whether the reselected storage space has a directory corresponding to the updated network information; If it is determined that the reselected storage space has a directory corresponding to the updated network information, the updated network information is stored in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create a directory corresponding to the updated network information and record it as a newly created directory; Store the updated network information in the newly created directory; After completing the storage of the updated network information, updating the link list, the link storage mapping table and the storage space list; Submitting the updated link list, the updated storage space list, and the updated link storage mapping table to the autonomous decision module; The updated link list, storage space list and link-storage mapping table are fed back to the user interaction interface of the application end, so that the user can set the link list, storage space list and link-storage mapping table through the user interaction interface.

[0016] According to a second aspect of an embodiment of the present disclosure, there is provided a device for acquiring a link and network information corresponding to the link, including: a detection unit, configured to detect status information of the storage space, a link of the application end, and a network performance between the application end and the storage space, wherein the application end runs on a cloud and / or a local terminal, and the storage space includes a cloud space and / or a local space; A generating unit, configured to generate a storage space list corresponding to the storage space; an acquisition unit, configured to acquire links to be stored on the application side and store them in a link list, and to detect and update the link list according to preset conditions, wherein the links include at least one of application links, set links, favorite website links, and stored tag links; A determination unit, configured to determine attribute information of network information corresponding to the link; The generating unit is further configured to generate a link storage mapping table according to the link list, the state information, the network performance and the attribute information; The acquisition unit is further configured to perform an acquisition operation on the network information according to the storage space list and the link storage mapping table, and the acquisition operation includes crawling, transmitting, storing and updating.

[0017] According to a third aspect of the present disclosure, there is provided an electronic device, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute any one of the methods described above based on instructions stored in the memory.

[0018] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a program is stored, and when the program is executed by a processor, the method for obtaining a link and network information corresponding to the link as described in any one of the above items is implemented.

[0019] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program, characterized in that when the computer program is executed by a processor, the method for obtaining a link and network information corresponding to the link as described in any one of the above items is implemented.

[0020] The disclosed embodiment generates a storage space list corresponding to the storage space by detecting the status information of the storage space, the link of the application end, and the network performance between the application end and the storage space, obtains the link to be stored on the application end and stores it in the link list, and detects and updates the link list according to preset conditions, thereby determining the attribute information of the network information corresponding to the link. Furthermore, a link storage mapping table is generated according to the link list, status information, network performance and attribute information. Finally, the network information is acquired according to the storage space list and the link storage mapping table. The application end of the cloud business can be uniformly called or simulated, and multiple different storage spaces can be used in a coordinated manner to complete the storage, update and editing of network information, thereby improving the convenience, efficiency and reliability of acquiring network information.

[0021] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0023] Figure 1 A schematic diagram showing an exemplary system architecture of a solution for obtaining links and network information corresponding to the links to which the embodiments of the present disclosure can be applied; Figure 2 is a flow chart of a method for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Figure 3 is a schematic diagram of an architecture for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Figure 4 It is a flowchart of a solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Figure 5It is a flowchart of another solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Figure 6 It is a flowchart of another solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Figure 7 It is a flowchart of another solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Figure 8 It is a flowchart of another solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Fig. 9 It is a flowchart of another solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Fig.10 It is a flowchart of another solution for obtaining a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Fig.11 is a block diagram of a device for acquiring a link and network information corresponding to the link in an exemplary embodiment of the present disclosure; Fig.12 is a block diagram of an electronic device in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0024] The example embodiments shown in the reference drawings are now described more fully. However, the example embodiments can be implemented in various forms and should not be construed as being limited to the examples set forth herein; on the contrary, these embodiments are provided so that the present disclosure will be fully conveyed to those skilled in the art with the concept of a more comprehensive and complete example embodiment. The described features, structures, or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or other methods, components, devices, steps, etc. may be adopted. In other cases, known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0025] In addition, the accompanying drawings are only schematic diagrams of the present disclosure, and the same reference numerals in the drawings represent the same or similar parts, so their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities, which do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware units or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0026] The technical terms involved in the embodiments of the present disclosure are described as follows: Link: In the fields of computer science and information technology, it refers to the mechanism or means of connecting one resource to another through hypertext or hypermedia. The main function of a link is to enable users to navigate and access different documents, web pages, data or programs.

[0027] Crawling: In the fields of computer science and information technology, especially in search engine technology, it refers to the process of systematically browsing and crawling websites or network resources through automated programs (usually called crawlers or spiders). The purpose of crawling is to collect web content or data for further processing, analysis or storage.

[0028] Cloud computing refers to computing resources and services provided through the Internet. Cloud computing refers to accessing computing resources (such as servers, storage, databases, networks, software, analysis, etc.) through a network (usually the Internet) rather than accessing and managing them through local computing devices or private data centers.

[0029] Cloud disk: refers to an online storage service based on cloud computing technology, which allows users to upload, download, store, synchronize and share files through the Internet. Cloud disk can provide a convenient, reliable and flexible storage and management method, allowing users to access and manage their data or programs anytime and anywhere.

[0030] Cloud commerce: refers to an e-commerce model that uses cloud computing technology and the Internet platform to conduct business activities, that is, moving traditional business activities to the cloud, providing an e-commerce solution based on cloud computing.

[0031] Storage space: refers to online storage services based on cloud computing technology, which provide users with a virtual space for storing, managing and sharing data. Storage space can be regarded as an online data warehouse, where users can access and manage the data stored in the storage space anytime and anywhere through the Internet.

[0032] Network performance: refers to the efficiency and quality of computer networks when transmitting data. The concept of network performance covers many aspects, including bandwidth, jitter, latency, throughput, reliability, packet loss rate, etc. Evaluating and optimizing network performance is an important aspect to ensure that applications and services can run efficiently.

[0033] Figure 1 A schematic diagram of an exemplary system architecture for a solution for obtaining links and network information corresponding to the links, to which the embodiments of the present disclosure can be applied, is shown.

[0034] like Figure 1As shown, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0035] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. According to the implementation requirements, there may be any number of terminal devices, networks and servers. For example, the server 105 may be a server cluster composed of multiple servers.

[0036] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Terminal devices 101, 102, 103 can be various electronic devices with display screens, including but not limited to smart phones, tablet computers, portable computers, desktop computers, etc.

[0037] In some embodiments, the method for obtaining a link and network information corresponding to the link provided in the embodiments of the present disclosure is generally performed by the terminal device 103. Accordingly, the device for obtaining a link and network information corresponding to the link is generally provided in the terminal device 103 (or the terminal device 101 or 102). In other embodiments, some terminals may have functions similar to those of a server device to perform the method.

[0038] The exemplary embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

[0039] Figure 2 The present invention is a flowchart of a method for acquiring a link and network information corresponding to the link in an exemplary embodiment of the present invention.

[0040] refer to Figure 2 , the method for obtaining the link and the network information corresponding to the link may include: Step S202, detecting the status information of the storage space, the link of the application end, and the network performance between the application end and the storage space, the application end runs on the cloud and / or the local terminal, and the storage space includes the cloud space and / or the local space.

[0041] Step S204, generating a storage space list corresponding to the storage space; Step S206, obtaining the links to be stored on the application side and storing them in the link list, and detecting and updating the link list according to preset conditions, the links include at least one of application links, setting links, favorite website links and stored tag links.

[0042] Step S208: determining the attribute information of the network information corresponding to the link.

[0043] In an exemplary embodiment of the present disclosure, the attribute information includes the data volume, timeliness information, and category of the network information, but is not limited thereto. By determining the attribute information of the network information, the attribute information can be used as a logical basis for obtaining the network information, and the attribute information can be automatically maintained through the background, or pushed to the user interaction interface for the user to customize and edit or personalize the attribute information.

[0044] Step S210, generating a link storage mapping table according to the link list, state information, network performance and attribute information.

[0045] Step S212, performing an acquisition operation on the network information according to the storage space list and the link storage mapping table, the acquisition operation including crawling, transmitting, storing and updating.

[0046] The disclosed embodiment generates a storage space list corresponding to the storage space by detecting the status information of the storage space, the link of the application end, and the network performance between the application end and the storage space, obtains the link to be stored on the application end and stores it in the link list, and detects and updates the link list according to preset conditions, thereby determining the attribute information of the network information corresponding to the link. Furthermore, a link storage mapping table is generated according to the link list, status information, network performance and attribute information. Finally, the network information is acquired according to the storage space list and the link storage mapping table. The application end of the cloud business can be uniformly called or simulated, and multiple different storage spaces can be used in a coordinated manner to complete the storage, update and editing of network information, thereby improving the convenience, efficiency and reliability of acquiring network information.

[0047] The following describes in detail the steps of the method for obtaining the link and the network information corresponding to the link.

[0048] In an exemplary embodiment of the present disclosure, before detecting the state information of the storage space, the link of the application end, and the network performance between the application end and the storage space, the method further includes: Determine the link of the network information to be acquired; Determine the storage space associated with the application end, and create a storage space list including all storage spaces; Get access permissions for all storage spaces; The available space, total space and network performance of each storage space in the storage space list are initialized, and the status information includes the available space, total space and network performance, but is not limited thereto.

[0049] In an exemplary embodiment of the present disclosure, network performance includes but is not limited to latency (ms) and upload / download rate (eg, Mbps).

[0050] In an exemplary embodiment of the present disclosure, the detection of network delay includes but is not limited to a terminal initiating a ping detection on a storage space.

[0051] In an exemplary embodiment of the present disclosure, the method for testing the rate of uploading / downloading files includes but is not limited to uploading / downloading test files, obtaining test data, or using historical data of the uploaded / downloaded files as data for this test, such as using the average rate of the last three upload / download file records.

[0052] In an exemplary embodiment of the present disclosure, detecting the state information of the storage space, the link of the application end, and the network performance between the application end and the storage space includes: Detect the link on the application side, which is used to obtain the network information corresponding to the link; Testing parameter values ​​of available space, total space, and network performance of storage space according to preset testing conditions; Perform polling detection according to the identifiers of the storage spaces in the storage space list until the detection of all storage spaces is completed; After determining that the detection of all storage space is completed, the parameter values ​​of the detected available space, the parameter values ​​of the total space and the parameter values ​​of the network performance are written into the storage space list. The network performance includes at least one of latency, upload rate, download rate and packet loss rate, but is not limited to these.

[0053] In an exemplary embodiment of the present disclosure, the operation of acquiring network information according to the storage space list and the link storage mapping table includes: Determine the data volume of the network information corresponding to the link in the link storage mapping table; Sort the links corresponding to the network information according to the amount of data; The network information is acquired according to the sorting result of the links in the link storage mapping table and the preset strategy.

[0054] In an exemplary embodiment of the present disclosure, the operation of acquiring network information according to the storage space list and the link storage mapping table further includes: Determine time validity information of network information corresponding to the link in the link storage mapping table; Sort the links corresponding to the network information according to the timeliness information; The network information is acquired according to the sorting result of the links in the link storage mapping table and the preset strategy.

[0055] In an exemplary embodiment of the present disclosure, the timeliness information includes the information age, validity period, receiving time, storage time, sending time, etc. of the network information, but is not limited thereto.

[0056] In the above embodiment, the order or priority of executing the acquisition operation is determined by linking the attribute information of the corresponding network information and the preset strategy to further optimize the efficiency and reliability of processing network information. The user can set or edit the attribute information through the user interaction interface so that the background determines the above order or the above priority based on the attribute information and preset strategy set by the user.

[0057] In an exemplary embodiment of the present disclosure, generating a link storage mapping table according to the link list, the state information and the attribute information includes: Sort all storage spaces by available space and / or network performance; Selecting a storage space whose available space is larger than the storage space required for the network information according to the sorting result and the preset strategy; Determine whether the storage space has the category to which the network information belongs; A directory is generated according to the determination result of the classification, and then a link storage mapping table is generated. The link storage mapping table includes the address of the link of the network information to be stored, the identification of the storage space and the directory of the storage space.

[0058] In the above embodiment, the background determines the directory in the storage space that the network information should correspond to based on the category to which it belongs, and then stores it. This not only facilitates the maintenance of the network information, but also helps to delete the stored network information based on the category, thereby reducing redundant storage data and releasing more available storage space in a timely manner.

[0059] In an exemplary embodiment of the present disclosure, the categories include text, image, audio, data, etc., but are not limited thereto.

[0060] In an exemplary embodiment of the present disclosure, the categories include work, education, medical treatment, travel, finance, weather, etc., but are not limited thereto.

[0061] In an exemplary embodiment of the present disclosure, it further includes: According to the correspondence between the links and the storage space in the link storage mapping table, the crawled network information is transmitted to the directory corresponding to the corresponding storage space for storage; After the crawled network information is stored, the link corresponding to the stored network information is parsed as a link to be stored or a link to be deleted according to the attribute information of the link in the link storage mapping table; If the link corresponding to the stored network information is a link to be stored, the link to be stored is retained, and the network information corresponding to the link to be stored is detected according to a preset strategy to see whether it is updated; If the link corresponding to the stored network information is a link to be deleted, then the link to be deleted is deleted; After completing the processing of the link to be stored or the link to be deleted, updating the link list, the storage space list and the link storage mapping table; Submit the updated link list, the updated storage space list and the updated link storage mapping table to the autonomous decision module.

[0062] In an exemplary embodiment of the present disclosure, it further includes: Detect whether the network information corresponding to the link to be stored is updated according to the preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, determining whether to replace the network information before the update with the updated network information according to a preset update rule; If it is determined that the network information before the update is replaced with the updated network information, the corresponding network information before the update is deleted and it is determined whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, the updated network information is saved; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselect a storage space with available space larger than the space required by the updated network information according to the storage space list; Determine whether the reselected storage space has a directory corresponding to the updated network information classification; If it is determined that the reselected storage space has a directory corresponding to the updated network information classification, the updated network information is stored in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information classification, then create a directory corresponding to the updated network information classification and record it as a newly created directory; Store the updated network information in the newly created directory; After completing the storage of the updated network information, updating the link list, the link storage mapping table and the storage space list; Submitting the updated link list, the updated storage space list, and the updated link storage mapping table to the autonomous decision module; The updated link list, storage space list and link-storage mapping table are fed back to the user interaction interface of the application end, so that the user can set the link list, link-storage mapping table and storage space list through the user interaction interface.

[0063] In an exemplary embodiment of the present disclosure, the preset strategy includes a detection update cycle and / or event.

[0064] In an exemplary embodiment of the present disclosure, it further includes: Detect whether the network information corresponding to the link to be stored is updated according to the preset strategy; If it is detected that the network information corresponding to the storage link is updated, it is determined whether to save the updated network information separately according to the preset update strategy; If it is determined to store the updated network information separately, then determining whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, then the updated network information is stored separately; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselect a storage space whose available space is larger than the space required by the updated network information according to the link storage mapping table and the storage space list; Determine whether the reselected storage space has a directory corresponding to the updated network information classification; If it is determined that the reselected storage space has a directory corresponding to the updated network information classification, the updated network information is stored in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information classification, then create a directory corresponding to the updated network information classification and record it as a newly created directory; Store the updated network information in the newly created directory; After completing the storage of the updated network information, updating the link list, the link storage mapping table and the storage space list; Submitting the updated link list, the updated storage space list, and the updated link storage mapping table to the autonomous decision module; The updated link list, storage space list and link-storage mapping table are fed back to the user interaction interface of the application end, so that the user can set the link list, storage space list and link-storage mapping table through the user interaction interface.

[0065] like Figure 3 As shown, the present disclosure proposes an architecture 300 for obtaining links and network information corresponding to the links. Based on pre-set parameters, the system automatically detects and makes autonomous decisions, dynamically specifies storage space, automatically crawls, transmits, saves and updates information to be stored, automatically deletes redundant information, and automatically optimizes the operating status of the application end and the operating status of the storage space.

[0066] like Figure 3As shown, multiple application software are running on the application side, and each application software can set a large number of collections, tags, addresses and other links. The information corresponding to these links may be deleted, modified or supplemented due to changes in circumstances. It is necessary to save and update the information corresponding to the links in time to avoid information loss or missing.

[0067] like Figure 3 As shown, the user can have multiple storage spaces, and the user can select a storage space for storage from the storage space, and the storage space for storage constitutes the target storage space of the application end.

[0068] like Figure 3 As shown, the autonomous decision-making module, the detection module, and the information processing module run on the application side, and respectively complete operations such as autonomous decision-making, detection, and information processing.

[0069] like Figure 3 As shown, the autonomous decision-making module is connected to the user interaction interface. The autonomous decision-making module can receive operations performed by the user through the user interaction interface and send them to the information processing module and the detection module. The detection module obtains detection parameters from the autonomous decision-making module, initiates detection operations using periodic detection or event-triggered detection, and feeds back the detection results to the autonomous decision-making module.

[0070] like Figure 3 As shown, the information processing module receives the information processing strategy, the list of links to be stored, the storage space list, and the link storage mapping table from the autonomous decision-making module, completes information crawling, transmission, storage, update and other operations according to the strategy, updates the link list, storage space list, and link storage mapping table according to the requirements of the preset strategy, and feeds back the processing information and update information to the autonomous decision-making module.

[0071] like Figure 3 As shown, the storage space used to store information can be one or more, forming a storage space set. The storage space is added by the user and managed by the autonomous decision-making module. The information corresponding to the link is stored in a subset of the storage space set, which is selected by the autonomous decision-making module based on the storage strategy and detection results.

[0072] like Figure 3 The architecture 300 for obtaining links and network information corresponding to the links is as follows: Figure 4 The core steps shown in the figure are to obtain the link and the network information corresponding to the link, including: Step 402, initializing application side parameters and storage space parameters.

[0073] Step 404, determine whether to trigger detection according to the strategy, if so, execute step S406, if not, execute step S404 in a loop.

[0074] Step 406, detecting network performance and storage space status.

[0075] Step 408, detecting attributes such as information size corresponding to the link, adding the attributes to the link list and generating a link storage mapping table.

[0076] Step 410, perform information processing operations such as network information crawling, transmission, storage, and deletion according to the strategy.

[0077] Step 412: perform tracking detection and update according to the strategy.

[0078] like Figure 4 Step 402, the step of initializing the parameters of the application side is as follows Figure 5 shown.

[0079] like Figure 5 As shown, initializing application-side parameters includes the following steps: Step 502: Set the information processing strategy of the application side.

[0080] Step 504, obtaining access permissions for the application terminal and the application.

[0081] Step 506, initializing a list of links to be processed, including applications, links, websites, etc., but not limited thereto.

[0082] like Figure 4 Step 402, the step of initializing the parameters of the storage space is as follows Figure 6 shown.

[0083] like Figure 6 As shown, the steps to initialize the parameters of the storage space are as follows: Step 602: Create a storage space list.

[0084] Step 604: Obtain access permission information for the storage space.

[0085] Step 606, initialize the available space, total space, network performance and available space ratio of each item in the storage space list.

[0086] In an exemplary embodiment of the present disclosure, the initially created storage space list may be empty, and the access permission information of the storage space includes a user name, a password, etc., but is not limited thereto.

[0087] In an exemplary embodiment of the present disclosure, the storage space list maintains a mapping relationship between storage space ID, available space, total space, and network performance, but is not limited thereto.

[0088] In an exemplary embodiment of the present disclosure, the storage space ID refers to the created storage space identifier, and the site domain name where the storage space is located can be used; the available space refers to the remaining space of the user in the storage space, and the total space refers to the total space that the user can use in the storage space.

[0089] In an exemplary embodiment of the present disclosure, network performance refers to the network performance between the user application end and the storage space.

[0090] In an exemplary embodiment of the present disclosure, network performance includes but is not limited to latency (ms) and upload / download rate (eg, Mbps).

[0091] In an exemplary embodiment of the present disclosure, parameters such as available space, total space, network performance, etc. in the initialization phase can be set to empty.

[0092] like Figure 4 In step 404, it is determined whether to trigger detection. The determination condition for triggering detection may be reaching a periodic detection time point, or event triggering, etc.

[0093] In an exemplary embodiment of the present disclosure, the detection cycle is set by the user in the autonomous decision-making module and sent to the detection module. The event trigger is initiated by an external event, such as automatically triggered when the user adds a favorite or adds a link.

[0094] like Figure 4 Step 406, the step of detecting storage space status and network performance is as follows Figure 7 shown.

[0095] like Figure 7 As shown, the steps to detect storage space status and network performance are as follows: Step 702, obtaining a storage space list and an access permission list.

[0096] Step 704, determine whether all storage spaces have been detected, if yes, return, if not, go to step 706.

[0097] Step 706, obtaining the available space, total space and available space ratio of the storage space.

[0098] Step 708, detecting the network performance between the application end and the storage space.

[0099] Step 710, using the detection result to update the state parameters of the storage space and report the storage space ID, available space, total space, network performance, etc., but not limited to this.

[0100] like Figure 7In step 702 shown, a storage space list is generated by initializing the storage space state by the autonomous decision-making module and sent to the detection module, and a storage space access permission list is sent to the detection module by the autonomous decision-making module.

[0101] like Figure 7 In step 704, it is determined whether the detection of the storage space is completed. The detection module independently determines whether the detection of all storage spaces has been completed by polling the storage space list.

[0102] like Figure 7 In step 706 shown, the storage space to be detected is selected from the storage space list, and the detection module simulates the client or calls the cloud business client to log in to the storage space to obtain the user's available space, total space and available space ratio in the storage space.

[0103] like Figure 7 In step 708, the network performance between the application end and the storage space mainly includes but is not limited to the network delay of the application end accessing the storage space and the rate of uploading / downloading files. The detection of network delay includes but is not limited to the terminal initiating a ping test on the storage space; the test method of the upload / download file rate includes but is not limited to uploading / downloading test files, and obtaining test data includes but is not limited to using the historical data of the upload / download file as the data of this test, such as using the average rate of the last three upload / download file records.

[0104] like Figure 7 In step 710 shown, the status parameters of the storage space include but are not limited to storage space ID, available space, total space, and network performance.

[0105] like Figure 7 In step 710 shown, the state parameters of the storage space are updated with the detection results and reported to the autonomous decision-making module.

[0106] like Figure 4 Step 408, detecting the information size and other attributes corresponding to the link, adding the attributes to the link list and generating the link storage mapping table is as follows: Figure 8 shown.

[0107] like Figure 8 As shown, the steps of detecting the information size and other attributes corresponding to the link, adding the attributes to the link list and generating the link storage mapping table are as follows: Step 802, initializing the application-side link list to be stored.

[0108] Step 804, obtaining the link to be stored and access rights on the application side.

[0109] Step 806, detect the information size and other attributes corresponding to the link, and add the attributes to the link list. Step 808, determining the professional classification of the information corresponding to the link to be stored.

[0110] Step 810, sort the storage space by available space size or network performance.

[0111] Step 812: Select a storage space that is larger than the information corresponding to the link to be stored according to the sorting result and the preset strategy.

[0112] Step 814, determine whether the storage space has a corresponding information classification. If the storage space has a corresponding classification, execute step S818, that is, establish a link storage mapping table. If not, execute step S816 to create a corresponding directory.

[0113] Step S816, create a new directory.

[0114] Step S818, establish a link storage mapping table and send it to the autonomous decision-making module.

[0115] like Figure 4 Step 410, as shown, is to perform information crawling, transmission, storage, deletion and other information processing operations according to the strategy. Fig. 9 shown.

[0116] like Fig. 9 As shown, the steps for performing information processing operations such as information crawling, transmission, storage, and deletion according to the strategy are as follows: Step 902, obtaining a list of links to be stored on the application side.

[0117] Step 904: sort the links to be stored according to the policy set by the user.

[0118] Step 906, determine whether the link of the information to be stored is 0? If yes, return, if not, execute step S908.

[0119] Step 908, if it is determined that the link of the information to be stored is not 0, then according to the link storage mapping relationship table and the storage space list, crawl, transmit, and save the information corresponding to the link to be stored to the storage space.

[0120] Step 910: retain the links that need to be updated and tested according to the policy, delete the links that are no longer needed, and update the link list, link storage mapping relationship table, and storage space list.

[0121] Step 912: Send the updated link list, link storage mapping table, and storage space list to the autonomous decision module.

[0122] like Figure 4 Step 412 is shown, and the steps of tracking, detecting and updating according to the strategy are performed as follows. Fig.10 shown.

[0123] like Fig.10 As shown, the steps for tracking, detecting and updating according to the strategy are as follows: Step 1002: trigger update detection for the link that needs update detection according to policy requirements.

[0124] Step 1004, determine whether an update is detected, if so, execute step S1006, if not, execute step S1002.

[0125] Step 1006, determine whether to replace or re-save according to the policy. If it is to replace, execute step S1008, if it is to re-save, execute step S1022.

[0126] Step 1008, if it is determined to be a replacement according to the policy, the original information is deleted and it is determined whether the space meets the space size required for the replacement information. If so, step S1010 is executed, if not, step S1012 is executed.

[0127] Step 1010, save the new information.

[0128] Step 1012, select a storage space that is larger than the storage space for the new information.

[0129] Step 1014, determine whether there is a corresponding directory, if so, execute step S1016, if not, execute step S1018.

[0130] Step 1016, save the new information to the corresponding directory.

[0131] Step 1018, create a corresponding directory and save the new information to the newly created directory.

[0132] Step 1020, update the available space and total space of the target storage space, update the link storage mapping relationship table, and provide it to the decision module.

[0133] Step 1022, if it is determined according to the policy that it is to be saved again, then determine whether the original space meets the space size required by the new information, if so, execute step S1024, if not, execute step S1026.

[0134] Step 1024, save the new information.

[0135] Step 1026, select a storage space that is larger than the storage space for the new information.

[0136] Step 1028, determine whether there is a corresponding directory, if so, execute step S1030, if not, execute step S1032.

[0137] Step 1030, save the new information to the corresponding directory.

[0138] Step 1032, create a corresponding directory and save the new information to the newly created directory.

[0139] Step 1034, update the available space and total space of the target storage space, update the link storage mapping relationship table, and provide it to the decision module.

[0140] Corresponding to the above method embodiment, the present disclosure also provides a device for obtaining a link and network information corresponding to the link, which can be used to execute the above method embodiment.

[0141] Fig.11 The invention is a block diagram of an apparatus for acquiring a link and network information corresponding to the link in an exemplary embodiment of the present invention.

[0142] refer to Fig.11 , the device 1100 for obtaining the link and the network information corresponding to the link may include: A detection unit 1102 is configured to detect status information of the storage space, a link of the application end, and a network performance between the application end and the storage space, where the application end runs on the cloud and / or a local terminal, and the storage space includes the cloud space and / or the local space; A generating unit 1104 is configured to generate a storage space list corresponding to the storage space; The acquisition unit 1106 is configured to acquire the links to be stored on the application side and store them in the link list, and detect and update the link list according to preset conditions, wherein the links include at least one of the links of the application, the links of settings, the links of favorite websites, and the links of stored tags; A determining unit 1108, configured to determine attribute information of network information corresponding to the link; The generating unit 1104 is further configured to generate a link storage mapping table according to the link list, the state information, the network performance and the attribute information; The acquisition unit 1106 is further configured to perform an acquisition operation on the network information according to the storage space list and the link storage mapping table, and the acquisition operation includes crawling, transmitting, storing and updating.

[0143] In an exemplary embodiment of the present disclosure, the apparatus 1100 for acquiring a link and network information corresponding to the link is further configured to: Determine the link of the network information to be acquired and generate a corresponding link list; Determine the storage space associated with the application end, and create a storage space list including all storage spaces; Get access permissions for all storage spaces; The available space, total space and network performance of each storage space in the storage space list are initialized, and the status information includes available space, total space, available space ratio and network performance, but is not limited thereto.

[0144] In an exemplary embodiment of the present disclosure, the detection unit 1102 is further configured to: Detect the link on the application side, which is used to obtain the network information corresponding to the link; Testing parameter values ​​of available space, total space, and network performance of storage space according to preset testing conditions; Perform polling detection according to the identifiers of the storage spaces in the storage space list until the detection of all storage spaces is completed; After determining that all storage spaces have been detected, the parameter values ​​of the detected available space, the parameter values ​​of the total space, and the parameter values ​​of the network performance are written into the storage space list, and the network performance includes at least one of latency, upload rate, download rate, and packet loss rate.

[0145] In an exemplary embodiment of the present disclosure, the acquiring unit 1106 is further configured to: Determine the data volume of the network information corresponding to the link in the link storage mapping table; Sort the links corresponding to the network information according to the amount of data; The network information is acquired according to the sorting result of the links in the link storage mapping table and the preset strategy.

[0146] In an exemplary embodiment of the present disclosure, the acquiring unit 1106 is further configured to: Determine time validity information of network information corresponding to the link in the link storage mapping table; Sort the links corresponding to the network information according to the timeliness information; The network information is acquired according to the sorting result of the links in the link storage mapping table and the preset strategy.

[0147] In an exemplary embodiment of the present disclosure, the generating unit 1104 is further configured to: Sort all storage spaces by available space and / or network performance; Selecting a storage space whose available space is larger than the storage space required for the network information according to the sorting result and the preset strategy; Determine whether the storage space has the category to which the network information belongs; A link storage mapping table is generated according to the classification determination result, and the link storage mapping table includes the address of the link of the network information to be stored, the identifier of the storage space and the directory of the storage space.

[0148] In an exemplary embodiment of the present disclosure, the apparatus 1100 for acquiring a link and network information corresponding to the link is further configured to: According to the correspondence between the links and the storage space in the link storage mapping table, the crawled network information is transmitted to the directory corresponding to the corresponding storage space for storage; After the crawled network information is stored, the link corresponding to the stored network information is parsed as a link to be stored or a link to be deleted according to the attribute information of the link in the link storage mapping table; If the link corresponding to the stored network information is a link to be stored, the link to be stored is retained, and the network information corresponding to the link to be stored is detected according to a preset strategy to see whether it is updated; If the link corresponding to the stored network information is a link to be deleted, deleting the link to be deleted from the link list; After completing the processing of the link to be stored or the link to be deleted, updating the link list, the storage space list and the link storage mapping table; Submit the updated link list, the updated storage space list and the updated link storage mapping table to the autonomous decision module.

[0149] In an exemplary embodiment of the present disclosure, the apparatus 1100 for acquiring a link and network information corresponding to the link is further configured to: Detect whether the network information corresponding to the link to be stored is updated according to the preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, determining whether to replace the network information before the update with the updated network information according to a preset update rule; If it is determined that the network information before the update is replaced with the updated network information, the corresponding network information before the update is deleted and it is determined whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, the updated network information is saved; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselect a storage space with available space larger than the space required by the updated network information according to the storage space list; Determine whether the reselected storage space has a directory corresponding to the updated network information; If it is determined that the reselected storage space has a directory corresponding to the updated network information, the updated network information is stored in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create a directory corresponding to the updated network information and record it as a newly created directory; Store the updated network information in the newly created directory; After completing the storage of the updated network information, updating the link list, the link storage mapping table and the storage space list; Submitting the updated link list, the updated storage space list, and the updated link storage mapping table to the autonomous decision module; The updated link list, storage space list and link-storage mapping table are fed back to the user interaction interface of the application end, so that the user can set the link list, link-storage mapping table and storage space list through the user interaction interface.

[0150] In an exemplary embodiment of the present disclosure, the apparatus 1100 for acquiring a link and network information corresponding to the link is further configured to: Detect whether the network information corresponding to the link to be stored is updated according to the preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, it is determined whether to save the updated network information separately according to the preset update rules; If it is determined to store the updated network information separately, then determining whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, then the updated network information is stored separately; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselect a storage space whose available space is larger than the space required by the updated network information according to the link storage mapping table and the storage space list; Determine whether the reselected storage space has a directory corresponding to the updated network information; If it is determined that the reselected storage space has a directory corresponding to the updated network information, the updated network information is stored in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then create a directory corresponding to the updated network information and record it as a newly created directory; Store the updated network information in the newly created directory; After completing the storage of the updated network information, updating the link list, the link storage mapping table and the storage space list; Submitting the updated link list, the updated storage space list, and the updated link storage mapping table to the autonomous decision module; The updated link list, storage space list and link-storage mapping table are fed back to the user interaction interface of the application end, so that the user can set the link list, storage space list and link-storage mapping table through the user interaction interface.

[0151] Since the functions of the device 1100 have been described in detail in the corresponding method embodiments, the present disclosure will not elaborate on them here.

[0152] It should be noted that, although several modules or units of the equipment for operation execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0153] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0154] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".

[0155] Refer to the following Fig.12 1200 according to this embodiment of the present disclosure is described. Fig.12 The electronic device 1200 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0156] like Fig.12 As shown, the electronic device 1200 is in the form of a general computing device. The components of the electronic device 1200 may include but are not limited to: at least one processing unit 1210, at least one storage unit 1220, and a bus 1230 connecting different system components (including the storage unit 1220 and the processing unit 1210).

[0157] In an exemplary embodiment of the present disclosure, the storage unit stores program codes, and the program codes can be executed by the processing unit 1210, so that the processing unit 1210 performs the steps according to various exemplary embodiments of the present disclosure described in the above “Exemplary Method” section of this specification. For example, the processing unit 1210 can perform the method shown in the embodiment of the present disclosure.

[0158] The storage unit 1220 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 12201 and / or a cache storage unit 12202 , and may further include a read-only storage unit (ROM) 12203 .

[0159] The storage unit 1220 may also include a program / utility 12204 having a set (at least one) of program modules 12205, such program modules 12205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0160] Bus 1230 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0161] The electronic device 1200 may also communicate with one or more external devices 1240 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), may also communicate with one or more devices that enable a user to interact with the electronic device 1200, and / or communicate with any device that enables the electronic device 1200 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 1250. In addition, the electronic device 1200 may also communicate with one or more networks (e.g., local area networks (LANs), wide area networks (WANs), and / or public networks, such as the Internet) through a network adapter 1260. As shown, the network adapter 1260 communicates with other modules of the electronic device 1200 through a bus 1230. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 1200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data storage systems, etc.

[0162] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method described in the implementation of the present disclosure.

[0163] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary implementations of the present disclosure described in the above "Exemplary Method" section of the present specification.

[0164] The program product for implementing the above method according to the embodiment of the present disclosure may adopt a portable compact disk read-only memory (CD-ROM), which is used to store program code and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device.

[0165] In an exemplary embodiment of the present disclosure, the readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0166] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, wherein readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0167] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0168] In an exemplary embodiment of the present disclosure, a computer program product is also provided, which can be loaded or stored in any combination of one or more readable media, and can be written in any combination of one or more programming languages ​​to perform the program code of the present disclosure, wherein the programming language includes an object-oriented programming language, such as Java, C++, etc., and also includes a conventional procedural programming language, such as "C" language or similar programming language. The program code can be executed completely on the user computing device, partially on the user device, as an independent software package, partially on the user computing device and partially on the remote computing device, or completely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0169] In addition, the above-mentioned figures are only schematic illustrations according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be executed synchronously or asynchronously, for example, in multiple modules.

[0170] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and concept of the present disclosure are indicated by the claims.

Claims

1. A method for obtaining a link and network information corresponding to the link, characterized in that: include: Detecting status information of the storage space, the link of the application end, and the network performance between the application end and the storage space; generating a storage space list corresponding to the storage space; Obtaining the link to be stored on the application side and storing it in a link list; Determine attribute information of the network information corresponding to the link; Generate a link storage mapping table according to the link list, the state information, the network performance and the attribute information; The network information is acquired according to the storage space list and the link storage mapping table.

2. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: Before detecting the state information of the storage space, the link of the application end, and the network performance between the application end and the storage space, the method further includes: Determine a link of network information to be obtained; Determine the storage space associated with the application end, and create a storage space list including all the storage spaces; Obtaining access permission information for all storage spaces; The available space, total space and network performance of each storage space in the storage space list are initialized.

3. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: Detecting the status information of the storage space, the link of the application end, and the network performance between the application end and the storage space includes: Detecting a link of the application end, the link being used to obtain network information corresponding to the link; Testing the parameter value of the available space, the parameter value of the total space and the parameter value of the network performance of the storage space according to the preset testing conditions; Performing polling detection according to the identifiers of the storage spaces in the storage space list until the detection of all the storage spaces is completed; After it is determined that the detection of all the storage spaces is completed, the detected parameter values ​​of the available space, the parameter values ​​of the total space, and the parameter values ​​of the network performance are written into the storage space list.

4. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: The operation of acquiring the network information according to the storage space list and the link storage mapping table includes: Determine the data volume of the network information corresponding to the link in the link storage mapping table; Sorting the links corresponding to the network information according to the amount of data; The acquisition operation is performed on the network information according to the sorting result of the links in the link storage mapping table and a preset strategy.

5. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: The operation of acquiring the network information according to the storage space list and the link storage mapping table further includes: Determine timeliness information of network information corresponding to the link in the link storage mapping table; sorting the links corresponding to the network information according to the timeliness information; The acquisition operation is performed on the network information according to the sorting result of the links in the link storage mapping table and a preset strategy.

6. The method for obtaining a link and network information corresponding to the link according to claim 2, characterized in that: Generating a link storage mapping table according to the link list, the state information and the attribute comprises: sorting all the storage spaces according to the available space and / or the network performance; Selecting a storage space whose available space is larger than the storage space required for the network information according to the sorting result; Determining whether the storage space has the category to which the network information belongs; The link storage mapping table is generated according to the determination result of the classification.

7. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: Also includes: According to the correspondence between the link and the storage space in the link storage mapping table, the crawled network information is transmitted to the directory corresponding to the corresponding storage space for storage; After the crawled network information is stored, the link corresponding to the stored network information is parsed as a link to be stored or a link to be deleted according to the attribute information of the link in the link storage mapping table; If the link corresponding to the stored network information is the link to be stored, retain the link to be stored, and detect whether the network information corresponding to the link to be stored is updated according to a preset strategy; If the link corresponding to the stored network information is the link to be deleted, deleting the link to be deleted; After completing the processing of the link to be stored or the link to be deleted, the link list, the storage space list and the link storage mapping table are updated.

8. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: Also includes: Detecting whether the network information corresponding to the link to be stored is updated according to a preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, determining whether to replace the network information before the update with the updated network information according to a preset update rule; If it is determined that the network information before the update is replaced with the updated network information, the corresponding network information before the update is deleted and it is determined whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, then the updated network information is stored; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselecting a storage space with available space larger than the space required by the updated network information according to the storage space list; Determine whether the reselected storage space contains a directory corresponding to the updated network information; If it is determined that the reselected storage space has a directory corresponding to the updated network information, storing the updated network information in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then creating a directory corresponding to the updated network information and recording it as a newly created directory; Storing the updated network information in the newly created directory; After completing the storage of the updated network information, the link list, the link storage mapping table and the storage space list are updated.

9. The method for obtaining a link and network information corresponding to the link according to claim 1, characterized in that: Also includes: Detecting whether the network information corresponding to the link to be stored is updated according to a preset strategy; If it is detected that the network information corresponding to the link to be stored is updated, determining whether to save the updated network information separately according to a preset update rule; If it is determined to store the updated network information separately, determining whether the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information; If it is determined that the storage space size corresponding to the link to be stored satisfies the space size required by the updated network information, then the updated network information is stored separately; If it is determined that the storage space size corresponding to the link to be stored does not meet the space size required by the updated network information, reselecting a storage space whose available space is larger than the space required by the updated network information according to the link storage mapping table and the storage space list; Determine whether the reselected storage space contains a directory corresponding to the updated network information; If it is determined that the reselected storage space has a directory corresponding to the updated network information, storing the updated network information in the directory; If it is determined that the reselected storage space does not have a directory corresponding to the updated network information, then creating a directory corresponding to the updated network information and recording it as a newly created directory; Storing the updated network information in the newly created directory; After completing the storage of the updated network information, the link list, the link storage mapping table and the storage space list are updated.

10. A device for obtaining a link and network information corresponding to the link, characterized in that: include: A detection unit, configured to detect status information of the storage space, a link of the application end, and a network performance between the application end and the storage space; A generating unit, configured to generate a storage space list corresponding to the storage space; An acquisition unit, configured to acquire the link to be stored on the application end and store it in a link list; A determination unit, configured to determine attribute information of the network information corresponding to the link; The generating unit is further configured to generate a link storage mapping table according to the link list, the state information, the network performance and the attribute information; The acquisition unit is further configured to perform an acquisition operation on the network information according to the storage space list and the link storage mapping table.

11. An electronic device, characterized in that: include: Memory; as well as A processor coupled to the memory, the processor being configured to execute the method for obtaining a link and network information corresponding to the link according to any one of claims 1 to 9 based on instructions stored in the memory.

12. A computer-readable storage medium having a program stored thereon, wherein when the program is executed by a processor, the method for obtaining a link and network information corresponding to the link as claimed in any one of claims 1 to 9 is implemented.

13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the method for obtaining a link and network information corresponding to the link as described in any one of claims 1 to 9 is implemented.

Images