Computer network data acquisition and analysis method and system

By collecting and analyzing network data and pushing related websites, the problem of poor resource circulation of websites with weak popularity is solved, and the convenience of obtaining network resources is improved.

CN119004076AInactive Publication Date: 2024-11-22高晓蓉
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411165287.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-23
Publication Date
2024-11-22
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The poor circulation of websites and their network resources is caused by weak visibility, which makes people lack the convenience of obtaining network resources.

Method used

By collecting network data from multiple computer devices, analyzing website content characteristics, determining website relevance, and pushing access websites associated with the target access website based on the access time, improving the circulation of network resources.

Benefits of technology

It increases the circulation of websites with weaker popularity and their network resources, and improves the convenience of people to obtain network resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119004076A_ABST
    Figure CN119004076A_ABST
Patent Text Reader

Abstract

The invention provides a computer network data collection and analysis method and system, and the method comprises the steps: collecting the network access data of a plurality of computer devices, and obtaining the network data of each computer device; the network data comprises a plurality of access websites and website content characteristics of each computer device; according to the website content features, website relevance of all the visited websites is analyzed; determining a plurality of target access websites having an access relationship with a target computer according to the access duration of the target computer to each access website; and according to the website relevance, pushing an access website associated with the target access website to a target computer. According to the method and the device, the circulation of accessing websites and network resources thereof can be increased by collecting and analyzing the network data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of network data collection and analysis, and in particular to a computer network data collection and analysis method and system. Background Art

[0002] With the development of network communication technology, people can obtain the information data they need through the network. Specifically, people can obtain the required picture materials, program codes, video music, documents and other resources on the network. However, the picture materials, program codes, video music, documents and other information data are usually stored on different websites. Therefore, people need to visit the website to obtain the required information data. However, although some websites are easy to use and have many resources, they may be less well-known and unknown to people. Therefore, only a few people will obtain resources from these less well-known websites, which limits the circulation of the website and its network resources, and also limits the way people obtain resources from less well-known websites, resulting in poor convenience for people to obtain network resources. Summary of the invention

[0003] The purpose of this application is to provide a computer network data collection and analysis method and system, which can overcome the shortcomings and deficiencies in the prior art.

[0004] A first aspect of an embodiment of the present application provides a computer network data collection and analysis method, comprising:

[0005] Collecting data of network access by multiple computer devices to obtain network data of each computer device; the network data includes multiple visited websites and website content features of each computer device;

[0006] Analyzing the website relevance of each visited website based on the website content characteristics;

[0007] Determining a number of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites;

[0008] According to the website association, a visited website associated with the target visited website is pushed to the target computer.

[0009] Furthermore, the step of analyzing the website relevance of each visited website according to the website content characteristics includes:

[0010] According to the website content characteristics, each of the visited websites is classified to obtain a plurality of website classification tables; wherein the classification table characteristics of the website classification table correspond to at least one website content characteristic, and one visited website is classified into at least one website classification table;

[0011] According to the correspondence between the website content characteristics of each visited website and the characteristics of the classification table in the website classification table, sorting each visited website in the website classification table to obtain a website sorting result corresponding to the website classification table;

[0012] According to the website ranking results of each of the website classification tables, the website relevance of each visited website is obtained.

[0013] Further, the step of classifying each of the visited websites according to the website content characteristics to obtain a plurality of website classification tables includes:

[0014] Performing semantic analysis on the website content features to obtain corresponding content feature semantics;

[0015] A corresponding website classification table is generated according to the content feature semantics, and the visited websites including website content features corresponding to the content feature semantics are stored in the website classification table.

[0016] Furthermore, after the step of storing the visited websites containing the website content features corresponding to the content feature semantics in the website classification table, the step further includes:

[0017] According to the number of website content features corresponding to the content feature semantics in the website classification table, a website content feature with the largest number is determined as the classification table feature.

[0018] Further, the step of sorting the visited websites in the website classification table according to the correspondence between the website content features of the visited websites and the features of the classification table to obtain the website sorting result corresponding to the website classification table includes:

[0019] According to the number of website content features of each of the visited websites in the website classification table that are the same as the features in the classification table, and a preset first weight value, a first ranking value is obtained;

[0020] According to the website classification table, the number of features of the website content of each of the visited websites that are different from the features of the classification table but have the same semantics, and a preset second weight value, a second ranking value is obtained;

[0021] The total ranking value of each visited website is obtained according to the first ranking value and the second ranking value, and the visited websites are sorted from large to small according to the total ranking value to obtain a website ranking result.

[0022] Furthermore, the step of obtaining the website relevance of each visited website according to the website ranking results of each website classification table includes:

[0023] The website classification tables in which two visited websites exist in common are determined as common classification tables, and at least one common classification table is obtained;

[0024] According to the website ranking result of the common classification table, a ranking difference conversion value of the two visited websites is obtained; wherein the smaller the ranking difference, the greater the ranking difference conversion value;

[0025] The ranking position difference conversion values ​​of each of the common classification tables are added together to obtain a correlation value between the two visited websites. If the correlation value is greater than a preset correlation threshold, it is determined that there is a website correlation between the two visited websites.

[0026] Furthermore, the step of obtaining the ranking difference conversion value of the two visited websites according to the website ranking result of the common classification table includes:

[0027] According to the website ranking result of the common classification table, the ranking difference between the two visited websites is obtained;

[0028] The reciprocal of the ranking difference is determined as the ranking difference conversion value.

[0029] Furthermore, the step of determining a plurality of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites includes:

[0030] If the access duration is greater than a preset duration threshold, the corresponding access website is determined to be the target access website.

[0031] A second aspect of an embodiment of the present application provides a computer network data collection and analysis system, including:

[0032] A network data acquisition module is used to collect data of multiple computer devices accessing the network and obtain network data of each computer device; the network data includes multiple visited websites and website content features of each computer device;

[0033] A website relevance analysis module, used to analyze the website relevance of each visited website according to the website content characteristics;

[0034] A target visited website acquisition module, used to determine a number of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites;

[0035] The push module is used to push the visited website associated with the target visited website to the target computer according to the website association.

[0036] Furthermore, the website relevance analysis module includes:

[0037] A website classification module is used to classify each of the visited websites according to the website content characteristics to obtain multiple website classification tables; wherein the classification table characteristics of the website classification table correspond to at least one website content characteristic, and one visited website is classified in at least one website classification table;

[0038] A website sorting module, used to sort each of the visited websites in the website classification table according to the correspondence between the website content characteristics of each of the visited websites and the characteristics of the classification table in the website classification table, and obtain a website sorting result corresponding to the website classification table;

[0039] The website relevance acquisition module is used to obtain the website relevance of each visited website according to the website sorting results of each website classification table.

[0040] The present application can collect data of multiple computer devices accessing the network, thereby obtaining multiple visited websites and website content features of each computer device, and then analyze the website relevance of each visited website based on the website content features, determine a number of target visited websites that have an access relationship with the target computer based on the access duration, and then push the visited websites associated with the target visited websites to the target computer. The visited websites associated with the target visited websites frequently visited by the target computer can be pushed to the target computer, achieving the technical effect of pushing visited websites by collecting and analyzing network data, which can increase the circulation of visited websites and their network resources that have relevance, and is conducive to improving the convenience of people obtaining network resources.

[0041] In order to provide a clearer understanding of the present application, the specific implementation of the present application will be described below in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 The present invention is a flowchart of a computer network data collection and analysis method according to an embodiment of the present invention.

[0043] Figure 2 This is a schematic diagram of module connections of a computer network data acquisition and analysis system according to one embodiment of the present application.

[0044] 1. Network data acquisition module; 2. Website relevance analysis module; 3. Target visit website acquisition module; 4. Push module. DETAILED DESCRIPTION

[0045] In order to make the objectives, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

[0046] It should be clear that the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.

[0047] When the following description relates to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are only used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to the specific circumstances. The singular forms of "a", "said" and "the" used in the present application and the appended claims are also intended to include the majority form, unless the context clearly indicates other meanings. The words "if" / "if" used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0048] In addition, in the description of this application, unless otherwise specified, "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0049] See also Figure 1 , which is a flow chart of the computer network data collection and analysis method of the first embodiment of the present application, including:

[0050] S1: Collect data of network access by multiple computer devices to obtain network data of each computer device; the network data includes multiple visited websites and website content features of each computer device.

[0051] The multiple computer devices may be computer devices of the same enterprise or the same department.

[0052] S2: Analyze the website relevance of each visited website according to the website content characteristics.

[0053] The website relevance refers to the relevance between two visited websites, which can be understood as a pairwise correlation, including the existence of website relevance and the non-existence of website relevance. Specifically, the website relevance between two visited websites can be determined by a preset relevance threshold.

[0054] S3: Determine a number of target visited websites that have a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites.

[0055] The target computer may be one of the multiple computer devices in step S1. The access duration refers to the duration of the target computer accessing the access website within a preset time period, which can be obtained based on the access frequency and the duration of each access.

[0056] S4: According to the website association, the visited website associated with the target visited website is pushed to the target computer.

[0057] In a feasible embodiment, the step S2: analyzing the website relevance of each visited website according to the website content characteristics includes:

[0058] S21: Classifying each of the visited websites according to the website content features to obtain a plurality of website classification tables; wherein a classification table feature of a website classification table corresponds to at least one website content feature, and a visited website is classified in at least one website classification table.

[0059] S22: Sort the visited websites in the website classification table according to the correspondence between the website content features of the visited websites and the features of the classification table, and obtain a website sorting result corresponding to the website classification table.

[0060] S23: Obtaining the website relevance of each visited website according to the website ranking results of each website classification table.

[0061] In a feasible embodiment, S21: the step of classifying each of the visited websites according to the website content characteristics to obtain a plurality of website classification tables comprises:

[0062] S211: Perform semantic analysis on the website content features to obtain corresponding content feature semantics.

[0063] S212: Generate a corresponding website classification table according to the content feature semantics, and store the visited websites containing website content features corresponding to the content feature semantics in the website classification table.

[0064] In a feasible embodiment, after the step of storing the visited websites including the website content features corresponding to the content feature semantics in the website classification table in S212, the method further includes:

[0065] S213: According to the number of website content features corresponding to the content feature semantics in the website classification table, a website content feature with the largest number is determined as the classification table feature.

[0066] In a feasible embodiment, the step S22: sorting the visited websites in the website classification table according to the correspondence between the website content features of the visited websites and the features of the classification table to obtain the website sorting result corresponding to the website classification table includes:

[0067] S221: Obtain a first ranking value according to the number of features of the website content of each visited website in the website classification table that are the same as the features in the classification table, and a preset first weight value.

[0068] S222: Obtain a second ranking value according to the number of features in the website classification table that are different from the features in the classification table but have the same semantics, and a preset second weight value, of the website content features of each of the visited websites.

[0069] S223: Obtaining a total ranking value of each visited website according to the first ranking value and the second ranking value, and sorting the visited websites from large to small according to the total ranking value to obtain a website ranking result.

[0070] In a feasible embodiment, the step S23: obtaining the website relevance of each visited website according to the website ranking results of each website classification table includes:

[0071] S231: Determine the website classification tables in which two visited websites exist together as common classification tables, and obtain at least one common classification table.

[0072] S232: Obtaining a ranking difference conversion value of the two visited websites according to the website ranking result of the common classification table; wherein, the smaller the ranking difference, the greater the ranking difference conversion value.

[0073] S233: Adding the ranking difference conversion values ​​of each of the common classification tables to obtain a correlation value between the two visited websites. If the correlation value is greater than a preset correlation threshold, it is determined that there is a website correlation between the two visited websites.

[0074] In a feasible embodiment, the step S232: obtaining the ranking difference conversion value of the two visited websites according to the website ranking result of the common classification table includes:

[0075] S2321: Obtain the ranking difference between the two visited websites according to the website ranking result of the common classification table.

[0076] S2322: Determine the reciprocal of the sorting difference as the sorting difference conversion value.

[0077] In a feasible embodiment, the step S3: determining a number of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites, comprises:

[0078] If the access duration is greater than a preset duration threshold, the corresponding access website is determined to be the target access website.

[0079] In this embodiment, the present application can collect data of multiple computer devices accessing the network, thereby obtaining multiple visited websites and website content features of each computer device, and then analyze the website relevance of each visited website based on the website content features, determine a number of target visited websites that have an access relationship with the target computer based on the access duration, and then push the visited websites associated with the target visited websites to the target computer. The visited websites associated with the target visited websites frequently visited by the target computer can be pushed to the target computer, achieving the technical effect of pushing visited websites by collecting and analyzing network data, which can increase the circulation of visited websites and their network resources that have relevance, and is conducive to improving the convenience of people obtaining network resources.

[0080] See also Figure 2 The second embodiment of the present application provides a computer network data collection and analysis system, including:

[0081] The network data acquisition module 1 is used to collect data of multiple computer devices accessing the network and obtain network data of each computer device; the network data includes multiple visited websites and website content features of each computer device;

[0082] A website relevance analysis module 2, used to analyze the website relevance of each visited website according to the website content characteristics;

[0083] The target visited website acquisition module 3 is used to determine a number of target visited websites that have a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites;

[0084] The push module 4 is used to push the visited website associated with the target visited website to the target computer according to the website association.

[0085] In a feasible embodiment, the website relevance analysis module 2 includes:

[0086] A website classification module is used to classify each of the visited websites according to the website content characteristics to obtain multiple website classification tables; wherein the classification table characteristics of the website classification table correspond to at least one website content characteristic, and one visited website is classified in at least one website classification table;

[0087] A website sorting module, used to sort each of the visited websites in the website classification table according to the correspondence between the website content characteristics of each of the visited websites and the characteristics of the classification table in the website classification table, and obtain a website sorting result corresponding to the website classification table;

[0088] The website relevance acquisition module is used to obtain the website relevance of each visited website according to the website sorting results of each website classification table.

[0089] It should be noted that the computer network data acquisition and analysis system provided in the second embodiment of the present application only uses the division of the above-mentioned functional modules as an example when executing the computer network data acquisition and analysis method. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the computer network data acquisition and analysis system provided in the second embodiment of the present application and the computer network data acquisition and analysis method of the first embodiment of the present application belong to the same concept. The implementation process is detailed in the method embodiment and will not be repeated here.

[0090] The device embodiments described above are merely illustrative, wherein the components described as separate parts may or may not be physically separated, and the parts displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present application. Ordinary technicians in this field can understand and implement it without creative work.

[0091] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0092] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function selected in the process. Figure 1 A process or multiple processes and / or boxes Figure 1 function selected in a box or multiple boxes.

[0093] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 steps for the function selected in a box or multiple boxes.

[0094] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0095] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0096] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0097] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0098] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A computer network data collection and analysis method, characterized in that: include: Collecting data of network access by multiple computer devices to obtain network data of each computer device; the network data includes multiple visited websites and website content features of each computer device; Analyzing the website relevance of each visited website based on the website content characteristics; Determining a number of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites; According to the website association, a visited website associated with the target visited website is pushed to the target computer.

2. The computer network data collection and analysis method according to claim 1, characterized in that: The step of analyzing the website relevance of each visited website according to the website content characteristics comprises: According to the website content characteristics, each of the visited websites is classified to obtain a plurality of website classification tables; wherein the classification table characteristics of the website classification table correspond to at least one website content characteristic, and one visited website is classified into at least one website classification table; According to the correspondence between the website content characteristics of each visited website and the characteristics of the classification table in the website classification table, sorting each visited website in the website classification table to obtain a website sorting result corresponding to the website classification table; According to the website ranking results of each of the website classification tables, the website relevance of each visited website is obtained.

3. The computer network data collection and analysis method according to claim 2, characterized in that: The step of classifying each of the visited websites according to the website content features to obtain a plurality of website classification tables comprises: Performing semantic analysis on the website content features to obtain corresponding content feature semantics; A corresponding website classification table is generated according to the content feature semantics, and the visited websites including website content features corresponding to the content feature semantics are stored in the website classification table.

4. The computer network data collection and analysis method according to claim 3 is characterized in that: After the step of storing the visited websites containing the website content features corresponding to the content feature semantics in the website classification table, the method further includes: According to the number of website content features corresponding to the content feature semantics in the website classification table, a website content feature with the largest number is determined as the classification table feature.

5. The computer network data collection and analysis method according to claim 2, characterized in that: The step of sorting the visited websites in the website classification table according to the correspondence between the website content features of the visited websites and the features of the classification table to obtain the website sorting result corresponding to the website classification table includes: According to the number of website content features of each of the visited websites in the website classification table that are the same as the features in the classification table, and a preset first weight value, a first ranking value is obtained; According to the website classification table, the number of features of the website content of each of the visited websites that are different from the features of the classification table but have the same semantics, and a preset second weight value, a second ranking value is obtained; The total ranking value of each visited website is obtained according to the first ranking value and the second ranking value, and the visited websites are sorted from large to small according to the total ranking value to obtain a website ranking result.

6. The computer network data collection and analysis method according to claim 2, characterized in that: The step of obtaining the website relevance of each visited website according to the website sorting results of each website classification table comprises: The website classification tables in which two visited websites exist in common are determined as common classification tables, and at least one common classification table is obtained; According to the website ranking result of the common classification table, a ranking difference conversion value of the two visited websites is obtained; wherein the smaller the ranking difference, the greater the ranking difference conversion value; The ranking position difference conversion values ​​of each of the common classification tables are added together to obtain a correlation value between the two visited websites. If the correlation value is greater than a preset correlation threshold, it is determined that there is a website correlation between the two visited websites.

7. The computer network data collection and analysis method according to claim 6, characterized in that: The step of obtaining the ranking difference conversion value of the two visited websites according to the website ranking result of the common classification table includes: According to the website ranking result of the common classification table, the ranking difference between the two visited websites is obtained; The reciprocal of the ranking difference is determined as the ranking difference conversion value.

8. The computer network data collection and analysis method according to claim 1, characterized in that: The step of determining a plurality of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites comprises: If the access duration is greater than a preset duration threshold, the corresponding access website is determined to be the target access website.

9. A computer network data collection and analysis system, characterized in that: include: A network data acquisition module is used to collect data of multiple computer devices accessing the network and obtain network data of each computer device; the network data includes multiple visited websites and website content features of each computer device; A website relevance analysis module, used to analyze the website relevance of each visited website according to the website content characteristics; A target visited website acquisition module, used to determine a number of target visited websites having a visit relationship with the target computer according to the visit duration of the target computer to each of the visited websites; The push module is used to push the visited website associated with the target visited website to the target computer according to the website association.

10. The computer network data collection and analysis system according to claim 9, characterized in that: The website relevance analysis module includes: A website classification module is used to classify each of the visited websites according to the website content characteristics to obtain multiple website classification tables; wherein the classification table characteristics of the website classification table correspond to at least one website content characteristic, and one visited website is classified in at least one website classification table; A website sorting module, used to sort each of the visited websites in the website classification table according to the correspondence between the website content characteristics of each of the visited websites and the characteristics of the classification table in the website classification table, and obtain a website sorting result corresponding to the website classification table; The website relevance acquisition module is used to obtain the website relevance of each visited website according to the website sorting results of each website classification table.