A semi-structured method for storing browser access information
Through the semi-structured browser access information storage method, the problems of dynamic web page information inconsistency and resource waste are solved, local information retrieval and statistical analysis are realized, information sharing and effectiveness rating are optimized, network resources are saved and information is improved Processing efficiency.
Patent Information
- Application Number
- CN202111569817.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-21
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-12-21
AI Technical Summary
It is difficult to quickly find and analyze the information of accessed web pages, dynamic web pages lead to inconsistency of information, difficulty in finding browser favorites, information is lost, and repeated network requests are wasted resources.
Design a semi-structured browser access information storage method, including information copying, processing, sending, receiving, storing and querying units, processing data through HTTP protocol and storing web page information locally, users can search and analyze locally, combined with The information validity rating module optimizes information sharing.
It realizes the acquisition of accessed information without repeated network requests, saves resources, facilitates information statistical processing and analysis, and optimizes information sharing and effectiveness rating.
Smart Images

Figure CN114491231B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of browsers, and in particular relates to a method for semi-structured storage of browser access information. Background Art
[0002] With the development of the times, it is becoming more and more convenient to obtain information through the Internet (browser), but how to quickly find the information you have visited and perform data analysis has become a difficult problem. Currently, most users manually copy information to spreadsheets or save web pages to favorites.
[0003] However, in the process of implementing the technical solution of this application, the inventors of this application found that:
[0004] First, many web pages are dynamic, so when you open the web page again, the information on the page is different from when you first opened it, and it is difficult for users to obtain information they have seen before.
[0005] Second, as the number of favorite web pages increases, searching in browser bookmarks will become more difficult.
[0006] Third, these two behaviors are not convenient for users to use some statistical software to analyze and process information.
[0007] Fourth, after the browser is closed, the information is lost. To access the information again, you must re-initiate a network request. Repeatedly accessing the same web page is essentially a waste of social resources. (At least the same information taking up network resources multiple times is a waste of network resources).
[0008] When sharing information, the amount of information sent is related to the user's sharing level, which effectively avoids information leakage to people with a low level of sharing and encourages people to participate in sharing. Summary of the invention
[0009] The purpose of the present invention is to provide a method for semi-structured storage of browser access information for existing material collection devices, so as to solve the problems raised in the above-mentioned background technology.
[0010] In order to solve the above technical problems, the present invention provides the following technical solutions: a method for semi-structured retention of browser access information, the system used in the method includes an information copying unit, an information processing unit, an information sending unit, an information receiving unit, an information storage unit, and an information query unit, the information query unit is electrically connected to the information processing unit, the information storage unit and the information copying unit are both electrically connected to the information processing unit, and the information receiving unit and the information sending unit are both electrically connected to the information processing unit;
[0011] The information copying unit is used to copy the browsing information of the browser plug-in program, the information processing unit is used to process data according to the http protocol, the information storage unit is used to store the information on the web page locally, the information query unit is used to retrieve the information locally when the user accesses the information again, the information receiving unit is used to receive the processed information, and the information sending unit is used to send the processed information.
[0012] The present invention further illustrates that the information processing unit includes an information body processing unit and an access processing unit. The information body processing unit is used to process data into a composite information body of domain name, request path, query parameters, COOKIE, request information, and response information. The access processing unit is used to process the information to facilitate query.
[0013] The present invention is further described, comprising the following specific steps:
[0014] S1. When a user uses a browser to surf the Internet, the information copying unit in the built-in plug-in of the browser copies information;
[0015] S2, the information body processing unit processes the data according to the HTTP protocol, and processes the data into the domain name, request path, query parameters, COOKIE, request information, and response information, which are collectively referred to as information body I;
[0016] S3, using the information sending unit to send the information body I to the receiving unit to receive the information;
[0017] S4, using the access processing unit to further process the information and then using the information storage unit to store the information body I in the user's local computer;
[0018] S4. The next time the user visits, the user can query and obtain the information body I through the information query unit.
[0019] The present invention further illustrates that it also includes an information validity rating module, the information validity rating module includes a rating selection module, a rating statistics module, a rating difference recording module, and a rating sorting module, and the rating statistics module is electrically connected to the rating difference recording module and the rating sorting module;
[0020] The rating selection module is used to allow the user to select the information effectiveness rating, the rating statistics module is used to count the information effectiveness ratings of all users, the rating difference recording module is used to record the difference in the user's information effectiveness rating each time, and the rating sorting module is used to sort users according to the level of their information effectiveness ratings.
[0021] The present invention further illustrates that the information query unit includes an information sending module, an information display module, an information validity calculation module, and an information sorting module, wherein the information sending module is electrically connected to the information display module, and the information validity calculation module is electrically connected to the information sorting module and the rating difference recording module;
[0022] The information sending module is used to send relevant information of the usage record to the user, the information display module is used to display relevant information of the usage record, the information validity calculation module is used to judge the information according to the difference of the user's information validity rating each time, and the information sorting module is used to sort the information according to the validity of the information.
[0023] The present invention further illustrates that the working process of the information validity rating module is as follows:
[0024] Sa. Initially, all users have the same degree of mastery of the information of the historical records being shared. In the first round of sharing, users share according to their personal wishes and give sharing degrees through the sharing selection module. The system counts the sharing degrees of all users through the sharing statistics module, and then sorts the users according to the degree of sharing through the sharing sorting module. Users with high sharing can obtain more information related to the historical records. The information is provided to users through the information sending module, and users can view it through the information display module;
[0025] Sb, the second round of sharing, the user adjusts the sharing degree according to the relevant information of the historical records provided by the system after the previous round of sharing, the system records the difference of the user's sharing through the sharing difference recording module, and then uses the information validity calculation module to determine which information is more attractive to the user according to the difference of the user's sharing, and sorts the information according to the validity through the information sorting module. The system sorts the second round of sharing of the user and gives priority to providing the user with information with higher validity;
[0026] Sc, the system collects the data shared twice by the user through the data acquisition module, and averages them to obtain the reasonable sharing degree of the historical records;
[0027] Sd, the third round of sharing, the user makes the final sharing based on the information provided after the second round of sharing;
[0028] Sd, the user with the highest sharing rate in the third round initiates sharing successfully.
[0029] The present invention further illustrates that in the above step Sa, the information sharing rule is:
[0030] The system will provide more information to users with higher sharing, and less information to users with lower sharing. The specific method is as follows;
[0031] There are m pieces of information in an electronic history record, and n users participate in initiating sharing. In the first round of sharing, the degree of sharing of each user is A. i , in the second round of sharing, each user's share is B i , where i∈[1,n], then the average share of users in the first round is
[0032] The relationship between the user's first round of sharing and the information he obtains after the first round of sharing is:
[0033]
[0034] Where q is the number of information obtained by the user after the first round of sharing, μ is the adjustment coefficient, and q pieces of information will be randomly selected from the total m pieces of information.
[0035] The present invention further illustrates that in the above step S2, the specific method for calculating the validity of the information is:
[0036] The initial validity of each piece of information is 100%, and each user receives q i pieces of information, and a new sharing degree B is given based on the information i , then each user's evaluation of the overall effectiveness of the information he received is
[0037] Information is randomly provided to users. The number of times a piece of information is provided to users is uncertain. The effectiveness of a piece of information is expressed as the average of the total effectiveness evaluation of all users who receive this information. The effectiveness of a piece of information is
[0038]
[0039] Where W is the validity of information, is the sum of the total effectiveness evaluations of all users who received this message, and k is the number of all users who received this message.
[0040] Compared with the prior art, the beneficial effects achieved by the present invention are: the present invention stores data locally through the program interface M, which has the following advantages:
[0041] First, most of the image and audio requests can be ignored, filtering out a lot of useless information.
[0042] Second, it allows users to directly obtain previously accessed information locally without having to request data over the network again, thus saving network resources.
[0043] Third, the semi-structured storage of the program is more convenient for information statistical processing (i.e. data mining) than HTML pages, which can save time for users (information users). BRIEF DESCRIPTION OF THE DRAWINGS
[0044] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:
[0045] Figure 1 It is a schematic diagram of the overall structure of the present invention; DETAILED DESCRIPTION
[0046] The following is a further non-limiting detailed description of the technical solution of the present invention in conjunction with the preferred embodiments and the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0047] See also Figure 1 The present invention provides a technical solution: a method for semi-structured retention of browser access information, the system used in the method includes an information copying unit, an information processing unit, an information sending unit, an information receiving unit, an information storage unit, and an information query unit, the information query unit is electrically connected to the information processing unit, the information storage unit and the information copying unit are both electrically connected to the information processing unit, and the information receiving unit and the information sending unit are both electrically connected to the information processing unit;
[0048] The information copying unit is used to copy the browsing information of the browser plug-in program to the browser, the information processing unit is used to process data according to the http protocol, the information storage unit is used to store the information on the web page locally, the information query unit is used to retrieve the information locally when the user accesses the information again, the information receiving unit is used to receive the processed information, and the information sending unit is used to send the processed information;
[0049] The information processing unit includes an information body processing unit and an access processing unit. The information body processing unit is used to process data into a composite information body including domain name, request path, query parameter, cookie, request information and response information. The access processing unit is used to process the information to facilitate query.
[0050] The specific steps include:
[0051] S1. When a user uses a browser to surf the Internet, the information copying unit in the built-in plug-in of the browser copies information;
[0052] S2, the information body processing unit processes the data according to the HTTP protocol, and processes the data into the domain name, request path, query parameters, COOKIE, request information, and response information, which are collectively referred to as information body I;
[0053] S3, using the information sending unit to send the information body I to the receiving unit to receive the information;
[0054] S4, using the access processing unit to further process the information and then using the information storage unit to store the information body I in the user's local computer;
[0055] S4. The next time the user visits, the user can query and obtain the information body I through the information query unit;
[0056] It also includes an information validity rating module, which includes a rating selection module, a rating statistics module, a rating difference recording module, and a rating sorting module, and the rating statistics module is electrically connected to the rating difference recording module and the rating sorting module;
[0057] The rating selection module is used to allow users to select information effectiveness ratings, the rating statistics module is used to count the information effectiveness ratings of all users, the rating difference recording module is used to record the difference in information effectiveness ratings of each user, and the rating sorting module is used to sort users according to the level of information effectiveness ratings;
[0058] The information query unit includes an information sending module, an information display module, an information validity calculation module, and an information sorting module. The information sending module is electrically connected to the information display module, and the information validity calculation module is electrically connected to the information sorting module and the rating difference recording module.
[0059] The information sending module is used to send the relevant information of the usage record to the user, the information display module is used to display the relevant information of the usage record, the information validity calculation module is used to judge the information according to the difference of the user's information validity rating each time, and the information sorting module is used to sort the information according to the validity of the information;
[0060] The working process of the information effectiveness rating module is as follows:
[0061] Sa. Initially, all users have the same degree of mastery of the information of the historical records being shared. In the first round of sharing, users share according to their personal wishes and give sharing degrees through the sharing selection module. The system counts the sharing degrees of all users through the sharing statistics module, and then sorts the users according to the degree of sharing through the sharing sorting module. Users with high sharing can obtain more information related to the historical records. The information is provided to users through the information sending module, and users can view it through the information display module;
[0062] Sb, the second round of sharing, the user adjusts the sharing degree according to the relevant information of the historical records provided by the system after the previous round of sharing, the system records the difference of the user's sharing through the sharing difference recording module, and then uses the information validity calculation module to determine which information is more attractive to the user according to the difference of the user's sharing, and sorts the information according to the validity through the information sorting module. The system sorts the second round of sharing of the user and gives priority to providing the user with information with higher validity;
[0063] Sc, the system collects the data shared twice by the user through the data acquisition module, and averages them to obtain the reasonable sharing degree of the historical records;
[0064] Sd, the third round of sharing, the user makes the final sharing based on the information provided after the second round of sharing;
[0065] Sd, the user with the highest sharing rate in the third round successfully initiates sharing;
[0066] In the above step Sa, the rules for information sharing are:
[0067] The system will provide more information to users with higher sharing, and less information to users with lower sharing. The specific method is as follows;
[0068] There are m pieces of information in an electronic history record, and n users participate in initiating sharing. In the first round of sharing, the degree of sharing of each user is A. i , in the second round of sharing, each user's share is B i , where i∈[1,n], then the average share of users in the first round is
[0069] The relationship between the user's first round of sharing and the information he obtains after the first round of sharing is:
[0070]
[0071] Where q is the number of messages the user obtains after the first round of sharing, μ is the adjustment coefficient, and q messages will be randomly selected from the total m messages;
[0072] In the above step S2, the specific method for calculating the validity of the information is:
[0073] The initial validity of each piece of information is 100%, and each user receives q i pieces of information, and a new sharing degree B is given based on the information i , then each user's evaluation of the overall effectiveness of the information he received is
[0074] Information is randomly provided to users. The number of times a piece of information is provided to users is uncertain. The effectiveness of a piece of information is expressed as the average of the total effectiveness evaluation of all users who receive this information. The effectiveness of a piece of information is
[0075]
[0076] Where W is the validity of information, is the sum of the total effectiveness evaluations of all users who received this message, and k is the number of all users who received this message.
[0077] Example: Step 1: Assume that a user visits the website of the National Bureau of Statistics
[0078] https: / / data.stats.gov.cn / easyquery.htm?cn=A01, we can easily find the structured information in
[0079] https: / / data.stats.gov.cn / easyquery.htm?m=QueryData&dbcode=hgyd&rowcode=zb&colcode=sj&wds=%5B%5D&dfwds=%5B%5D&k1=1636513644385&h=1
[0080] Step 2: The information is processed into domain name: data.stats.gov.cn, path: / easyquery.htm, query parameters
[0081] :{m:QueryData,dbcode:hgyd,rowcode:zb,colcode:sj,wds:%5B%5D,dfwds:%5B%5D,k1:1636513644385,h:1},COOKIE:{(too long to be omitted)},Request information:{(too long to be omitted)},Response information:{(too long to be omitted)}
[0082] Step 3: The information processing unit of program 2 processes the data, and the information storage unit of program 2 stores the information locally in the user.
[0083] Step 4. When the user wants to access the information again, the user can search locally through the information query unit of Program 2, and the domain name = data.stats.gov.cn and the query parameter.dbcode = hgyd can obtain the corresponding information I, without having to apply for data from the server where data.stats.gov.cn is located again, and the data queried in JSON structure is relatively more convenient for analysis.
[0084] In the description of the present invention, it is necessary to understand that the terms "up", "down", "front", "back", "left", "right", etc. indicate directions or positional relationships based on the directions or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention, rather than indicating or implying that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as a limitation on the present invention.
[0085] Finally, it should be pointed out that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the above embodiments, a person skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features can be replaced by equivalents, and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A method for semi-structured storage of browser access information, characterized in that: The system adopted by the method includes an information copying unit, an information processing unit, an information sending unit, an information receiving unit, an information storage unit, and an information query unit, wherein the information query unit is electrically connected to the information processing unit, the information storage unit and the information copying unit are both electrically connected to the information processing unit, and the information receiving unit and the information sending unit are both electrically connected to the information processing unit; The information copying unit uses a browser plug-in to copy the browsing information of the browser, the information processing unit is used to process data according to the http protocol, the information storage unit is used to store the information on the web page locally, the information query unit is used to retrieve the information locally when the user accesses the information again, the information receiving unit is used to receive the processed information, and the information sending unit is used to send the processed information; The information processing unit includes an information body processing unit and an access processing unit. The information body processing unit is used to process data into a composite information body of domain name, request path, query parameter, cookie, request information, and response information. The access processing unit is used to process the information to facilitate query. The specific steps include: S1. When a user uses a browser to surf the Internet, the browser's built-in plug-in uses the information copying unit to copy information; S2, the information body processing unit processes the data according to the HTTP protocol, and processes the data into a domain name, a request path, a query parameter, a cookie, a request message, and a response message, collectively referred to as an information body I; S3, using the information sending unit to send the information body I to the receiving unit to receive the information; S4, using the access processing unit to further process the information and then using the information storage unit to store the information body I in the user's local computer; S5. The user can query the information body I through the information query unit during the next visit. It also includes an information validity rating module, which includes a rating selection module, a rating statistics module, a rating difference recording module, and a rating sorting module, and the rating statistics module is electrically connected to the rating difference recording module and the rating sorting module; The rating selection module is used to allow users to select information effectiveness ratings, the rating statistics module is used to count the information effectiveness ratings of all users, the rating difference recording module is used to record the difference in information effectiveness ratings of each user, and the rating sorting module is used to sort users according to the level of information effectiveness ratings; The information query unit includes an information sending module, an information display module, an information validity calculation module, and an information sorting module. The information sending module is electrically connected to the information display module, and the information validity calculation module is electrically connected to the information sorting module and the rating difference recording module. The information sending module is used to send the relevant information of the usage record to the user, the information display module is used to display the relevant information of the usage record, the information validity calculation module is used to judge the validity of the information according to the difference of the user's information validity rating each time, and the information sorting module is used to sort the information according to the validity of the information; The working process of the information validity rating module is as follows: Sa. Initially, all users have the same degree of mastery of the information of the historical records being shared. In the first round of sharing, users share according to their personal wishes and decide the degree of sharing through the sharing selection module. The system counts the degree of sharing of all users through the sharing statistics module, and then sorts the users according to the degree of sharing through the sharing sorting module. Users with high sharing can obtain more information related to the historical records. The information is provided to users through the information sending module, and users can view it through the information display module; Sb, the second round of sharing, the user adjusts the sharing degree according to the relevant information of the historical records provided by the system after the previous round of sharing, the system records the difference of the user's sharing through the sharing difference recording module, and then uses the information validity calculation module to determine which information is more attractive to the user according to the difference of the user's sharing, and sorts the information according to the validity through the information sorting module. The system sorts the second round of sharing of the user and gives priority to providing the user with information with higher validity; Sc, the system collects the data shared twice by the user through the data acquisition module, and averages them to obtain the reasonable sharing degree of the historical records; Sd, the third round of sharing, the user makes the final sharing based on the information provided after the second round of sharing; Se. The user with the highest sharing rate in the third round successfully initiates sharing.
2. The method for semi-structured storage of browser access information according to claim 1, characterized in that: In step Sa, the rules for information sharing are: The system will provide more information to users with higher sharing, and less information to users with lower sharing. The specific method is as follows; There are m pieces of information in an electronic history record, and n users participate in initiating sharing. In the first round of sharing, the degree of sharing of each user is , in the second round of sharing, each user's share is ,in , then the average share of users in the first round is , the relationship between the user's first round of sharing and the information he obtains after the first round of sharing is ; Where q is the amount of information the user obtains after the first round of sharing. To adjust the coefficient, q messages will be randomly selected from the total m messages.
3. The method for semi-structured storage of browser access information according to claim 2, characterized in that: The specific method for calculating the validity of information is: The initial validity of each piece of information is 100%, and each user receives it before the second round of sharing. Messages, and a new sharing level is given based on the messages , then each user's evaluation of the overall effectiveness of the information he received is ; Information is randomly provided to users. The number of times a piece of information is provided to users is uncertain. The effectiveness of a piece of information is expressed as the average of the total effectiveness evaluation of all users who receive this information. The effectiveness of a piece of information is ; Where W is the validity of information, is the sum of the total effectiveness evaluations of all users who received this message, and k is the number of all users who received this message.
