Webpage 404 error page monitoring processing method, system and equipment

Abstract

The invention relates to the technical field of webpage state detection, in particular to a webpage 404 error page monitoring processing method, system and equipment, and the method comprises the following steps: checking a state code of a webpage in real time through regular crawler and user behavior monitoring so as to monitor a 404 error page; performing intelligent classification on the monitored 404 error pages based on a machine learning algorithm; and based on a classification result, repairing the 404 error page according to a rule set by a user or through a preset content management system. Therefore, the error page of the webpage 404 can be determined in real time and efficiently in combination with user behaviors, corresponding repair can be performed, and website performance, search engine ranking and user experience are greatly improved.

Description

Technical Field

[0001] The present invention relates to the technical field of web page status detection, and in particular to a method, system and device for monitoring and processing a 404 error page of a web page. Background Art

[0002] At present, 404 error pages are one of the common network problems on Internet websites. In actual applications, when a web page is deleted, a link is invalid, or a URL is entered incorrectly, the server cannot find the corresponding page and will return a 404 status code. Although 404 error pages have a certain impact on user experience and SEO (search engine optimization), existing web page status monitoring tools often cannot detect and respond to 404 error pages in real time and efficiently, resulting in a large number of 404 error pages that continue to exist, affecting website performance, search engine rankings, and user experience. Summary of the invention

[0003] In view of this, the purpose of the present invention is to provide a method, system and device for monitoring and processing a web page 404 error page, so as to overcome the current problem that a web page 404 error page cannot be monitored in real time and efficiently.

[0004] To achieve the above objectives, the present invention adopts the following technical solutions:

[0005] In a first aspect, an embodiment of the present application provides a method for monitoring and processing a 404 error page of a web page, comprising:

[0006] Through regular crawling and user behavior monitoring, the status code of the website page is checked in real time to monitor 404 error pages;

[0007] Intelligently classify the monitored 404 error pages based on a machine learning algorithm;

[0008] Based on the classification result, the 404 error page is repaired according to the rules set by the user or through a preset content management system.

[0009] Furthermore, in some embodiments of the present application, the results of the intelligent classification include invalid links, deleted web pages, and input errors.

[0010] Furthermore, in some embodiments of the present application, based on the classification result, the 404 error page is repaired according to rules set by the user or through a preset content management system, including: automatically repairing the 404 error page through 301 redirection.

[0011] Furthermore, in some embodiments of the present application, it also includes: for the 404 error page that cannot be automatically repaired, an error report is generated and optimization suggestions are provided.

[0012] Furthermore, in some embodiments of the present application, it also includes:

[0013] Continuously monitoring the 404 error page and generating a real-time error report; wherein the real-time error report includes an intelligent classification result of the 404 error page;

[0014] According to the intelligent classification results of the 404 error pages, SEO optimization suggestions are generated.

[0015] Furthermore, in some embodiments of the present application, it also includes:

[0016] Analyze user behavior and predict in advance the 404 error pages that users may trigger;

[0017] Provide real-time warnings based on prediction results and repair predicted 404 error pages.

[0018] Furthermore, in some embodiments of the present application, it also includes: generating an error report based on the monitored 404 error page.

[0019] In a second aspect, an embodiment of the present application provides a system for monitoring and processing a 404 error page of a web page, characterized in that it includes:

[0020] Web page status detection module, which is used to check the status code of website pages in real time through regular crawling and user behavior monitoring to monitor 404 error pages;

[0021] An intelligent error classification module, used for intelligently classifying the monitored 404 error pages based on a machine learning algorithm;

[0022] The automatic repair module is used to repair the 404 error page based on the classification result, according to the rules set by the user or through the preset content management system.

[0023] Furthermore, in some embodiments of the present application, it also includes: a monitoring and reporting module, which is used to generate an error report based on the monitored 404 error page.

[0024] In a third aspect, an embodiment of the present application provides a monitoring and processing device for a webpage 404 error page, including a processor and a memory, wherein the processor is connected to the memory:

[0025] Wherein, the processor is used to call and execute the program stored in the memory;

[0026] The memory is used to store the program, and the program is at least used to execute the above-mentioned monitoring and processing method of the web page 404 error page.

[0027] The present invention relates to the technical field of web page status detection, and specifically to a monitoring and processing method, system and device for a web page 404 error page, the method comprising: checking the status code of a website page in real time through regular crawlers and user behavior monitoring to monitor the 404 error page; intelligently classifying the monitored 404 error page based on a machine learning algorithm; and repairing the 404 error page based on the classification result according to the rules set by the user or through a preset content management system. In this way, the 404 error page of a web page can be determined in real time and efficiently, and can be combined with user behavior, and can be repaired accordingly, greatly improving website performance, search engine rankings and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0029] Figure 1 It is a flow chart of a method for monitoring and processing a 404 error page of a web page provided by an embodiment of the present invention;

[0030] Figure 2 It is a flow chart of a method for monitoring and processing a webpage 404 error page provided by another embodiment of the present invention;

[0031] Figure 3 It is a structural diagram of a system for monitoring and processing a webpage 404 error page provided by an embodiment of the present invention;

[0032] Figure 4 It is a structural schematic diagram of a monitoring and processing device for a web page 404 error page provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0033] To make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other implementation methods obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0034] Figure 1 FIG. 4 is a flow chart of a method for monitoring and processing a 404 error page of a web page provided by an embodiment of the present invention. Figure 1 As shown, the method includes:

[0035] S101. Check the status code of the website page in real time through regular crawling and user behavior monitoring to monitor 404 error pages.

[0036] Specifically, a preset module such as the web page status monitoring module in the monitoring and processing system of the web page 404 error page provided in the embodiment of the present application can be used to regularly crawl data with a regular crawler and monitor user behavior to check the status code of the website page in real time. If a 404 status code is detected, that is, a 404 error page is monitored, it can be reported to the system immediately.

[0037] S102. Intelligently classify the monitored 404 error pages based on a machine learning algorithm.

[0038] S103: Based on the classification result, the 404 error page is repaired according to the rules set by the user or through a preset content management system.

[0039] Specifically, a preset module such as the automatic repair module in the monitoring and processing system for the 404 error page of a web page provided in the embodiment of the present application can be used to automatically repair the monitored 404 error page through the corresponding repair strategy using rules set by the user or through integration with the content management system (CMS).

[0040] The monitoring and processing method of the webpage 404 error page provided in the embodiment of the present application firstly checks the status code of the website page in real time through regular crawling and user behavior monitoring to monitor the 404 error page; then intelligently classifies the monitored 404 error page based on the machine learning algorithm; finally, based on the classification result, the 404 error page is repaired according to the rules set by the user or through the preset content management system. In this way, the 404 error page of the webpage can be determined in real time and efficiently, and the 404 error page of the webpage can be determined in combination with user behavior, and corresponding repairs can be performed, which greatly improves the website performance, search engine ranking and user experience.

[0041] In practical applications, the webpage status detection module mentioned in the above embodiment of the present application can store all the page URLs of the website in the database, and detect whether there is a 404 page in the website in real time through periodic crawling and user access behavior monitoring. Once a 404 error is detected, the system will automatically generate an error report and notify the administrator via email or message.

[0042] Figure 2 FIG. 1 is a flow chart of a method for monitoring and processing a 404 error page of a web page provided by another embodiment of the present invention. Figure 2 As shown, in some embodiments of the present application, the above classification of 404 error pages can be implemented by a preset module such as an intelligent error classification module in the monitoring and processing system for web page 404 error pages provided in the embodiments of the present application.

[0043] Specifically, through this module, a machine learning algorithm is used to intelligently classify the monitored 404 error pages, thereby distinguishing 404 pages caused by broken links, web page deletions, input errors, etc., and providing corresponding repair strategies for each error type (corresponding to the user-set rules in the above embodiment or through integration with the content management system (CMS)).

[0044] Further, in some embodiments of the present application, based on the classification results, according to the rules set by the user or through the preset content management system, the 404 error page is repaired, which may include repairing through methods such as 301 redirection. In addition, in the embodiments of the present application, for 404 error pages that cannot be automatically repaired, the above system can also generate a detailed error report and provide optimization suggestions.

[0045] Through the above-mentioned intelligent error classification module, the system can automatically identify different types of errors according to the source of the 404 error page (such as broken links, page deletion, etc.). On this basis, through the preset program module, the system can automatically repair the pages that can be repaired. The automatic repair module will automatically repair errors according to the rules set by the administrator (such as 301 redirection or creating a new page) to improve efficiency.

[0046] Furthermore, in some embodiments of the present application, the monitoring and processing system for the 404 error page of the web page also includes a monitoring and reporting module. The module continuously monitors the status of the 404 error page of the entire website, generates a real-time error report, and gives detailed SEO optimization suggestions based on the detected error type. In actual applications, the system can send an email or other reminder method to the administrator to indicate a serious 404 error based on the above information.

[0047] Furthermore, in some embodiments of the present application, the monitoring and processing system for the above-mentioned web page 404 error page also includes a user behavior tracking module, which analyzes user behavior and predicts in advance the 404 pages that may be triggered, as well as potential 404 error pages. The system will issue early warnings for these potential errors and prompt administrators to repair or optimize the pages in advance.

[0048] The monitoring and processing method for web page 404 error page provided by this application has the following advantages:

[0049] Real-time detection and rapid response can be achieved. Compared with traditional 404 error page detection tools, which often rely on periodic site crawling and are unable to discover and handle problems in real time, resulting in users visiting 404 error pages for a long time, affecting user experience and website traffic. The monitoring and processing method for 404 error pages of web pages provided in this application, through a system integrating a web page status detection module and a user behavior tracking module, can monitor all pages visited by users in real time, quickly detect 404 errors and respond, greatly shortening the existence time of error pages, thereby effectively improving the availability of the website.

[0050] It can intelligently classify and automatically repair errors. Existing 404 error detection methods can often only simply report 404 error pages, and cannot deeply analyze the source of the error. The monitoring and processing method of the 404 error page of the web page provided by this application, through the intelligent error classification module of the preset system, classifies 404 errors, and can distinguish different reasons such as link failure, input errors and page deletion. This classification not only improves the accuracy of error processing, but also provides targeted strategies for subsequent repairs. In addition, the automatic repair module in the system can automatically execute 301 redirects or other repair measures according to preset rules or algorithms, greatly reducing the need for manual intervention by website administrators and improving problem handling efficiency.

[0051] It can improve SEO effects. In practical applications, the excessive presence of 404 error pages will have a negative impact on the website's search engine ranking. The monitoring and processing method for 404 error pages of web pages provided in this application can not only repair 404 pages in a timely manner by automatically generating error reports and SEO optimization suggestions, but also provide specific suggestions for improving website structure and link quality based on SEO best practices, helping website administrators improve web page quality and search engine rankings. This 404 detection system combined with SEO optimization strategies effectively solves the problem that traditional tools do not take into account the long-term SEO impact of websites.

[0052] The monitoring and processing method for the 404 error page of a web page provided in this application can automatically monitor all pages of a website through a relevant system, and provide intelligent repair suggestions or automatic repair options when a 404 error page is detected. It is also scalable and suitable for websites of various sizes.

[0053] Based on the same inventive concept, the embodiment of the present application also provides a monitoring and processing system for a web page 404 error page, such as Figure 3 As shown, the system includes:

[0054] The webpage status detection module 11 is used to check the status code of the website page in real time through regular crawling and user behavior monitoring to monitor the 404 error page. The intelligent error classification module 12 is used to intelligently classify the monitored 404 error page based on the machine learning algorithm. The automatic repair module 1 is used to repair the 404 error page based on the classification result, according to the rules set by the user or through the preset content management system. The monitoring and reporting module 14 is used to generate an error report based on the monitored 404 error page. The user behavior tracking module 15 is used to predict the 404 error page that may be triggered in advance by analyzing the user behavior, and to provide early warning and repair in real time.

[0055] Regarding the system in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0056] The present invention also provides a monitoring and processing device for a web page 404 error page, which is used to implement the above method embodiment. Figure 4 404 error page monitoring and processing device provided by the embodiment of the present invention. Figure 4 As shown, the monitoring and processing device for the webpage 404 error page of this embodiment includes a processor 21 and a memory 22, and the processor 21 is connected to the memory 22. The processor 21 is used to call and execute the program stored in the memory 22; the memory 22 is used to store the program, and the program is at least used to execute the monitoring and processing method for the webpage 404 error page in the above embodiment.

[0057] The specific implementation scheme of the monitoring and processing device for the web page 404 error page provided in the embodiment of the present application can refer to the implementation scheme of the monitoring and processing method for the web page 404 error page in any of the above embodiments, which will not be repeated here.

[0058] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.

[0059] It should be noted that, in the description of the present invention, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "plurality" refers to at least two.

[0060] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention belong.

[0061] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0062] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0063] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0064] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0065] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0066] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for monitoring and processing a 404 error page of a web page, characterized in that: include: Through regular crawling and user behavior monitoring, the status code of the website page is checked in real time to monitor 404 error pages; Intelligently classify the monitored 404 error pages based on a machine learning algorithm; Based on the classification result, the 404 error page is repaired according to the rules set by the user or through a preset content management system.

2. The method for monitoring and processing a 404 error page of a web page according to claim 1, characterized in that: The results of the intelligent classification include broken links, deleted web pages, and input errors.

3. The method for monitoring and processing a 404 error page of a web page according to claim 1, characterized in that: Based on the classification result, the 404 error page is repaired according to the rules set by the user or through a preset content management system, including: automatically repairing the 404 error page through 301 redirection.

4. The method for monitoring and processing a 404 error page of a web page according to claim 3, characterized in that: Also includes: For the 404 error pages that cannot be automatically fixed, an error report is generated and optimization suggestions are provided.

5. The method for monitoring and processing a 404 error page of a web page according to claim 1, characterized in that: Also includes: Continuously monitoring the 404 error page and generating a real-time error report; wherein the real-time error report includes an intelligent classification result of the 404 error page; According to the intelligent classification results of the 404 error pages, SEO optimization suggestions are generated.

6. The method for monitoring and processing a 404 error page of a web page according to claim 1, characterized in that: Also includes: Analyze user behavior and predict in advance the 404 error pages that users may trigger; Provide real-time warnings based on prediction results and repair predicted 404 error pages.

7. The method for monitoring and processing a 404 error page of a web page according to claim 1, characterized in that: Also includes: Generate error reports based on detected 404 error pages.

8. A monitoring and processing system for 404 error pages of web pages, characterized in that: include: Web page status detection module, which is used to check the status code of website pages in real time through regular crawling and user behavior monitoring to monitor 404 error pages; An intelligent error classification module, used for intelligently classifying the monitored 404 error pages based on a machine learning algorithm; The automatic repair module is used to repair the 404 error page based on the classification result, according to the rules set by the user or through the preset content management system.

9. The monitoring and processing system for 404 error pages of web pages according to claim 8, characterized in that: Also includes: The monitoring and reporting module is used to generate error reports based on the monitored 404 error pages.

10. A monitoring and processing device for a 404 error page of a webpage, characterized in that: The invention comprises a processor and a memory, wherein the processor is connected to the memory: Wherein, the processor is used to call and execute the program stored in the memory; The memory is used to store the program, and the program is at least used to execute the monitoring and processing method for a web page 404 error page according to any one of claims 1 to 9.

Images