Webpage update analysis method and device, medium and product

Abstract

The invention discloses a webpage updating analysis method and device, a medium and a product, relates to the technical field of internet, and can be used in the field of financial science and technology. The method comprises the following steps: comparing webpage contents of a target website in a fixed time window to obtain webpage updating contents; performing type judgment on the webpage updating content according to webpage label characteristics to obtain an updating type; the update type comprises at least one of content addition, content deletion, data update, style adjustment and irrelevant change; determining the updating frequency and the updating weight of the updating type in the fixed time window; and according to the update type, the update frequency and the update weight, performing webpage activity analysis on the target website. By means of the technical scheme, webpage updating in the website can be effectively monitored, and the webpage activeness can be effectively analyzed.

Description

Technical Field

[0001] This invention relates to the field of Internet technology and can be used in the field of financial technology, and in particular to a webpage update analysis method, device, medium and product. Background Technology

[0002] A company website is not only an information dissemination platform, but also a crucial window for brand image, customer service, and business expansion. Timely and effective content updates are key to maintaining a website's vitality and value. As a company's digital portal, its update activity can reflect its operational health to a certain extent. Therefore, effectively monitoring website updates and sharing website activity levels is essential for understanding the website's operational health. Summary of the Invention

[0003] This invention provides a webpage update analysis method, apparatus, medium, and product that can automatically, accurately, and efficiently monitor changes in enterprise website content.

[0004] According to one aspect of the present invention, a webpage update analysis method is provided, the method comprising: The content of web pages on the target website is compared within a fixed time window to obtain the updated content of the web pages; The update type is determined by analyzing the webpage tag features; the update type includes at least one of the following: content addition, content deletion, data update, style adjustment, and irrelevant changes. Determine the number of updates and the update weight of the update type within the fixed time window; Based on the update type, the number of updates, and the update weight, the target website is analyzed for webpage activity.

[0005] According to another aspect of the present invention, a webpage update analysis apparatus is provided, the apparatus comprising: The update content determination module is used to compare the webpage content of the target website within a fixed time window to obtain the updated webpage content; The update type determination module is used to determine the type of the webpage update content based on the webpage tag characteristics to obtain the update type; the update type includes at least one of the following: content addition, content deletion, data update, style adjustment, and irrelevant changes; The update frequency weight determination module is used to determine the update frequency and update weight of the update type within the fixed time window; The webpage activity analysis module is used to perform webpage activity analysis on the target website based on the update type, the number of updates, and the update weight.

[0006] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, the computer program being executed by the at least one processor to enable the at least one processor to perform the webpage update analysis method according to any embodiment of the present invention.

[0007] According to another aspect of the present invention, a computer-readable storage medium is provided, the computer-readable storage medium storing computer instructions for causing a processor to execute and implement the webpage update analysis method according to any embodiment of the present invention.

[0008] According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program that, when executed by a processor, implements the webpage update analysis method according to any embodiment of the present invention.

[0009] The technical solution of this invention compares the webpage content of a target website within a fixed time window to obtain updated webpage content; it then determines the type of the updated content based on webpage tag features to obtain the update type; the update type includes at least one of the following: content addition, content deletion, data update, style adjustment, and irrelevant changes; it determines the update frequency and update weight of each update type within the fixed time window; and it performs webpage activity analysis on the target website based on the update type, update frequency, and update weight. This technical solution can automatically, accurately, and efficiently monitor changes to enterprise website content, transforming enterprise website change information into quantifiable and analyzable operational activity indicators, thereby improving the efficiency of website activity analysis.

[0010] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of the present invention, nor is it intended to limit the scope of the invention. Other features of the invention will become readily apparent from the following description. Attached Figure Description

[0011] To more clearly illustrate the technical solutions in the embodiments of the present invention, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a flowchart of a webpage update analysis method provided by an embodiment of the present invention; Figure 2 This is a flowchart of a webpage update analysis method provided by an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of a webpage update analysis device according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of an electronic device that implements the webpage update analysis method of this invention. Detailed Implementation

[0013] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0014] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0015] Furthermore, it should be noted that the information collected in the technical solution of this invention is information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of related data all comply with the relevant laws, regulations and standards of relevant countries and regions, necessary confidentiality measures have been taken, and public order and good morals are not violated. Corresponding operation entry points are provided for users to choose to authorize or refuse.

[0016] Figure 1 This is a flowchart of a webpage update analysis method according to an embodiment of the present invention. This embodiment is applicable to situations involving update detection and activity analysis of enterprise websites. The method can be executed by a webpage update analysis device, which can be implemented in hardware and / or software. This device can be configured in an electronic device with webpage update analysis functionality, such as a server. Figure 1As shown, the method includes: S110. Compare the webpage content of the target website within a fixed time window to obtain the updated webpage content.

[0017] In this embodiment, the target website refers to the enterprise website that requires webpage inspection and operational monitoring. The fixed time window refers to the inspection period for the target website, such as 90 days. Webpage update content refers to the content of the webpage that has changed.

[0018] An alternative approach is to compare the content of web pages on a target website at different times within a fixed time window to determine the content to be updated.

[0019] S120. Determine the type of the updated content of the webpage based on the characteristics of the webpage tags to obtain the update type.

[0020] In this embodiment, the update type refers to the type of content updated on the webpage. Optionally, the update type includes at least one of the following: content addition, content deletion, data update, style adjustment, and irrelevant changes.

[0021] Specifically, if the webpage tag features are 、 、 、 、 If a new node is added, and the corresponding webpage update content is new text / images / links, then the update type is determined to be new content, indicating business expansion; if the webpage tag characteristics are... <article> 、 <section> 、 If a node is deleted and the corresponding webpage updates by removing the product or article, then the update type is determined to be content deletion, indicating that the business is shrinking; if the webpage tag characteristics are... <time datetime="2026-01-13">, ¥99.00 ,<divdata-stock="50"> If the updated content of the webpage is a change in numerical values ​​such as price, date, or quantity, then the update type is determined to be a data update, indicating an adjustment in operational strategy; if the webpage tag characteristics are... <style>、<link rel="stylesheet">、<script>、<meta>等，且对应网页更新内容为CSS / JS变更，无内容变化，则确定更新类型为样式调整，表明品牌形象在升级。若网页标签特征为id="banner", class*="carousel",class*="ad-container"等，且对应网页更新内容为时间戳、广告轮播等，则确定更新类型为无关变动，可以忽略不计。

[0022] S130、确定更新类型在固定时间窗口的更新次数和更新权重。

[0023] 其中，更新权重和更新类型的对应关系如表1所示。

[0024] 表1具体的，对于每一更新类型，确定该更新类型在固定时间窗口内的更新次数和更新权重。

[0025] S140、根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析。

[0026] 具体的，可以将更新类型对应的更新次数和更新权重进行相乘得到更新质量分，基于更新质量分对目标网站进行网页活跃分析。

[0027] 一种可选方式，对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容，包括：获取目标网站在固定时间窗口内的当前版本网页和历史版本网页；分别对当前版本网页的网页源码和历史版本网页的网页源码进行HTML标签切分，得到当前标签代码序列和历史标签代码序列；确定当前标签代码序列和历史标签代码序列之间的最长公共代码子序列；根据最长公共代码子序列、当前标签代码序列和历史标签代码序列，确定网页更新内容。

[0028] 具体的，获取目标网站在固定时间窗口内的当前版本网页和历史版本网页，然后分别对当前版本网页的网页源码和历史版本网页的网页源码进行超文本标记语言（HyperText Markup Language，HTML）标签切分，得到当前标签代码序列和历史标签代码序列，然后基于最长公共子序列算法，确定当前标签代码序列和历史标签代码序列之间的最长公共代码子序列，最后比对最长公共代码子序列、当前标签代码序列和历史标签代码序列，确定网页更新内容。

[0029] 可以理解的是，网页本质上是包含HTML标签的纯文本文件，HTML标签使得网页文本内容呈现一定的结构性，直接将网页的单个字符为单位进行比较，比较的字符串文本较长，效率低下。本发明将网页源码以HTML标签进行切分，提升算法的检测粒度。

[0030] 示例性的，根据最长公共代码子序列、当前标签代码序列和历史标签代码序列，确定网页更新内容，包括：将当前标签代码序列和历史标签代码序列分别与最长公共代码子序列进行位置对齐，并标记当前标签代码序列中当前元素和历史标签代码序列中历史元素分别在最长公共代码子序列中的对应位置；分别对当前标签代码序列、历史标签代码序列和最长公共代码子序列中对应位置处元素内容进行比对，得到网页更新内容。

[0031] 具体的，将当前标签代码序列和历史标签代码序列分别与最长公共代码子序列进行位置对齐，并标记当前标签代码序列中当前元素和历史标签代码序列中历史元素分别在最长公共代码子序列中的对应位置；对于每一位置，比对当前标签代码序列、历史标签代码序列和最长公共代码子序列中该位置处的元素内容，得到网页更新内容。

[0032] 可以理解的是，对当前网页代码序列、历史网页代码序列和最长公共子序列进行位置对齐，便于元素比较，提高更新内容确定准确性。

[0033] 分别对当前标签代码序列、历史标签代码序列和最长公共代码子序列中对应位置处元素内容进行比对，得到网页更新内容，包括：若当前元素不在最长公共代码子序列中，则确定当前元素为删除内容；若历史元素不在最长公共代码子序列中，则确定历史元素为新增内容；若最长公共代码子序列中元素同时在当前标签代码序列和历史标签代码序列中对应位置处出现，且元素内容一致，则确定当前标签代码序列对应位置处的内容未更新；若当前标签代码序列和历史标签代码序列中相对于最长公共代码子序列同一位置处都有内容，且内容不一致，则确定当前标签代码序列中对应位置处内容为修改内容；将删除内容、新增内容和修改内容作为网页更新内容。

[0034] 具体的，例如历史标签代码序列为X=[x1,x2,...,xm]，当前标签代码序列为Y=[y1,y2,...,yn]，最长公共代码子序列为Z=[z1,z2,...,zk]；则通过如下逻辑确定网页更新内容，将X和Y分别与Z对齐，标记出每个元素在Z中的对应位置。若X中某元素不在Z中，则判断为删除。若Y中某元素不在Z中，则判断为新增。若某元素在X和Y中均出现，且内容一致，则判断为未变动。若X和Y中相对Z同一位置都含值，但内容不一致，则判断为修改。

[0035] 可以理解的是，准确识别到具体的更新内容。

[0036] 本发明实施例的技术方案，通过对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容；根据网页标签特征对网页更新内容进行类型判断，得到更新类型；更新类型包括内容新增、内容删除、数据更新、样式调整和无关变动中的至少一种类型；确定更新类型在固定时间窗口的更新次数和更新权重；根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析。上述技术方案，能够自动、精确、高效地监测企业网站内容变更，将企业网站变更信息转化为可量化、可分析的运营活跃度指标，从而提升网站活跃分析效率。

[0037] 在上述实施例的基础上，作为本发明的一种可选方式，对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容，包括：根据目标网站在固定时间窗口内当前版本网页的当前网页哈希值和历史版本网页的历史网页哈希值，确定目标网站的页面内容是否更新；若更新，则对当前版本网页和历史版本网页进行比对，确定网页更新内容。

[0038] 具体的，获取目标网站在固定时间窗口内当前版本网页的当前网页哈希值和历史版本网页的历史网页哈希值，比对当前网页哈希值和历史网页哈希值是否一致，若一致，则表示网页内容没更新；若不一致，则表示网页内容有更新，则当前版本网页和历史版本网页进行比对，确定网页更新内容。其中，哈希值可以是MD5值。

[0039] 可以理解的是，先通过网页哈希值判断网页是否有内容更新，可以避免直接进行内容比对，造成资源浪费。

[0040] 图2是根据本发明实施例提供的一种网页更新分析方法的流程图；本实施例在上述实施例的基础上，对"根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析”进一步优化，提供一种可选实施方案。如图2所示，该方法包括：S210、对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容。

[0041] S220、根据网页标签特征对网页更新内容进行类型判断，得到更新类型。

[0042] 其中，更新类型包括内容新增、内容删除、数据更新、样式调整和无关变动中的至少一种类型；S230、确定更新类型在固定时间窗口的更新次数和更新权重。

[0043] S240、根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析。

[0044] 一种可选方式，根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析，包括：根据更新权重和更新次数，确定更新质量分；根据更新类型的连续活跃天数，确定基础活跃分；根据基础活跃分和更新质量分，确定网页活跃度；根据网页活跃度和活跃度阈值，确定网页活跃等级，以对目标网站的网页活跃分析。

[0045] 其中，连续活跃天数是指网页内容有效更新的连续天数。

[0046] 具体的，对于每一更新类型，将该更新类型对应的更新权重和更新次数相乘得到类型质量分，将各更新类型的类型质量分相加得到更新质量分；在固定时间窗口内，获取有效的更新类型（如非无关变动）的连续活跃天数，从设定倍数的连续活跃天数，和固定分值中选择最小值作为基础活跃分；将基础活跃分和更新质量分相加得到网页活跃度，然后基于网页活跃等级与活跃度阈值之间的对应关系，将网页活跃度与活跃度阈值进行比较，确定网页活跃等级，其中，网页活跃等级与活跃度阈值之间的对应关系如下表2所示。

[0047] 表2可以理解的是，对网页活跃分析进行量化，便于网页活跃自动分析，降低人工巡检成本。

[0048] 另一种可选方式，根据基础活跃分和更新质量分，确定网页活跃度，还包括：确定目标网站的网站关键板块，并根据网站关键板块的更新情况，确定关键板块检测扣分；根据基础活跃分、更新质量分和关键板块检测扣分，确定网页活跃度。

[0049] 具体的，可以确定目标网站的网站关键板块，若网站关键板块在固定时间窗口内完全无更新，则确定关键板块检测扣分为设定值，例如-30，其中，网站关键板块可以自定义配置。然后将基础活跃分、更新质量分和关键板块检测扣分相加得到网页活跃度。

[0050] 可以理解的是，融合关键板块的更新情况，能够有效监测重要板块，使得网页活跃度的确定更加合理。

[0051] 本发明实施例的技术方案，通过对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容；根据网页标签特征对网页更新内容进行类型判断，得到更新类型；更新类型包括内容新增、内容删除、数据更新、样式调整和无关变动中的至少一种类型；确定更新类型在固定时间窗口的更新次数和更新权重；根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析。上述技术方案，能够自动、精确、高效地监测企业网站内容变更，将企业网站变更信息转化为可量化、可分析的运营活跃度指标，从而提升网站活跃分析效率。

[0052] 本发明通过算法自动化实现网站内容的比对与分析，显著降低人工巡检成本，提升监测频率与覆盖范围。通过设定时间窗口与更新权重体系，将网站更新行为量化为活跃度评分，实现对更新频率、更新范围及更新质量的系统化评估，为企业运营决策提供数据支持。通过结合MD5快速比对与LCS深度文本分析，能够准确识别内容新增、删除、修改等不同类型更新，并根据网页结构化的特点，对网页进行标签切分，提高了网页对比算法的检测粒度，提升监测的准确性图3是根据本发明实施例提供的一种网页更新分析装置的结构示意图；本实施例可适用于如何对企业网站进行更新检测和活跃度分析的情况，该网页更新分析装置可以采用硬件和 / 或软件的形式实现，该装置可配置于网页更新分析功能的电子设备中，例如服务器中。如图3所示，该装置包括：更新内容确定模块310，用于对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容；更新类型确定模块320，用于根据网页标签特征对网页更新内容进行类型判断，得到更新类型；更新类型包括内容新增、内容删除、数据更新、样式调整和无关变动中的至少一种类型；更新次数权重确定模块330，用于确定更新类型在固定时间窗口的更新次数和更新权重；网页活跃分析模块340，用于根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析。

[0053] 本发明实施例的技术方案，通过对目标网站在固定时间窗口内的网页内容进行比对，得到网页更新内容；根据网页标签特征对网页更新内容进行类型判断，得到更新类型；更新类型包括内容新增、内容删除、数据更新、样式调整和无关变动中的至少一种类型；确定更新类型在固定时间窗口的更新次数和更新权重；根据更新类型、更新次数和更新权重，对目标网站进行网页活跃分析。上述技术方案，能够自动、精确、高效地监测企业网站内容变更，将企业网站变更信息转化为可量化、可分析的运营活跃度指标，从而提升网站活跃分析效率。

[0054] 可选的，更新内容确定模块310用于：获取目标网站在固定时间窗口内的当前版本网页和历史版本网页；分别对当前版本网页的网页源码和历史版本网页的网页源码进行HTML标签切分，得到当前标签代码序列和历史标签代码序列；确定当前标签代码序列和历史标签代码序列之间的最长公共代码子序列；根据最长公共代码子序列、当前标签代码序列和历史标签代码序列，确定网页更新内容。

[0055] 可选的，更新内容确定模块310具体用于：将当前标签代码序列和历史标签代码序列分别与最长公共代码子序列进行位置对齐，并标记当前标签代码序列中当前元素和历史标签代码序列中历史元素分别在最长公共代码子序列中的对应位置；分别对述当前标签代码序列、历史标签代码序列和最长公共代码子序列中对应位置处元素内容进行比对，得到网页更新内容。

[0056] 可选的，更新内容确定模块310具体用于：：若当前元素不在最长公共代码子序列中，则确定当前元素为删除内容；若历史元素不在最长公共代码子序列中，则确定历史元素为新增内容；若最长公共代码子序列中元素同时在当前标签代码序列和历史标签代码序列中对应位置处出现，且元素内容一致，则确定当前标签代码序列对应位置处的内容未更新；若当前标签代码序列和历史标签代码序列中相对于最长公共代码子序列同一位置处都有内容，且内容不一致，则确定当前标签代码序列中对应位置处内容为修改内容；将删除内容、新增内容和修改内容作为网页更新内容。

[0057] 可选的，网页活跃分析模块340用于：根据更新权重和更新次数，确定更新质量分；根据更新类型的连续活跃天数，确定基础活跃分；根据基础活跃分和更新质量分，确定网页活跃度；根据网页活跃度和活跃度阈值，确定网页活跃等级，以对目标网站的网页活跃分析。

[0058] 可选的，网页活跃分析模块340用于：确定目标网站的网站关键板块，并根据网站关键板块的更新情况，确定关键板块检测扣分；根据基础活跃分、更新质量分和关键板块检测扣分，确定网页活跃度。

[0059] 可选的，更新内容确定模块310用于：根据目标网站在固定时间窗口内当前版本网页的当前网页哈希值和历史版本网页的历史网页哈希值，确定目标网站的页面内容是否更新；若更新，则对当前版本网页和历史版本网页进行比对，确定网页更新内容。

[0060] 本发明实施例所提供的网页更新分析装置可执行本发明任意实施例所提供的网页更新分析方法，具备执行方法相应的功能模块和有益效果。

[0061] 根据本发明实施例，本发明还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。

[0062] 图4是实现本发明实施例的网页更新分析方法的电子设备的结构示意图。图4示出了可以用来实施本发明的实施例的电子设备10的结构示意图。电子设备旨在表示各种形式的数字计算机，诸如，膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置，诸如，个人数字助理、蜂窝电话、智能电话、可穿戴设备（如头盔、眼镜、手表等）和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例，并且不意在限制本文中描述的和 / 或者要求的本发明的实现。

[0063] 如图4所示，电子设备10包括至少一个处理器11，以及与至少一个处理器11通信连接的存储器，如只读存储器（ROM）12、随机访问存储器（RAM）13等，其中，存储器存储有可被至少一个处理器执行的计算机程序，处理器11可以根据存储在只读存储器（ROM）12中的计算机程序或者从存储单元18加载到随机访问存储器（RAM）13中的计算机程序，来执行各种适当的动作和处理。在RAM 13中，还可存储电子设备10操作所需的各种程序和数据。处理器11、ROM 12以及RAM 13通过总线14彼此相连。输入 / 输出（I / O）接口15也连接至总线14。

[0064] 电子设备10中的多个部件连接至I / O接口15，包括：输入单元16，例如键盘、鼠标等；输出单元17，例如各种类型的显示器、扬声器等；存储单元18，例如磁盘、光盘等；以及通信单元19，例如网卡、调制解调器、无线通信收发机等。通信单元19允许电子设备10通过诸如因特网的计算机网络和 / 或各种电信网络与其他设备交换信息 / 数据。

[0065] 处理器11可以是各种具有处理和计算能力的通用和 / 或专用处理组件。处理器11的一些示例包括但不限于中央处理单元（CPU）、图形处理单元（GPU）、各种专用的人工智能（AI）计算芯片、各种运行机器学习模型算法的处理器、数字信号处理器（DSP）、以及任何适当的处理器、控制器、微控制器等。处理器11执行上文所描述的各个方法和处理，例如网页更新分析方法。

[0066] 在一些实施例中，网页更新分析方法可被实现为计算机程序，其被有形地包含于计算机可读存储介质，例如存储单元18。在一些实施例中，计算机程序的部分或者全部可以经由ROM 12和 / 或通信单元19而被载入和 / 或安装到电子设备10上。当计算机程序加载到RAM 13并由处理器11执行时，可以执行上文描述的网页更新分析方法的一个或多个步骤。备选地，在其他实施例中，处理器11可以通过其他任何适当的方式（例如，借助于固件）而被配置为执行网页更新分析方法。

[0067] 本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、现场可编程门阵列（FPGA）、专用集成电路（ASIC）、专用标准产品（ASSP）、芯片上系统的系统（SOC）、复杂可编程逻辑设备（CPLD）、计算机硬件、固件、软件、和 / 或它们的组合中实现。这些各种实施方式可以包括：实施在一个或者多个计算机程序中，该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和 / 或解释，该可编程处理器可以是专用或者通用可编程处理器，可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令，并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。

[0068] 用于实施本发明的方法的计算机程序可以采用一个或多个编程语言的任何组合来编写。这些计算机程序可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器，使得计算机程序当由处理器执行时使流程图和 / 或框图中所规定的功能 / 操作被实施。计算机程序可以完全在机器上执行、部分地在机器上执行，作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。

[0069] 在本发明的上下文中，计算机可读存储介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的计算机程序。计算机可读存储介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。备选地，计算机可读存储介质可以是机器可读信号介质。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器（RAM）、只读存储器（ROM）、可擦除可编程只读存储器（EPROM或快闪存储器）、光纤、便捷式紧凑盘只读存储器（CD-ROM）、光学储存设备、磁储存设备、或上述内容的任何合适组合。

[0070] 为了提供与用户的交互，可以在电子设备上实施此处描述的系统和技术，该电子设备具有：用于向用户显示信息的显示装置（例如，CRT（阴极射线管）或者LCD（液晶显示器）监视器）；以及键盘和指向装置（例如，鼠标或者轨迹球），用户可以通过该键盘和该指向装置来将输入提供给电子设备。其它种类的装置还可以用于提供与用户的交互；例如，提供给用户的反馈可以是任何形式的传感反馈（例如，视觉反馈、听觉反馈、或者触觉反馈）；并且可以用任何形式（包括声输入、语音输入或者、触觉输入）来接收来自用户的输入。

[0071] 可以将此处描述的系统和技术实施在包括后台部件的计算系统（例如，作为数据服务器）、或者包括中间件部件的计算系统（例如，应用服务器）、或者包括前端部件的计算系统（例如，具有图形用户界面或者网络浏览器的用户计算机，用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互）、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信（例如，通信网络）来将系统的部件相互连接。通信网络的示例包括：局域网、广域网、区块链网络和互联网。

[0072] 计算系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器，又称为云计算服务器或云主机，是云计算服务体系中的一项主机产品，以解决了传统物理主机与虚拟专用服务服务中，存在的管理难度大，业务扩展性弱的缺陷。

[0073] 应该理解，可以使用上面所示的各种形式的流程，重新排序、增加或删除步骤。例如，本发明中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行，只要能够实现本发明的技术方案所期望的结果，本文在此不进行限制。

[0074] 上述具体实施方式，并不构成对本发明保护范围的限制。本领域技术人员应该明白的是，根据设计要求和其他因素，可以进行各种修改、组合、子组合和替代。任何在本发明的精神和原则之内所作的修改、等同替换和改进等，均应包含在本发明保护范围之内。< / style> < / time> < / section> < / article>

Claims

1. A webpage update analysis method, characterized in that, include: The content of web pages on the target website is compared within a fixed time window to obtain the updated content of the web pages; The update type is determined by analyzing the webpage tag features; the update type includes at least one of the following: content addition, content deletion, data update, style adjustment, and irrelevant changes. Determine the number of updates and the update weight of the update type within the fixed time window; Based on the update type, the number of updates, and the update weight, the target website is analyzed for webpage activity.

2. The method according to claim 1, characterized in that, The content of web pages on the target website is compared within a fixed time window to obtain the updated content, including: Retrieve the current and historical versions of web pages from a target website within a fixed time window; The HTML tags of the current version of the webpage and the historical version of the webpage are segmented to obtain the current tag code sequence and the historical tag code sequence. Determine the longest common code subsequence between the current tag code sequence and the historical tag code sequences; The updated content of the webpage is determined based on the longest common code subsequence, the current tag code sequence, and the historical tag code sequence.

3. The method according to claim 2, characterized in that, Based on the longest common code subsequence, the current tag code sequence, and the historical tag code sequence, the updated webpage content is determined, including: Align the current tag code sequence and the historical tag code sequence with the longest common code subsequence, and mark the corresponding positions of the current element in the current tag code sequence and the historical element in the historical tag code sequence in the longest common code subsequence; The content of the elements at corresponding positions in the current tag code sequence, the historical tag code sequence, and the longest common code subsequence are compared to obtain the updated content of the webpage.

4. The method according to claim 3, characterized in that, The content of elements at corresponding positions in the current tag code sequence, the historical tag code sequence, and the longest common code subsequence are compared to obtain the updated webpage content, including: If the current element is not in the longest common code subsequence, then the current element is determined to be content to be deleted; If the historical element is not in the longest common code subsequence, then the historical element is determined to be newly added content; If an element in the longest common code subsequence appears at the corresponding position in both the current tag code sequence and the historical tag code sequence, and the element content is the same, then it is determined that the content at the corresponding position in the current tag code sequence has not been updated. If both the current tag code sequence and the historical tag code sequence contain content at the same position relative to the longest common code subsequence, and the content is inconsistent, then the content at the corresponding position in the current tag code sequence is determined to be the modified content. The deleted content, the added content, and the modified content are used as the updated content of the webpage.

5. The method according to claim 1, characterized in that, Based on the update type, the update frequency, and the update weight, perform webpage activity analysis on the target website, including: The update quality score is determined based on the update weight and the number of updates. The base activity score is determined based on the number of consecutive active days for the aforementioned update type; The page activity level is determined based on the basic activity score and the update quality score. Based on the webpage activity level and the activity threshold, a webpage activity level is determined for webpage activity analysis of the target website.

6. The method according to claim 5, characterized in that, Determining webpage activity based on the basic activity score and the update quality score also includes: Identify the key sections of the target website, and determine the detection deduction points for the key sections based on the update status of the key sections; The webpage activity level is determined based on the basic activity score, the update quality score, and the key section detection deduction score.

7. The method according to claim 1, characterized in that, The content of web pages on the target website is compared within a fixed time window to obtain the updated content, including: Based on the current page hash value of the current version of the webpage and the historical page hash value of the historical version of the webpage within a fixed time window, determine whether the page content of the target website has been updated; If an update is needed, the current version of the webpage and the historical versions of the webpage are compared to determine the updated content.

8. A webpage update analysis device, characterized in that, include: The update content determination module is used to compare the webpage content of the target website within a fixed time window to obtain the updated webpage content; The update type determination module is used to determine the type of the webpage update content based on the webpage tag characteristics to obtain the update type; the update type includes at least one of the following: content addition, content deletion, data update, style adjustment, and irrelevant changes; The update frequency weight determination module is used to determine the update frequency and update weight of the update type within the fixed time window; The webpage activity analysis module is used to perform webpage activity analysis on the target website based on the update type, the number of updates, and the update weight.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that cause a processor to execute the webpage update analysis method according to any one of claims 1-7.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the webpage update analysis method according to any one of claims 1-7.

Images