7 results about "HTML element" patented technology

A system for dynamically updating data for course generation, the system including a web crawler operating on a server, wherein the web crawler is configured to identify one or more predetermined HTML elements on a plurality of web pages, identify isolated data as a function of the one or more predetermined HTML elements, compare the isolated data to a modification baseline and generate regulatory data as a function of the isolated data and the comparison, and a memory the memory containing instructions configuring at least a processor to receive the regulatory data, classify the regulatory data to one or more guideline categorizations, identify a plurality of course modules, modify the one or more course modules as a function of the regulatory data and transmit a notification associated with the one or more modified course modules to an end user.

This invention belongs to the field of web page data parsing technology, specifically relating to a web page data parsing method based on a large language model. The method includes: obtaining the target website URL input by the user; performing preliminary parsing of the input URL using a large language model; parsing the DOM structure of each website and extracting HTML elements and their hierarchical relationships; generating corresponding data crawling scripts based on the parsing results; executing the data crawling scripts to extract the required data from each website; preprocessing the extracted data; fusing the preprocessed data from multiple sources; extracting key information from the fused data; and storing the finally processed and extracted information in a database. This invention achieves automatic parsing of complex web page data, intelligent entity extraction and knowledge expansion, as well as efficient data fusion and deduplication.

The invention discloses a webpage element similarity detection method based on adaptive clustering, which comprises the following steps: S1, input field XPath processing: receiving an XPath path of at least one target field as input, and verifying the format validity of the XPath path; s2, element path extraction: positioning a corresponding webpage HTML (Hypertext Markup Language) element according to a verified XPath path, and extracting a complete label path of the HTML element from a node of the HTML element to a webpage root node; s3, calculating the similarity; s4, distribution analysis: constructing a symmetric similarity matrix for the comprehensive similarity of all the element pairs obtained in the step S3, and performing statistical distribution analysis on comprehensive similarity values in the similarity matrix by adopting kernel density estimation; s5, self-adaptive clustering: performing multi-target clustering on the HTML elements based on the distribution peak value and the salient interval identified in the step S4; s6, generating an XPath (X Path); and S7, outputting: outputting the optimized general XPath expression. The method has the advantages of high adaptability, high accuracy, good robustness, high efficiency, high universality and the like.

The invention discloses a webpage main body information extraction method and device and a medium, and relates to the technical field of Internet information processing. The method comprises the following steps: acquiring a document object model (DOM) tree of a webpage and visual rendering information of at least one HTML element through a headless browser; based on the visual rendering information, dividing the webpage into at least one visual block by using a visual separation algorithm, and calculating a visual feature score of the visual block; performing weighted fusion on the visual feature scores of the DOM nodes in the DOM tree and the structural feature scores of the DOM nodes to obtain comprehensive weight scores of the DOM nodes; and determining the DOM node with the comprehensive weight score greater than a preset weight threshold as a container node of the main body content, so as to perform information extraction on the container node and obtain main body information of the webpage. Therefore, webpage main body information extraction with high accuracy, good robustness and excellent efficiency can be realized.

A method includes emulating a browser in cooperation with a browser controller for providing a controlled environment to safely execute a web program, loading a web page into the browser, injecting, by executing the browser controller, a first program into the loaded web page, capturing a first visual representation of a HTML element of the web page at a first time after the loading, executing the web page in the browser, logging, via the first program, an execution of a second program embedded in the web page, capturing a second visual representation of the HTML element at a second time later than the first time after the execution of the second program, comparing the first and second visual representation to detect a visual change, identifying the execution of the second program as a cause of the visual change, and performing a remedial action related to the web page in response.

The application discloses a webpage element similarity detection method based on adaptive clustering, comprising the following steps: S1. Input field XPath processing: receiving the XPath path of at least one target field as input, and verifying the format validity of the XPath path; S2. Element path extraction: locating the corresponding webpage HTML element according to the verified XPath path, and extracting the complete tag path of the HTML element from the own node to the webpage root node; S3. Similarity calculation; S4. Distribution analysis: constructing a symmetric similarity matrix of the comprehensive similarity of all element pairs obtained in step S3, and performing statistical distribution analysis on the comprehensive similarity value in the similarity matrix by using kernel density estimation; S5. Adaptive clustering: performing multi-target clustering on the HTML element based on the distribution peak value and significant interval identified in step S4; S6. XPath generation; S7. Output: outputting the optimized general XPath expression. The application has the advantages of strong adaptability, high accuracy, good robustness, high efficiency and strong universality.

This application provides an HTML document processing method, apparatus, HTML element location method, computer device, and storage medium. The method includes: acquiring a document to be processed, which is an HTML document of a page to be tested; identifying multiple target elements among all elements in the document to be processed; each target element includes at least one target attribute, and target attributes with the same attribute name in different target elements conform to a preset rule; generating standard attribute values ​​corresponding to the target elements; the standard attribute values ​​reflect the relative relationships between target elements; adding a retrieval attribute to the target elements to obtain the target document; the attribute name of the retrieval attribute is a string supported by the element selector of an automated testing framework, and the attribute value of the retrieval attribute is the standard attribute value corresponding to the target element. This method ensures good reusability of test cases, greatly reduces repetitive work when writing test cases, and improves the efficiency of test case writing.