4 results about "HTML element" patented technology

This invention belongs to the field of web page data parsing technology, specifically relating to a web page data parsing method based on a large language model. The method includes: obtaining the target website URL input by the user; performing preliminary parsing of the input URL using a large language model; parsing the DOM structure of each website and extracting HTML elements and their hierarchical relationships; generating corresponding data crawling scripts based on the parsing results; executing the data crawling scripts to extract the required data from each website; preprocessing the extracted data; fusing the preprocessed data from multiple sources; extracting key information from the fused data; and storing the finally processed and extracted information in a database. This invention achieves automatic parsing of complex web page data, intelligent entity extraction and knowledge expansion, as well as efficient data fusion and deduplication.

A method includes emulating a browser in cooperation with a browser controller for providing a controlled environment to safely execute a web program, loading a web page into the browser, injecting, by executing the browser controller, a first program into the loaded web page, capturing a first visual representation of a HTML element of the web page at a first time after the loading, executing the web page in the browser, logging, via the first program, an execution of a second program embedded in the web page, capturing a second visual representation of the HTML element at a second time later than the first time after the execution of the second program, comparing the first and second visual representation to detect a visual change, identifying the execution of the second program as a cause of the visual change, and performing a remedial action related to the web page in response.

The application discloses a webpage element similarity detection method based on adaptive clustering, comprising the following steps: S1. Input field XPath processing: receiving the XPath path of at least one target field as input, and verifying the format validity of the XPath path; S2. Element path extraction: locating the corresponding webpage HTML element according to the verified XPath path, and extracting the complete tag path of the HTML element from the own node to the webpage root node; S3. Similarity calculation; S4. Distribution analysis: constructing a symmetric similarity matrix of the comprehensive similarity of all element pairs obtained in step S3, and performing statistical distribution analysis on the comprehensive similarity value in the similarity matrix by using kernel density estimation; S5. Adaptive clustering: performing multi-target clustering on the HTML element based on the distribution peak value and significant interval identified in step S4; S6. XPath generation; S7. Output: outputting the optimized general XPath expression. The application has the advantages of strong adaptability, high accuracy, good robustness, high efficiency and strong universality.

This application provides an HTML document processing method, apparatus, HTML element location method, computer device, and storage medium. The method includes: acquiring a document to be processed, which is an HTML document of a page to be tested; identifying multiple target elements among all elements in the document to be processed; each target element includes at least one target attribute, and target attributes with the same attribute name in different target elements conform to a preset rule; generating standard attribute values ​​corresponding to the target elements; the standard attribute values ​​reflect the relative relationships between target elements; adding a retrieval attribute to the target elements to obtain the target document; the attribute name of the retrieval attribute is a string supported by the element selector of an automated testing framework, and the attribute value of the retrieval attribute is the standard attribute value corresponding to the target element. This method ensures good reusability of test cases, greatly reduces repetitive work when writing test cases, and improves the efficiency of test case writing.